database.sqltable Module

SQLAlchemy table implementations.

class wpull.database.sqltable.BaseSQLURLTable[source]

Bases: wpull.database.base.BaseURLTable

add_many(new_urls)[source]
add_visits(visits)[source]
check_in(url, new_status, increment_try_count=True, url_result=None)[source]
check_out(filter_status, level=None)[source]
convert_check_in(file_id, status)[source]
convert_check_out()[source]
count()[source]
get_all()[source]
get_hostnames()[source]
get_one(url)[source]
get_revisit_id(url, payload_digest)[source]
get_root_url_todo_count()[source]
release()[source]
remove_many(urls)[source]
update_one(url, **kwargs)[source]
class wpull.database.sqltable.SQLiteURLTable(path=':memory:')[source]

Bases: wpull.database.sqltable.BaseSQLURLTable

URL table with SQLite storage.

Parameters:path – A SQLite filename
close()[source]
class wpull.database.sqltable.GenericSQLURLTable(url)[source]

Bases: wpull.database.sqltable.BaseSQLURLTable

URL table using SQLAlchemy without any customizations.

Parameters:url – A SQLAlchemy database URL.
close()[source]
wpull.database.sqltable.URLTable

The default URL table implementation.

alias of SQLiteURLTable

wpull.database.sqltable.convert_dict_enum_values(dict_)[source]