database.wrap Module

URL table wrappers.

class wpull.database.wrap.URLTableHookWrapper(url_table)[source]

Bases: wpull.database.base.BaseURLTable, wpull.application.hook.HookableMixin

URL table wrapper with scripting hooks.

Parameters:url_table – URL table.
url_table

URL table.

add_many(urls)[source]
add_visits(visits)[source]
check_in(url, new_status, increment_try_count=True, url_result=None)[source]
check_out(filter_status, filter_level=None)[source]
close()[source]
convert_check_in(file_id: int, status: wpull.pipeline.item.Status)[source]
convert_check_out()[source]
count()[source]
static dequeued_url(url_info: wpull.url.URLInfo, record_info: wpull.pipeline.item.URLRecord)[source]

Callback fired after an URL was retrieved from the queue.

get_all()[source]
get_hostnames()[source]
get_one(url)[source]
get_revisit_id(url, payload_digest)[source]
get_root_url_todo_count()[source]
queue_count()[source]

Return the number of URLs queued in this session.

static queued_url(url_info: wpull.url.URLInfo)[source]

Callback fired after an URL was put into the queue.

release()[source]
remove_many(urls)[source]
update_one(*args, **kwargs)[source]