`database.wrap` Module¶

URL table wrappers.

class wpull.database.wrap.URLTableHookWrapper(url_table)[source]¶

Bases: wpull.database.base.BaseURLTable, wpull.application.hook.HookableMixin

URL table wrapper with scripting hooks.

Parameters:	url_table – URL table.

url_table¶: URL table.

add_many(urls)[source]¶

add_visits(visits)[source]¶

check_in(url, new_status, increment_try_count=True, url_result=None)[source]¶

check_out(filter_status, filter_level=None)[source]¶

close()[source]¶

convert_check_in(file_id: int, status: wpull.pipeline.item.Status)[source]¶

convert_check_out()[source]¶

count()[source]¶

static dequeued_url(url_info: wpull.url.URLInfo, record_info: wpull.pipeline.item.URLRecord)[source]¶: Callback fired after an URL was retrieved from the queue.

get_all()[source]¶

get_hostnames()[source]¶

get_one(url)[source]¶

get_revisit_id(url, payload_digest)[source]¶

get_root_url_todo_count()[source]¶

queue_count()[source]¶: Return the number of URLs queued in this session.

static queued_url(url_info: wpull.url.URLInfo)[source]¶: Callback fired after an URL was put into the queue.

release()[source]¶

remove_many(urls)[source]¶

update_one(*args, **kwargs)[source]¶