cookiewrapper Module

Wrappers that wrap instances to Python standard library.

class wpull.cookiewrapper.CookieJarWrapper(cookie_jar, save_filename=None, keep_session_cookies=False)[source]

Bases: object

Wraps a CookieJar.

Parameters:
  • cookie_jar – An instance of http.cookiejar.CookieJar.
  • save_filename (str, optional) – A filename to save the cookies.
  • keep_session_cookies (bool) – If True, session cookies are kept when saving to file.

Wrapped add_cookie_header.

Parameters:
  • request – An instance of http.request.Request.
  • referrer_host (str) – An hostname or IP address of the referrer URL.
close()[source]

Save the cookie jar if needed.

cookie_jar

Return the wrapped Cookie Jar.

extract_cookies(response, request, referrer_host=None)[source]

Wrapped extract_cookies.

Parameters:
class wpull.cookiewrapper.HTTPResponseInfoWrapper(response)[source]

Bases: object

Wraps a HTTP Response.

Parameters:response – An instance of http.request.Response
info()[source]

Return the header fields as a Message:

Returns:An instance of email.message.Message. If Python 2, returns an instance of mimetools.Message.
Return type:Message
wpull.cookiewrapper.convert_http_request(request, referrer_host=None)[source]

Convert a HTTP request.

Parameters:
  • request – An instance of http.request.Request.
  • referrer_host (str) – The referrering hostname or IP address.
Returns:

An instance of urllib.request.Request

Return type:

Request