application.tasks.warc Module

class wpull.application.tasks.warc.WARCRecorderSetupTask[source]

Bases: wpull.pipeline.pipeline.ItemTask

process(session: wpull.pipeline.app.AppSession)[source]
class wpull.application.tasks.warc.WARCRecorderTeardownTask[source]

Bases: wpull.pipeline.pipeline.ItemTask

process(session: wpull.pipeline.app.AppSession)[source]
class wpull.application.tasks.warc.WARCVisitsTask[source]

Bases: wpull.pipeline.pipeline.ItemTask

process(session: wpull.pipeline.app.AppSession)[source]

Populate the visits from the CDX into the URL table.