let's see what's new in this fork of the warc lib#22

Open

nlevitt wants to merge 28 commits intointernetarchive:masterfrom

sacabuche:master

Commits on Nov 15, 2014

Test to make sure arc file header is written just once.

Anand Chitipothu
authored and
recrm
committed
Fixed the issue of writing duplicate file header in arc file.

Anand Chitipothu
authored and
recrm
committed
ARCFile: filename is specified should be used and should work even if filename is not specified.

Anand Chitipothu
authored and
recrm
committed
bump version to 0.2.1

Anand Chitipothu
authored and
recrm
committed
Added some bugfixes
recrm
committed
Ran 2to3, fixed CaseInsensitiveDict
recrm
committed

Commits on Nov 22, 2014

Commits on Dec 3, 2014

Updated testing, improved HTTPObject. Numerous bug fixes in warc
recrm
committed

Commits on Dec 12, 2014

update to HTTPObject
recrm
committed

Commits on Dec 15, 2014

Added warcscrape.py and supporting files.
recrm
committed

Commits on Jul 28, 2015

Remove reference to HTTPObject
jpbruinsslot
committed
* warc.py: fix for creating warc files based on a requests response.
Almer S. Tigelaar
committed

Commits on Aug 11, 2015

* warc.py: disable encoding/decoding and simply store and work with raw bytes instead.
Almer S. Tigelaar
committed

Commits on Aug 13, 2015

Commits on Apr 14, 2016

Fix corner case when record_length is zero
sacabuche
committed

Commits on Apr 22, 2016

Commits on Apr 26, 2016