Unsupported WARC version: 1.1

[kiska3]

example file

f = warc.open("example.warc.gz")
for record in f:
     print record['WARC-Target-URI'], record['Content-Length']

Expected Behaviour

Prints records with URI + Content Length

Observed Behaviour:

Traceback (most recent call last):
File "", line 1, in
File "/home/kiska/.local/lib/python2.7/site-packages/warc/warc.py", line 390, in iter
record = self.read_record()
File "/home/kiska/.local/lib/python2.7/site-packages/warc/warc.py", line 373, in read_record
header = self.read_header(fileobj)
File "/home/kiska/.local/lib/python2.7/site-packages/warc/warc.py", line 334, in read_header
raise IOError("Unsupported WARC version: %s" % version)
IOError: Unsupported WARC version: 1.1

[ivanistheone]

This seems to be a known issue for .warc.gz files.

See workaround in #21 (comment) and #21 (comment) .

[JustAnotherArchivist]

@ivanistheone Yes, there are many bugs in this library. This is a lack of support for the WARC/1.1 specification though and has nothing to do with #21.