WARC Data Downloads
Access raw Web ARChive files spanning 1990–1999. Filter by era, compression, or geographic region. All files are cryptographically signed and available under open academic licenses.
14 datasets found • 82.4 GB total
| Filename | Year | Records | Size | Format | SHA-256 | Actions |
|---|---|---|---|---|---|---|
| us-east-1993-v1.warc.gz | 1993 | 14,203 | 2.4 GB | WARC GZip | a1f9c3...8d2e | |
| eu-central-1995-v2.warc.gz | 1995 | 89,412 | 8.1 GB | WARC GZip | b7e21f...4c9a | |
| geo-1997-angelfire.warc.gz | 1997 | 245,000 | 14.3 GB | WARC GZip | 9f3d01...7b8e | |
| gov-1998-ftpsites.warc.gz | 1998 | 112,500 | 9.7 GB | WARC GZip | c4a8b2...1f3d | |
| edu-1999-univ.warc.gz | 1999 | 310,200 | 22.1 GB | WARC GZip | d8f1a0...5e7c |
📦 WARC Specification
All archives comply with WARC-1.1 & WARC-2.0 standards (RFC 8491 / RFC 8693). Files include proper Conductor, Metadata, and Response records. Compression uses standard gzip (-9) for maximum density.
# Verify integrity locally
$ sha256sum us-east-1993-v1.warc.gz
a1f9c3...8d2e us-east-1993-v1.warc.gz
$ warcstat us-east-1993-v1.warc.gz
[✓] 14,203 requests | 13,890 responses | 312 metadata
⌨️ CLI & API Usage
Stream datasets directly into your pipeline using our authenticated download endpoints. Supports resumable transfers and chunked GZip extraction.
# Stream via curl with auth token
$ curl -H "Authorization: Bearer $TOKEN" \
https://api.1990webarchive.org/v2/datasets/geo-1997-angelfire.warc.gz \
-o angelfire.warc.gz
$ pywarc parse angelfire.warc.gz --output html/
[✓] Parsed 245,000 records in 42.1s
- All WARC datasets are released under CC BY-SA 4.0. Attribution to "1990 Web Archive" is required.
- Academic & research use is unrestricted. Commercial redistribution requires a separate data license.
- Rate limits: 500 requests/min per token. Bulk downloads should use the `/v2/manifest` endpoint.
- Personal data & PII have been redacted per GDPR & archive preservation standards. Consult the `REDACTION-NOTES.md` bundle.