Common Crawl Foundation

@CommonCrawl

Common Crawl is a non-profit foundation dedicated to the Open Web.

San Francisco, CA

Common Crawl Foundation
@CommonCrawl
7h
Introducing warc2zip We are pleased to introduce warc2zip, a tool that allows anyone to turn WARC archives into simpler, zipped files that can be inspected with ordinary tools.
3
Common Crawl Foundation
@CommonCrawl
Oct 30
The uneven rise of AI-generated web content arxiv.org/pdf/2610.36631
3
Common Crawl Foundation
@CommonCrawl
Oct 24
Common Crawl Foundation will be at IETF 127 in SF, week of November 15. If you are around, we'd love to chat!
1
Common Crawl Foundation
@CommonCrawl
Oct 21
October 2026 Crawl Archive Now Available We are pleased to announce the release of the October 2026 crawl archive, consisting of 2.16 billion pages (or 371.19 TiB of uncompressed content)
1
Common Crawl Foundation
@CommonCrawl
Oct 14
Somali was written down on purpose. AI is learning it by accident - Hiiraan Online
From hiiraan.com

Common Crawl Foundation’s posts