Common Crawl's text corpus, around 13 TB and 2.8 billion records, is now loaded into MongoDB.
Software & Data
The Burf.co search engine and data projects.
Elasticsearch : I did it, I used an existing framework, not recreate the wheel :)
Switching Burf.co search to Elasticsearch, fed from Common Crawl data filtered through MongoDB, all in Java.
Read more of Elasticsearch : I did it, I used an existing framework, not recreate the wheel :) →
DeletedCity.net
DeletedCity.net, an interactive archive of GeoCities, and what should happen to old websites.
Experimenting with MongoKitten
Using MongoDB via MongoKitten from server-side Swift for the Burf.co search engine, and the query gotchas I hit.
Burf is on GitHub
My code starts going up on GitHub, starting with the projects I'm happy for others to use.
