My thesis - building blocks of a scalable webcrawler - Marc's Blog

http://blog.marc-seeger.de/2010/12/09/my-thesis-building-blocks-of-a-scalable-webcrawler

In my last semester as a student, I had the chance of working for an awesome company (Acquia) on a very interesting project. It all started with a post over at Dries Buytaert's blog. He is the CTO and co-founder of Acquia (and Mollom), inventor of Drupal, open-source celebrity and also knows a thing or two about FPGA-aware garbage collection :). I had a great time with a lot of brilliant people and learned tons and tons about scalability, nosql and asynchronous I/O.
Tags: nosql, scalability, crawling, io, programming, webcrawler, asynchronous, thesis, searchengine, web Saved by: admin