Why we stopped crawling the web (and how we got it started again)

Our open source search engine Mwmbl is crawled by our community. But it stopped working for a while and I explain how we got it going again.

[@IgorAlexeyM]

Good job! I just learned about the project. I was seeking for an alternate search engine a few months ago, and this looks good!

[@mwmbl]

Cool, thanks!

[@rojorum2433]

Very interesting, I have always wondered how the big search engines handled all the link data. I will be watching your career with great interest.

[@mwmbl]

Thanks! Glad it you found it interesting