We are building a platform for comparing websites on a detailed level. We are using MongoDB to store all the information and it works quite nicely. We use it to store all meta-information of the domains, because MongoDB better fits the requirements. For example: We retrieve different kind of data for every domain so I […]

We are currently developing a system which wants to analyze all the domains in the internet. This is a really challenging task and not easily done in a few months time. Besides loads of problems, like finding so many domains and parsing them in a reasonable amount of time we also implement a MongoDB cluster […]