Use a real database #12
Description
With the current solution (json files) we can't parallelize much, because if two crawlers happen to edit the same file at the same time, the file might end up corrupted.
Maybe we can find a database (relational or not) which is not too expensive?