Think about using redis as chache

[FreakyBytes]

Trac Ticket #11

component: code
owner: somebody
reporter: martinP
created: 2016-09-06 13:06:57
milestone:
type: proposal
version:
keywords:

With increasing usage it might be a good idea to cache crawling results to reduce traffic and waiting time. A possible solution could be to use a redis server. Adapting redis as cache could also improve distributed deployment on a long-shot

Java-lib: http://redis.paluch.biz/
redis: http://redis.io/