Use a queueing system which can scale

[adamalton]

Currently all incoming requests (name records from w3name)are stored in memory before they are processed and sent to the DHT. At the current traffic this is perfectly acceptable, but at a certain scale or volume of requests, this might cause the service to fall over.

@francois-potato and @josh Ghent made a proposal for this, which is to use SQS with a FIFO queue using this tool: https://github.com/bbc/sqs-consumer

Proposal write-up here: https://www.notion.so/ipns-publisher-2-258f425cabf4444b826481918f7b4c1e

That proposal is assuming that this service gets moved to AWS though, which so far it hasn't been. This service is currently still running on Digital Ocean.