Wednesday 28 November 2018

Need help figuring out an architecture for background processing of jobs on node.

So the idea is the client makes a request to a task manager. This task manager makes jobs from this request and stores each job state along with id in DB and returns the job ids back to client. The task manager then pushes it queue. After the queue consumer is done processing it sends an ack back to task manager (who was the producer). This task manager then marks this job as complete. Meanwhile client was polling task manager for state of job, which now comes back as completed.​I have looked into Kue, Agenda, Bull, bee-queue. But they dont have rest-api layer to communicate or persistence.Was thinking if there is any ready made solution out there for this job for node? Was thinking of using RabbitMQ but then would have to do state management myself.Please help.

Submitted November 28, 2018 at 12:21PM by fap_frenzy

No comments:

Post a Comment