Designing Background Jobs for Safety and Efficiency
Designing Background Jobs for Safety and Efficiency

Designing Background Jobs for Safety and Efficiency

Author
Shiv Bade
Tags
background jobs
task queues
Published
November 10, 2016
Featured
Slug
Tweet
Background workers sound simple but can be risky.
Design considerations: - At-least-once vs at-most-once - Idempotency in job handlers - Retry, visibility timeout, and dead-letter queues
Queue tools: Sidekiq, RabbitMQ, Amazon SQS.