Show HN: A SQLite-backed job queue handling 15k jobs/s

by joseferbenon 9/4/2024, 7:15 PMwith 0 comments

15k jobs/s is on my macbook pro m1 without batching.

i did a bit of benchmarking and optimizing, but there are probably quite a few things that can be done to improve throughput.

plainjobs is a bit more feature complete than just a bare-bones queue with atomic pop semantic. it supports scheduled cron jobs and auto re-queueing if a worker dies.

the queue has an api that can be used to build a dashboard, which is one of the next things i'm going to do.

i extracted plainjobs while working on a SQLite stack for web development in TypeScript, hoping it could be useful for others!

0