pg-boss

https://github.com/timgit/pg-boss https://github.com/hatchet-dev/hatchet are both on top of Postgres, but I like the SQLite here for a project I have in mind.

Looks really neat! Starred on GitHub! If you have heard of pg-boss [1], how does sidequest compare to it? I’m about to embark on some « jobification » on some flows and I’d love to have your opinion (possibly biased, but still)! [1] https://github.com/timgit/pg-boss

It's polling using javascript timers: https://github.com/timgit/pg-boss/blob/master/src/attorney.j...

I have nothing against pg_boss[0] from the articel (I don't know anything about it), but there are plenty of queues and crons and schedulers for PG Some others: * https://github.com/LaunchPlatform/bq * https://github.com/cybertec-postgresql/pg_timetable * https://github.com/pgmq/pgmq * https://github.com/riverqueue/river * https://github.com/oban-bg/oban * https://github.com/pgadmin-org/pgagent * https://github.com/citusdata/pg_cron etc. There are plenty of options to choose from. 0: https://github.com/timgit/pg-boss

What like pg boss for Node? https://github.com/timgit/pg-boss

Another one for Node is PG-Boss (https://github.com/timgit/pg-boss)

I think for me the problem with every single new PG queue is that it seems like everyone and their mother thinks they need to reinvent this specific wheel for some reason and the flavor of the day doesn’t often bring much new to the space. Probably because it's 1. Pretty easy to understand and grok the problem space 2. Scratching the programmer itch of wanting something super generic that you can reuse all over the place 3. Doable with a modest effort over a reasonable scope of time 4. Built on rock solid internals (Postgres) with specific guarantees that you can lean on Here's 7 of them just right quick: - https://github.com/timgit/pg-boss - https://github.com/queueclassic/queue_classic - https://github.com/florentx/pgqueue - https://github.com/mbreit/pg_jobs - https://github.com/graphile/worker - https://github.com/pgq/pgq - https://git

How is this different from pg-boss[1]? Other than the distributed part it also seems to use skip locked. [1] https://github.com/timgit/pg-boss

For running queues on Postgres with Node.js backend(s), I highly recommend https://github.com/timgit/pg-boss. I'm sure it has it scale limits. But if you're one of the 90% of the apps that never needs any kind of scale that a modern server can't easily handle then it's fantastic. You get transactional queueing of jobs, and it automatically handles syncing across multiple job processing servers using Postgres locks.

There are libraries that implement queueing on top of databases that require very little setup by the user. For example https://github.com/timgit/pg-boss

If you don't want to roll your own, look into https://github.com/timgit/pg-boss

(I'm assuming you want a queue/workflow engine) Temporal has done an incredible job of ensuring there will be no side-effects (even with external systems), so I doubt we'll be able to do something as extensive as they have. That said, we will probably build a simple Postgres queue/workflow engine (similar to pgboss[0]). It will live in the Postgres database (as an extension), but will be nicely integrated with Edge Functions. We haven't started this yet, so I don't have any timelines. [0] pgboss: https://github.com/timgit/pg-boss

Both! For context, we're currently using https://github.com/timgit/pg-boss as a task queue on top of postgres and it works great. No need to complicate things with Redis. I believe it's quite straightforward to implement a task queue on top of postgres using the SKIP LOCKED functionality.

If you are using node.js and looking for PgSQL based JobQueue, PgBoss (https://github.com/timgit/pg-boss) is a solid one!