bq

I have nothing against pg_boss[0] from the articel (I don't know anything about it), but there are plenty of queues and crons and schedulers for PG Some others: * https://github.com/LaunchPlatform/bq * https://github.com/cybertec-postgresql/pg_timetable * https://github.com/pgmq/pgmq * https://github.com/riverqueue/river * https://github.com/oban-bg/oban * https://github.com/pgadmin-org/pgagent * https://github.com/citusdata/pg_cron etc. There are plenty of options to choose from. 0: https://github.com/timgit/pg-boss

Hatchet looks pretty awesome. I was thinking about using it to replace my Celery worker. However, the problem is that I can only use the gRPC client to create a task (correct me if I am wrong). What I want is to be able to commit a bunch of database rows altogether with the background task itself directly. The benefit of doing so with a PostgreSQL database is that all the rows will be in the same transaction. With traditional background worker solutions, you will run into two problems: 1. Commit changes in the db first: if you fail to enqueue the task, there will be data rows hanging in the db but no task to process them 2. Push the task first: the task may kick start too early, and the DB transaction is not committed yet, it cannot find the rows still in transaction. You will need to retry failure We also looked at Celery and hope it can