JIjinqueeny·Aug 5, 2018Submission
Machinery: an asynchronous task/job queue based on distributed message passing
10 points · Open discussionRichardKnop
machinery
Go2015–2018
RichardKnop / machinery
machinery
Machinery is an asynchronous task queue/job queue based on distributed message passing.
3Distinct people
9Mentions
0Explicit recommenders
8KGitHub stars
What to know before exploring
What it is
Machinery is an asynchronous task queue/job queue based on distributed message passing.
GitHub
Where it is used
No documented product use has been verified yet.
What people are saying
No recommendation phrase was found in the indexed comments.
No classified warning is attached to this page. Read the discussions before treating silence as approval.
Also in these discussions
No other repository is repeatedly linked in the same discussions.
This week on Hacker News
Nov 7–Nov 14 UTC · Direct repository links and separately labeled related project stories. Indexed through 11/14/2026, 5:04:57 PM UTC.
No direct repository links were found in the indexed HN discussions over the past seven days. Older discussions are available below.
Mentions over time
HN mentions by year9 dated mentions
Observed mentions: 2015-05-10 17:55:46 UTC to 2018-08-05 04:50:44 UTC.
Counts come from the repository’s dated source evidence. Index cutoff: 2026-11-02 08:16:59 UTC.
View mention counts and date ranges
| Period | Start (UTC) | End (exclusive, UTC) | Mentions | Submissions | Comments |
|---|---|---|---|---|---|
| 2015 | 2015-01-01 00:00:00 UTC | 2016-01-01 00:00:00 UTC | 1 | 1 | 0 |
| 2016 | 2016-01-01 00:00:00 UTC | 2017-01-01 00:00:00 UTC | 1 | 0 | 1 |
| 2017 | 2017-01-01 00:00:00 UTC | 2018-01-01 00:00:00 UTC | 5 | 1 | 4 |
| 2018 | 2018-01-01 00:00:00 UTC | 2019-01-01 00:00:00 UTC | 2 | 1 | 1 |
What Hacker News says
9 sourcesWould like to know this as well.
I have been on the lookout for a similar system to SideKiq.
Unfortunately for Go, there isn't anything that matches it 100%.
I have looked into:
https://github.com/celrenheit/sandglass
https://github.com/RichardKnop/machinery
https://github.com/contribsys/faktory
In the end I went with machinery due to supporting:
- Batches (or Groups, tasks executed at the same time)
- Chains (tasks executed one by one)
- Callbacks (a task executed, on completion of a Batch)
- Cron Jobs
- Rescheduling failed jobs
- Long-runnng Jobs
- Distributed/Fault Tolerant DB (for Jobs)
- Distributed/Fault Tolerant Workers
+ other things I cant remember now.
It would be very interesting to know if this is going to be opened sourced and whether it supports the list above.
In Centrifuge: a reliable system for delivering billions of events per dayObligatory plug of my own job queue in Go: https://github.com/RichardKnop/machinery
In Show HN: Sandglass – Distributed, scalable, persistent time-sorted message queueMy biggest project which led to some networking: https://github.com/RichardKnop/machinery
More projects here: https://github.com/RichardKnop
In Ask HN: What are your personal projects that helped in landing a job?I haven't regretted making anything open source.
I do agree with the sentiment expressed here several times. Once my open source project gets popular it seems that there is a flood of incoming bug fix / feature requests and it is quite overwhelming.
People expect you to just work on the open source library almost as it were your full time job (without a compensation). So that can be frustrating.
This problem can be solved by finding skilled contributors who would be willing to work with you on maintaining the project but this can be quite difficult.
Let's say your project is just reasonably popular (1-2 thousand stars on Github), you will be hard pressed to find willing contributors. It's much easier once the project gets very popular (5k stars I guess).
It also depends on the language and niche of the library. Might be easier to find con
Read the rest
tributors in certain languages than others.
Having said all that, my open source projects have actually paid me back in a way of interesting work opportunities that I wouldn't otherwise stumble upon. And it's a nice to have some reasonably well received open source project on your CV.
Finally, I would like to shamelessly plug my project: https://github.com/RichardKnop/machinery
Core contributors / maintainers always welcome!
A bit of a plug but this is my "flagship" open source project and I have worked on the codebase since late 2015 (a lot of time) so hopefully it should be a good example to take a look at.
Also would like to hear feedback if you spot something which doesn't seem pretty/idiomatic in my code.
https://github.com/RichardKnop/machinery
In Ask HN: Good Go codebases to read?Show HN: Machinery – asynchronous task queue (Golang implementation of Celery)
13 points · Open discussionI have written a similar library a while ago called machinery.
Though inspired by celery I tried to write it in a more idiomatic Go way.
Currently supports RabbitMQ and Redis brokers and many backends.
https://github.com/RichardKnop/machinery
In Gocelery: Celery Distributed Task Queue in GoMachinery: An asynchronous task/job queue for Golang
26 points · Open discussion