HackerReposA FIELD GUIDE TO OPEN SOURCE
ProSponsor the shelf♧ 0
← Back to top all-time
PrefectHQ
prefect
Python2019–2024
PrefectHQ / prefect

prefect

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

Systems & InfrastructureScience & EngineeringData & DatabasesDevOps & CloudObservabilityAutomation & Workflows
Explore on GitHubRead Hacker News discussions
16Distinct people
16Mentions
0Explicit recommenders
24.2KGitHub stars
REPOSITORY AT A GLANCE

What to know before exploring

What it is

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

GitHub

Where it is used

No documented product use was verified in the last source check.

What people are saying

No recommendation phrase was found in the indexed comments.

No classified warning is attached to this page. Read the discussions before treating silence as approval.

Also in these discussions

No other repository is repeatedly linked in the same discussions.

This week on Hacker News

Nov 7–Nov 14 UTC · Direct repository links and separately labeled related project stories. Indexed through 11/14/2026, 3:56:07 PM UTC.

No direct repository links were found in the indexed HN discussions over the past seven days. Older discussions are available below.

Mentions over time

HN mentions by year16 dated mentions

Observed mentions: 2019-03-25 15:16:14 UTC to 2024-12-03 01:25:54 UTC.

0123452019-01-01 00:00:00 UTC to 2020-01-01 00:00:00 UTC (exclusive): 5 mentions; 5 submissions, 0 comments20192020-01-01 00:00:00 UTC to 2021-01-01 00:00:00 UTC (exclusive): 4 mentions; 3 submissions, 1 comments2021-01-01 00:00:00 UTC to 2022-01-01 00:00:00 UTC (exclusive): 1 mentions; 1 submissions, 0 comments20212022-01-01 00:00:00 UTC to 2023-01-01 00:00:00 UTC (exclusive): 2 mentions; 0 submissions, 2 comments2023-01-01 00:00:00 UTC to 2024-01-01 00:00:00 UTC (exclusive): 1 mentions; 0 submissions, 1 comments2024-01-01 00:00:00 UTC to 2025-01-01 00:00:00 UTC (exclusive): 3 mentions; 1 submissions, 2 comments2024

Counts come from the repository’s dated source evidence. Index cutoff: 2026-11-02 08:16:59 UTC.

View mention counts and date ranges
UTC ranges include their start and exclude their end. Select a period to filter the source evidence.
PeriodStart (UTC)End (exclusive, UTC)MentionsSubmissionsComments
20192019-01-01 00:00:00 UTC2020-01-01 00:00:00 UTC550
20202020-01-01 00:00:00 UTC2021-01-01 00:00:00 UTC431
20212021-01-01 00:00:00 UTC2022-01-01 00:00:00 UTC110
20222022-01-01 00:00:00 UTC2023-01-01 00:00:00 UTC202
20232023-01-01 00:00:00 UTC2024-01-01 00:00:00 UTC101
20242024-01-01 00:00:00 UTC2025-01-01 00:00:00 UTC312

What Hacker News says

16 sources
dhx·Nov 13, 2024
This account was spamming Python repositories with the same type of low value obvious backdoor spam.[1] Full list of attempted pull requests (all deleted seemingly by GitHub): 1 https://www.github.com/KurtBestor/Hitomi-Downloader/pull/7638 2 https://www.github.com/home-assistant/core/pull/130423 3 https://www.github.com/celery/celery/pull/9407 4 https://www.github.com/chriskiehl/Gooey/pull/921 5 https://www.github.com/crewAIInc/crewAI/pull/1582 6 https://www.github.com/cumulo-autumn/StreamDiffusion/pull/177 7 https://www.github.com/AUTOMATIC1111/stable-diffusion-webui/pull/16646 8 https://www.github.com/Aider-AI/aider/pull/2343 9 https://www.github.com/aboul3la/Sublist3r/pull/383 10 https://www.github.com/plotly/dash/pull/3073 11 https://www.github.com/soimort/you-get/pull/3034 12 https://www.github.com/streamlink/
Read the rest
streamlink/pull/6290 13 https://www.github.com/jumpserver/jumpserver/pull/14440 14 https://www.github.com/junyanz/pytorch-CycleGAN-and-pix2pix/pull/1684 15 https://www.github.com/kornia/kornia/pull/3069 16 https://www.github.com/langflow-ai/langflow/pull/4520 17 https://www.github.com/exo-explore/exo/pull/432 18 https://www.github.com/PostHog/posthog/pull/26144 19 https://www.github.com/PrefectHQ/prefect/pull/15987 20 https://www.github.com/pydantic/pydantic/pull/10822 21 https://www.github.com/pyg-team/pytorch_geometric/pull/9777 22 https://www.github.com/qutebrowser/qutebrowser/pull/8379 23 https://www.github.com/tornadoweb/tornado/pull/3441 24 https://www.github.com/ungoogled-software/ungoogled-chromium/pull/3092 25 https://www.github.com/locustio/locust/pull/2980 26 https://www.github.com/matterport/Mask_RCNN/pull/3057 27 https://www.github.com/Stability-AI/generative-models/pull/425 28 https://www.github.com/yt-dlp/yt-dlp/pull/11520 [1] https://play.clickhouse.com/play?user=play#U0VMRUNUICogRlJPT...
In Backdoor attempt on Exolabs GitHub repo through an innocent looking PR
jlowin·Apr 8, 2023
Sure! We wrote a little bit about the origins in an announce post a couple weeks ago (https://news.ycombinator.com/item?id=35366838). Marvin (https://www.github.com/prefecthq/marvin) powers our AI efforts at Prefect (https://www.github.com/prefecthq/prefect). The first version of Marvin was an internal framework that powered our Slackbot. There are close to 30,000 members of our open-source community and we rely heavily on automation to deliver support. Then, as more of our customers started building AI stacks, we began to view Marvin as a platform to experiment with high-level UX for deploying AI. We have a few internal use cases, but it was the diversity of customer objectives that gave us confidence. Historically, we've always focused on data engineering, but the more we worked with LLMs, the more we saw the same set of issues, basical
Read the rest
ly driven by the need to integrate brittle, non-deterministic APIs that are heavily influenced by external state into well-structured traditional engineering and pipelines. We started using Marvin to codify the high-level patterns we were repeatedly deploying, including getting structured outputs from the LLM and building effective conversational agents for B2B use. The lightbulb moment was when we designed AI functions, which have no source code and essentially use the LLM as a runtime. It's one of those ideas that feels too simple to actually work... but it actually works incredibly well. It was the first time we felt like we weren't building tools to use AI, but rather using AI to build our tools. We open-sourced with AI functions as the headline and the response has been amazing! Now we're focused on releasing the "core" of Marvin -- the bots, plugins, and knowledge handling -- with a similar focus on usability. Hope that's what you were looking for!
In Show HN: A ChatGPT TUI with custom bots
rpeden·Sep 14, 2022
Disclaimer: I work for Prefect. It looks like we added cron and other schedule types to the deployment CLI just under a month ago[1]. Over the last couple of releases, we've also made it easier to pull deployments from GitHub or bake your flow code into Docker images instead of needing S3-like storage. As with any product, there's always more to do, so I appreciate you sharing your thoughts. More than anywhere else I've worked, community feedback is a huge driver of product enhancements and feature development. Feel free to join our Slack community[2] if you'd like to share more feedback or ask questions. [1] https://github.com/PrefectHQ/prefect/blob/main/RELEASE-NOTES... [2] https://www.prefect.io/slack/
In Dabbling with Dagster vs. Airflow
knite·May 30, 2020
There are too many different tools in the space. I've been heavily researching workflow / ETL frameworks this week, and even after culling the ones that seemed like poor fits, I'm still left with: - https://github.com/getpopper/popper - https://docs.pachyderm.com/ - https://github.com/lyft/flyte - https://aws.amazon.com/step-functions/ - https://github.com/spotify/luigi - https://docs.metaflow.org/ - https://github.com/dagster-io/dagster - https://github.com/argoproj/argo - https://github.com/prefecthq/prefect
In Introduction to Apache Airflow

Showing the 15 most recent of 16 sources. Enable JavaScript to search and browse every indexed mention.

MAKE YOURSELF AT HOME

A few shortcuts

/
Search the collection
?
Open this guide
Esc
Close dialogs and navigation

Your saved repositories and interests stay in this browser.