JDjdiennbn·Mar 1, 2026Submission
A deterministic execution specification for autonomous agent systems
2 points · Open discussionjustindobbs
Tracecore
Python2026–2026
justindobbs / Tracecore
Tracecore
Deterministic runtime for agent evaluation
Languages & CompilersScience & EngineeringAI & Machine LearningLearning & ReferenceTesting & QualityObservability
2Distinct people
2Mentions
0Explicit recommenders
7GitHub stars
What to know before exploring
What it is
Deterministic runtime for agent evaluation
GitHub
Where it is used
No documented product use has been verified yet.
What people are saying
No recommendation phrase was found in the indexed comments.
No classified warning is attached to this page. Read the discussions before treating silence as approval.
Also in these discussions
No other repository is repeatedly linked in the same discussions.
This week on Hacker News
Nov 7–Nov 14 UTC · Direct repository links and separately labeled related project stories. Indexed through 11/14/2026, 3:03:16 PM UTC.
No direct repository links were found in the indexed HN discussions over the past seven days. Older discussions are available below.
Mentions over time
HN mentions by 3-hour interval2 dated mentions
Observed mentions: 2026-02-26 22:07:31 UTC to 2026-03-01 21:11:47 UTC.
Counts come from the repository’s dated source evidence. Index cutoff: 2026-11-02 08:16:59 UTC.
View mention counts and date ranges
| Period | Start (UTC) | End (exclusive, UTC) | Mentions | Submissions | Comments |
|---|---|---|---|---|---|
| Feb 26, 21:00 | 2026-02-26 21:00:00 UTC | 2026-02-27 00:00:00 UTC | 1 | 1 | 0 |
| Feb 27, 00:00 | 2026-02-27 00:00:00 UTC | 2026-02-27 03:00:00 UTC | 0 | 0 | 0 |
| Feb 27, 03:00 | 2026-02-27 03:00:00 UTC | 2026-02-27 06:00:00 UTC | 0 | 0 | 0 |
| Feb 27, 06:00 | 2026-02-27 06:00:00 UTC | 2026-02-27 09:00:00 UTC | 0 | 0 | 0 |
| Feb 27, 09:00 | 2026-02-27 09:00:00 UTC | 2026-02-27 12:00:00 UTC | 0 | 0 | 0 |
| Feb 27, 12:00 | 2026-02-27 12:00:00 UTC | 2026-02-27 15:00:00 UTC | 0 | 0 | 0 |
| Feb 27, 15:00 | 2026-02-27 15:00:00 UTC | 2026-02-27 18:00:00 UTC | 0 | 0 | 0 |
| Feb 27, 18:00 | 2026-02-27 18:00:00 UTC | 2026-02-27 21:00:00 UTC | 0 | 0 | 0 |
| Feb 27, 21:00 | 2026-02-27 21:00:00 UTC | 2026-02-28 00:00:00 UTC | 0 | 0 | 0 |
| Feb 28, 00:00 | 2026-02-28 00:00:00 UTC | 2026-02-28 03:00:00 UTC | 0 | 0 | 0 |
| Feb 28, 03:00 | 2026-02-28 03:00:00 UTC | 2026-02-28 06:00:00 UTC | 0 | 0 | 0 |
| Feb 28, 06:00 | 2026-02-28 06:00:00 UTC | 2026-02-28 09:00:00 UTC | 0 | 0 | 0 |
| Feb 28, 09:00 | 2026-02-28 09:00:00 UTC | 2026-02-28 12:00:00 UTC | 0 | 0 | 0 |
| Feb 28, 12:00 | 2026-02-28 12:00:00 UTC | 2026-02-28 15:00:00 UTC | 0 | 0 | 0 |
| Feb 28, 15:00 | 2026-02-28 15:00:00 UTC | 2026-02-28 18:00:00 UTC | 0 | 0 | 0 |
| Feb 28, 18:00 | 2026-02-28 18:00:00 UTC | 2026-02-28 21:00:00 UTC | 0 | 0 | 0 |
| Feb 28, 21:00 | 2026-02-28 21:00:00 UTC | 2026-03-01 00:00:00 UTC | 0 | 0 | 0 |
| Mar 1, 00:00 | 2026-03-01 00:00:00 UTC | 2026-03-01 03:00:00 UTC | 0 | 0 | 0 |
| Mar 1, 03:00 | 2026-03-01 03:00:00 UTC | 2026-03-01 06:00:00 UTC | 0 | 0 | 0 |
| Mar 1, 06:00 | 2026-03-01 06:00:00 UTC | 2026-03-01 09:00:00 UTC | 0 | 0 | 0 |
| Mar 1, 09:00 | 2026-03-01 09:00:00 UTC | 2026-03-01 12:00:00 UTC | 0 | 0 | 0 |
| Mar 1, 12:00 | 2026-03-01 12:00:00 UTC | 2026-03-01 15:00:00 UTC | 0 | 0 | 0 |
| Mar 1, 15:00 | 2026-03-01 15:00:00 UTC | 2026-03-01 18:00:00 UTC | 0 | 0 | 0 |
| Mar 1, 18:00 | 2026-03-01 18:00:00 UTC | 2026-03-01 21:00:00 UTC | 0 | 0 | 0 |
| Mar 1, 21:00 | 2026-03-01 21:00:00 UTC | 2026-03-02 00:00:00 UTC | 1 | 1 | 0 |
What Hacker News says
2 sourcesShow HN: Tracecore: Benchmark AI Agents on Deterministic Coding Tasks
I'm sharing Tracecore, an OS tool I'm building to evaluate AI agents' ability to handle deterministic software tasks like log triage, config remediation, and incident recovery. It started as a way to test whether agents could reliably perform structured operations without free-form guessing, inspired by frustrations with brittle automation in ops workflows.
What sets it apart: Unlike benchmarks like SWE-Bench (which tests code generation on open-ended GitHub issues) or general agent evaluation suites (that mix diverse reasoning, coding, and interaction tasks), Tracecore focuses on deterministic episodes where agents must use constrained actions (e.g., file operations, ops triage) to achieve exact outcomes, with strict validation. It includes 15+ tasks across suites like operations and games, and supports running agents via adapters for fr
Read the rest
ameworks like OpenClaw and Autogen, or custom scripts.
You can try it out by installing through pip/uv, or by cloning the repo and installing the optional dev dependencies, and running the dashboard, the cli wizard or the cli commands. It outputs structured results with success/failure, steps used, traces for analysis, diffs, bundles and more.
I've been iterating on this over the past few weeks, adding new tasks and improving the harness. Previous discussions on AI eval tools were helpful in shaping the design. Feedback welcome, especially on expanding task suites or integration ideas.