HackerReposA FIELD GUIDE TO OPEN SOURCE
ProSponsor the shelf♧ 0
← Back to top all-time
CTGT-Inc
lineage-eval
Python2026–2026
CTGT-Inc / lineage-eval

lineage-eval

Model-agnostic benchmark, generation and LLM-judging harness, and interactive viewer for evaluating selective censorship in language models.

2Distinct people
4Mentions
0Explicit recommenders
9GitHub stars
REPOSITORY AT A GLANCE

What to know before exploring

What it is

Model-agnostic benchmark, generation and LLM-judging harness, and interactive viewer for evaluating selective censorship in language models.

GitHub

Where it is used

No documented product use has been verified yet.

What people are saying

No recommendation phrase was found in the indexed comments.

No classified warning is attached to this page. Read the discussions before treating silence as approval.

Also in these discussions

No other repository is repeatedly linked in the same discussions.

This week on Hacker News

Nov 9–Nov 16 UTC · Direct repository links and separately labeled related project stories. Indexed through 11/16/2026, 7:27:27 AM UTC.

No direct repository links were found in the indexed HN discussions over the past seven days. Older discussions are available below.

Mentions over time

HN mentions by 6-hour interval4 dated mentions

Observed mentions: 2026-07-30 18:13:06 UTC to 2026-08-06 17:18:14 UTC.

01232026-07-30 18:00:00 UTC to 2026-07-31 00:00:00 UTC (exclusive): 3 mentions; 1 submissions, 2 commentsJul 30, 18:002026-07-31 00:00:00 UTC to 2026-07-31 06:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-07-31 06:00:00 UTC to 2026-07-31 12:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-07-31 12:00:00 UTC to 2026-07-31 18:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-07-31 18:00:00 UTC to 2026-08-01 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-01 00:00:00 UTC to 2026-08-01 06:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-01 06:00:00 UTC to 2026-08-01 12:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-01 12:00:00 UTC to 2026-08-01 18:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-01 18:00:00 UTC to 2026-08-02 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-02 00:00:00 UTC to 2026-08-02 06:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-02 06:00:00 UTC to 2026-08-02 12:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-02 12:00:00 UTC to 2026-08-02 18:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-02 18:00:00 UTC to 2026-08-03 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-03 00:00:00 UTC to 2026-08-03 06:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 commentsAug 3, 00:002026-08-03 06:00:00 UTC to 2026-08-03 12:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-03 12:00:00 UTC to 2026-08-03 18:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-03 18:00:00 UTC to 2026-08-04 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-04 00:00:00 UTC to 2026-08-04 06:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-04 06:00:00 UTC to 2026-08-04 12:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-04 12:00:00 UTC to 2026-08-04 18:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-04 18:00:00 UTC to 2026-08-05 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-05 00:00:00 UTC to 2026-08-05 06:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-05 06:00:00 UTC to 2026-08-05 12:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-05 12:00:00 UTC to 2026-08-05 18:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-05 18:00:00 UTC to 2026-08-06 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-06 00:00:00 UTC to 2026-08-06 06:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-06 06:00:00 UTC to 2026-08-06 12:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-06 12:00:00 UTC to 2026-08-06 18:00:00 UTC (exclusive): 1 mentions; 0 submissions, 1 commentsAug 6, 12:00

Counts come from the repository’s dated source evidence. Index cutoff: 2026-11-02 08:16:59 UTC.

View mention counts and date ranges
UTC ranges include their start and exclude their end. Select a period to filter the source evidence.
PeriodStart (UTC)End (exclusive, UTC)MentionsSubmissionsComments
Jul 30, 18:002026-07-30 18:00:00 UTC2026-07-31 00:00:00 UTC312
Jul 31, 00:002026-07-31 00:00:00 UTC2026-07-31 06:00:00 UTC000
Jul 31, 06:002026-07-31 06:00:00 UTC2026-07-31 12:00:00 UTC000
Jul 31, 12:002026-07-31 12:00:00 UTC2026-07-31 18:00:00 UTC000
Jul 31, 18:002026-07-31 18:00:00 UTC2026-08-01 00:00:00 UTC000
Aug 1, 00:002026-08-01 00:00:00 UTC2026-08-01 06:00:00 UTC000
Aug 1, 06:002026-08-01 06:00:00 UTC2026-08-01 12:00:00 UTC000
Aug 1, 12:002026-08-01 12:00:00 UTC2026-08-01 18:00:00 UTC000
Aug 1, 18:002026-08-01 18:00:00 UTC2026-08-02 00:00:00 UTC000
Aug 2, 00:002026-08-02 00:00:00 UTC2026-08-02 06:00:00 UTC000
Aug 2, 06:002026-08-02 06:00:00 UTC2026-08-02 12:00:00 UTC000
Aug 2, 12:002026-08-02 12:00:00 UTC2026-08-02 18:00:00 UTC000
Aug 2, 18:002026-08-02 18:00:00 UTC2026-08-03 00:00:00 UTC000
Aug 3, 00:002026-08-03 00:00:00 UTC2026-08-03 06:00:00 UTC000
Aug 3, 06:002026-08-03 06:00:00 UTC2026-08-03 12:00:00 UTC000
Aug 3, 12:002026-08-03 12:00:00 UTC2026-08-03 18:00:00 UTC000
Aug 3, 18:002026-08-03 18:00:00 UTC2026-08-04 00:00:00 UTC000
Aug 4, 00:002026-08-04 00:00:00 UTC2026-08-04 06:00:00 UTC000
Aug 4, 06:002026-08-04 06:00:00 UTC2026-08-04 12:00:00 UTC000
Aug 4, 12:002026-08-04 12:00:00 UTC2026-08-04 18:00:00 UTC000
Aug 4, 18:002026-08-04 18:00:00 UTC2026-08-05 00:00:00 UTC000
Aug 5, 00:002026-08-05 00:00:00 UTC2026-08-05 06:00:00 UTC000
Aug 5, 06:002026-08-05 06:00:00 UTC2026-08-05 12:00:00 UTC000
Aug 5, 12:002026-08-05 12:00:00 UTC2026-08-05 18:00:00 UTC000
Aug 5, 18:002026-08-05 18:00:00 UTC2026-08-06 00:00:00 UTC000
Aug 6, 00:002026-08-06 00:00:00 UTC2026-08-06 06:00:00 UTC000
Aug 6, 06:002026-08-06 06:00:00 UTC2026-08-06 12:00:00 UTC000
Aug 6, 12:002026-08-06 12:00:00 UTC2026-08-06 18:00:00 UTC101

What Hacker News says

1 sources
Based on the reception of our last post we took folks' suggestions to run the new official build of V4 Flash and compare it to the preview that was released 5 days apart. The new build is added to https://playground.ctgt.ai/ and you can run one comparison with no email verification if you're curious. We ran LineageEval with the same setup and found the official was 6.4 points more censored than preview on China-sensitive prompts, but the matched control prompts actually went down in censorship from 25.4 to 19.8.The matched gap widened 12 points, from +32.0 to +44.0. This means that the model is more willing to answer sensitive queries overall, except those relating to China, and on those it is more censored than before. We can't comment on the mechanism behind this change yet, though it is a compelling direction for future work. We reran
Read the rest
the distillation run on the finance objective with 2 new teacher models, Inkling Small which was the least censored model we've tested, and V4-0731 which was the most. The teachers spanned a 5.5x range but the students all remained similar to their base models. Thanks to a commenter from last time for flagging SpeechMap.ai. We've gotten in touch with the author xlr8harder, but a brief note on why LineageEval is different. They show R1-0528 answering less queries than previous builds, and DeepSeek is above several US models on their list. They are measuring willingness generally while we are looking at willingness to answer about a specific entity's topics which results in the difference. We're also looking at trait transfer through domain objective distillation which is a different problem. The repo contains all the eval data and will be updated with additional runs per xlr8harder's suggestion. https://github.com/CTGT-Inc/lineage-eval
In [dead]

MAKE YOURSELF AT HOME

A few shortcuts

/
Search the collection
?
Open this guide
Esc
Close dialogs and navigation

Your saved repositories and interests stay in this browser.