HackerReposA FIELD GUIDE TO OPEN SOURCE
ProSponsor the shelf♧ 0
← Back to top all-time
getomni-ai
benchmark
TypeScript2025–2025
getomni-ai / benchmark

benchmark

OCR Benchmark

2Distinct people
10Mentions
0Explicit recommenders
639GitHub stars
REPOSITORY AT A GLANCE

What to know before exploring

What it is

OCR Benchmark

GitHub

Where it is used

No documented product use has been verified yet.

What people are saying

No recommendation phrase was found in the indexed comments.

No classified warning is attached to this page. Read the discussions before treating silence as approval.

Also in these discussions

No other repository is repeatedly linked in the same discussions.

This week on Hacker News

Nov 9–Nov 16 UTC · Direct repository links and separately labeled related project stories. Indexed through 11/16/2026, 8:59:02 AM UTC.

No direct repository links were found in the indexed HN discussions over the past seven days. Older discussions are available below.

Mentions over time

HN mentions by week10 dated mentions

Observed mentions: 2025-02-20 18:49:29 UTC to 2025-04-01 23:06:27 UTC. Weeks start Monday, UTC.

0123452025-02-17 00:00:00 UTC to 2025-02-24 00:00:00 UTC (exclusive): 1 mentions; 1 submissions, 0 commentsFeb 172025-02-24 00:00:00 UTC to 2025-03-03 00:00:00 UTC (exclusive): 1 mentions; 0 submissions, 1 comments2025-03-03 00:00:00 UTC to 2025-03-10 00:00:00 UTC (exclusive): 5 mentions; 0 submissions, 5 comments2025-03-10 00:00:00 UTC to 2025-03-17 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 commentsMar 102025-03-17 00:00:00 UTC to 2025-03-24 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2025-03-24 00:00:00 UTC to 2025-03-31 00:00:00 UTC (exclusive): 1 mentions; 0 submissions, 1 comments2025-03-31 00:00:00 UTC to 2025-04-07 00:00:00 UTC (exclusive): 2 mentions; 1 submissions, 1 commentsMar 31

Counts come from the repository’s dated source evidence. Index cutoff: 2026-11-02 08:16:59 UTC.

View mention counts and date ranges
UTC ranges include their start and exclude their end. Select a period to filter the source evidence.
PeriodStart (UTC)End (exclusive, UTC)MentionsSubmissionsComments
Feb 172025-02-17 00:00:00 UTC2025-02-24 00:00:00 UTC110
Feb 242025-02-24 00:00:00 UTC2025-03-03 00:00:00 UTC101
Mar 32025-03-03 00:00:00 UTC2025-03-10 00:00:00 UTC505
Mar 102025-03-10 00:00:00 UTC2025-03-17 00:00:00 UTC000
Mar 172025-03-17 00:00:00 UTC2025-03-24 00:00:00 UTC000
Mar 242025-03-24 00:00:00 UTC2025-03-31 00:00:00 UTC101
Mar 312025-03-31 00:00:00 UTC2025-04-07 00:00:00 UTC211

What Hacker News says

1 sources

Show HN: Benchmarking VLMs vs. Traditional OCR

Vision models have been gaining popularity as a replacement for traditional OCR. Especially with Gemini 2.0 becoming cost competitive with the cloud platforms. We've been continuously evaluating different models since we released the Zerox package last year (https://github.com/getomni-ai/zerox). And we wanted to put some numbers behind it. So we’re open sourcing our internal OCR benchmark + evaluation datasets. Full writeup + data explorer here: https://getomni.ai/ocr-benchmark Github: https://github.com/getomni-ai/benchmark Huggingface: https://huggingface.co/datasets/getomni-ai/ocr-benchmark Couple notes on the methodology: 1. We are using JSON accuracy as our primary metric. The end goal is to evaluate how well each OCR provider can prepare the data for LLM ingestion. 2. This methodology differs from a lot of OCR benchmarks, because it
Read the rest
doesn't rely on text similarity. We believe text similarity measurements are heavily biased towards the exact layout of the ground truth text, and penalize correct OCR that has slight layout differences. 3. Every document goes Image => OCR => Predicted JSON. And we compare the predicted JSON against the annotated ground truth JSON. The VLMs are capable of Image => JSON directly, we are primarily trying to measure OCR accuracy here. Planning to release a separate report on direct JSON accuracy next week. This is a continuous work in progress! There are at least 10 additional providers we plan to add to the list. The next big roadmap items are: - Comparing OCR vs. direct extraction. Early results here show a slight accuracy improvement, but it’s highly variable on page length. - A multilingual comparison. Right now the evaluation data is english only. - A breakdown of the data by type (best model for handwriting, tables, charts, photos, etc.)
146 points · Open discussion

MAKE YOURSELF AT HOME

A few shortcuts

/
Search the collection
?
Open this guide
Esc
Close dialogs and navigation

Your saved repositories and interests stay in this browser.