arxiv-browse

AI & ML engineering in particular is very research-adjacent. That's why we began building agents to source ideas from the arXiv and implement the core-methods from the papers in YOUR target repo months before this publication. We shared the demo video of it in our production system a while back: https://news.ycombinator.com/item?id=45132898 And we're offering a technical deep-dive into how we built it tomorrow at 9am PST with the AG2 team: https://calendar.app.google/3soCpuHupRr96UaF8 We've built up to 1K Docker images over the past couple months which we make public on DockerHub: https://hub.docker.com/u/remyxai And we're close to an integration with arXiv that will have these pre-built images linked to the papers: https://github.com/arXiv/arxiv-browse/pull/908

Yeah, probably pretty simple compared to the methods we've publicly discussed for months before this publication. Here's the last time we showed our demo on HN: https://news.ycombinator.com/item?id=45132898 We'll actually be presenting on this tomorrow at 9am PST https://calendar.app.google/3soCpuHupRr96UaF8 Besides ReAct, we use AG2's 2-agent pattern with Code Writer and Code Executor in the DockerCommandLineCodeExecutor Also, using hardware monitors and LLM-as-a-Judge to assess task completion. It's how we've built nearly 1K Docker images for arXiv papers over the last couple months: https://hub.docker.com/u/remyxai And how we'll support computational reproducibility by linking Docker images to the arXiv paper publications: https://github.com/arXiv/arxiv-browse/pull/908

No doubt, this toy demo will break your system if the research repo code runs unsecured code. We thought about this out as we built a system that goes beyond running the quickstart to implement the core-methods of arXiv papers as draft PRs for YOUR target repo. Running quickstart in sandbox is practically useless. To limit the attack surface we added PR#1929 to AG2 so we could pass API keys to the DockerCommandLineCodeExecutor and use egress whitelisting to limit the ability of an agent to reach out to a compromised server: https://github.com/ag2ai/ag2/pull/1929 Been talking publicly about this for at least a month before this publication, and along the way we've built up nearly 1K Docker images for arXiv paper code: https://hub.docker.com/u/remyxai We're close to seeing these images linked to the arXiv papers after PR#908 is merged: htt

Looks just like our post: https://news.ycombinator.com/item?id=45132898 Which we're presenting on tomorrow at 9am PST https://calendar.app.google/3soCpuHupRr96UaF8 Difference is we've put this out months ago: https://x.com/smellslikeml/status/1958495101153357835 About to get PR #908 merged so anyone can use one of the nearly 1K Docker images we've already built: https://github.com/arXiv/arxiv-browse/pull/908 We've been publishing about this all Summer on Substack and Reddit: https://www.reddit.com/r/LocalLLaMA/comments/1loj134/arxiv2d...

Speaking of which, if anyone knows someone at arXiv, would be great if you could prod someone to get back to me about this PR or the associated email I sent them about it: https://github.com/arXiv/arxiv-browse/pull/197 It would add the ability for people to state that they have reviewed a given work. Might not be the direction they want to go in, or it might not be - but so far I'm not even sure if someone's seen it, unfortunately.