writing

It is the new leader on my Short Story Creative Writing benchmark: https://github.com/lechmazur/writing/

I benchmarked it on four of my benchmarks so far. Got first place in two of them: https://github.com/lechmazur/confabulations https://github.com/lechmazur/nyt-connections https://github.com/lechmazur/generalization https://github.com/lechmazur/writing

If there isn’t, an AI could write it: https://github.com/lechmazur/writing?tab=readme-ov-file

I ran three more of my independent benchmarks: - Improves upon GPT-4o's score on the Short Story Creative Writing Benchmark, but Claude Sonnets and DeepSeek R1 score higher. (https://github.com/lechmazur/writing/) - Improves upon GPT-4o's score on the Confabulations/Hallucinations on Provided Documents Benchmark, nearly matching Gemini 1.5 Pro (Sept) as the best-performing non-reasoning model. (https://github.com/lechmazur/confabulations) - Improves upon GPT-4o's score on the Thematic Generalization Benchmark, however, it doesn't match the scores of Claude 3.7 Sonnet or Gemini 2.0 Pro Exp. (https://github.com/lechmazur/generalization) I should have the results from the multi-agent collaboration, strategy, and deception benchmarks within a couple of days. (https://github.com/lechmazur/elimination_game/, https://github.com/lechmazur/step_ga

I have a set of independent benchmarks and most also show a difference between reasoning and non-reasoning models: LLM Confabulation (Hallucination): https://github.com/lechmazur/confabulations/ LLM Step Game: https://github.com/lechmazur/step_game LLM Thematic Generalization Benchmark: https://github.com/lechmazur/generalization LLM Creative Story-Writing Benchmark: https://github.com/lechmazur/writing Extended NYT Connections LLM Benchmark: https://github.com/lechmazur/nyt-connections/ and a couple more that I haven't updated very recently.