Ai2
25 stories
Ai2LabsStateBench: Testing how language models track state changes over long documents StateBench tests how language models track changing information across long documents at four difficulty levels, revealing where models struggle and how targeted training helps recurrent and hybrid…
Ai2LabsHow Olmo 3 earned the highest ethical rating from Nextcloud Nextcloud chose Olmo 3 for fully open, self-hosted AI, earning its highest Ethical AI rating while making local AI practical on consumer hardware.
Ai2LabsHow researchers are adapting olmOCR 2 for historical and archaeological archives Researchers are adapting olmOCR 2 to make historical photo libraries searchable locally and improve transcription of handwritten archaeological records.
Ai2LabsCan we trust LLMs to judge whether a research idea is novel? Old Ideas, Novel Problems tests how reliably LLMs judge the novelty of research ideas, finding that small changes to the evaluation setup can produce very different verdicts.
Ai2LabsLitPivot: Developing research ideas through dynamic contextualization within the literature landscape LitPivot helps researchers refine early research ideas through literature-supported critiques and revisions as their proposals evolve.
Ai2LabsOlmoEarth v1.3: State-of-the-art embeddings for the whole planet OlmoEarth v1.3 brings state-of-the-art satellite embeddings, precomputed global data, and a browser-based Embeddings Explorer for mapping and analyzing the planet.
Ai2LabsA crop-mapping benchmark for the tropics PLANTEUR extends the PASTIS crop-mapping benchmark to six tropical regions to help evaluate geospatial models across more diverse agricultural systems.
Ai2LabsFairStress: A deeper evaluation of fairness in LLM decision-making FairStress is a new benchmark that reveals demographic differences in how LLMs defend and explain their decisions, even when their final choices appear fair.
Ai2LabsHiRO-ACEv2: Simulating extreme weather at 3 km resolution for a fraction of the cost HiRO-ACEv2 captures extreme rain, wind, and pressure events at 3 km resolution for about 1/300th the cost of X-SHiELD, making detailed global climate simulations more accessible to researchers.
Ai2LabsHow Molmo 2’s open release helped an MIT researcher rethink fish tracking Molmo 2’s open release helped MIT researcher Kai Van Brunt develop Molmo2Fish, an experimental model that tracks salmon in sonar footage and corrects some tracking errors using everyday language.
Ai2LabsImpactful scheduling for GPU clusters We explain how Ai2’s new GPU scheduler uses time budgets, fair-share allocation, and time-slicing to prioritize high-impact research, shorten queue waits, and keep GPUs busy.
Ai2LabsAi2 at COLM 2026: Open research, from models to agents for science Ai2 joined COLM 2026 to share advances in open language models, training infrastructure, and AI for science, including Olmo Hybrid, Asta, and Bolmo, while connecting with the broader research…
Ai2LabsNow in Nature: Retrofitting language models to operate over bytes The technique behind Bolmo, Ai2’s fully open byte-level language models, is now published in Nature, with new checkpoints showing the approach generalizes beyond Olmo to other model families.
Ai2LabsOpen-sourcing AstaBrief, the fast report-generation model in Asta We’re releasing AstaBrief, an 8B open-weights model for generating cited scientific reports, available in Asta’s Fast mode or to download and run on your own infrastructure.
Ai2LabsIntroducing Olmo-core 3: Open, scalable training infrastructure for large MoEs Olmo-core 3 introduces a redesigned, fully open training stack for efficiently scaling mixture-of-experts models into the trillion-parameter range.
Ai2LabsWhat a crowdsourced game revealed about steering Olmo 3 A crowdsourced game built on Olmo 3 showed how people can exploit unexpected model behaviors to stress-test prosocial AI evaluations—and how open access to a model’s internals can help researchers…
Ai2LabsTeaching future scientists to interrogate AI tools for scientific discovery University of Washington students put Ai2’s AutoDiscovery to the test, showing how AI can surface promising scientific leads while making human judgment, domain expertise, and rigorous validation…
Ai2LabsHow Goodfire used Ai2’s open post-training stack to trace unwanted model behavior Goodfire used Ai2’s fully open post-training stack to predict LLM behavioral changes, trace unwanted model behavior back to individual training examples, and test targeted fixes without sacrificing…
Ai2LabsBenchMIRT: What are LLM benchmarks actually measuring? BenchMIRT is a new method for auditing LLM benchmarks question by question, revealing which capabilities they actually measure and helping researchers build smaller, more focused, and…
Ai2LabsThe hard parts of AI-assisted science At an Ai2 event marking our expanded collaboration with Providence Swedish, researchers explored the hardest problems in AI-assisted science: keeping systems steerable, grounded in human judgment and…
Ai2LabsAi2 and Providence Swedish Cancer Institute partner to advance AI-assisted scientific discovery Ai2 and Providence Swedish Cancer Institute are expanding their collaboration after AutoDiscovery helped researchers uncover and validate a promising new immune signal in invasive lobular breast…
Ai2LabsHow researchers adapted Dolma for better Thai language models Thai researchers adapted Ai2’s open Dolma toolkit to build Mangosteen, a 47-billion-token Thai corpus that filters low-quality web data while maintaining or improving model performance and…
Ai2LabsHow a Georgia Tech team used the open Olmo stack to trace social reasoning A Georgia Tech team used Ai2’s fully open Olmo stack to trace social reasoning back to the training data that shaped it, finding that dialogue-rich, interpersonal writing had an outsized influence on…
Ai2LabsWhen a model reads a drug's class from its name—not its knowledge Researchers used Olmo 3 and its open training data to show that models can infer a drug’s class from its name instead of knowing the specific medication, and traced that shortcut to how often drugs…
Nothing matches this filter yet.