Our world changed with LLM / AI chatbots, which must be assessed for reliability. I evaluate LLM in part by asking them about known content (me!).

In today's news Olmo 3 (Allen AI) is an epic fail on my self-test.

Aside: another chatbot I recently tested was initally dead-on viz-a-viz me BUT (exhausted of facts) w/o warning BADLY hallucinated when pressed for additional detail, fabricating false content.
Better models (Claude ...) will admit no new data and stop.

#Olmo3 #Ai2 #DigitalLiteracy

The #AllenInstitute for AI (#Ai2) released #Olmo3, a collection of #openlanguage models designed to compete with industry leaders. Olmo 3 outperforms fully open models like #Stanford’s #Marin and commercial open-weight models like #Meta’s #Llama3.1, offering improved performance, efficiency, and transparency. https://www.geekwire.com/2025/ai2-releases-olmo-3-open-models-rivaling-meta-deepseek-and-others-on-performance-and-efficiency/?AIagents.at #AIagent #AI #ML #NLP #LLM #GenAI
Ai2 releases Olmo 3 open models, rivaling Meta, DeepSeek and others on performance and efficiency

The Allen Institute for AI (Ai2) unveiled Olmo 3, a new generation of open language models that it says outperforms rivals while using far less computing and offering more transparency.

GeekWire

AI2's new Olmo 3 family pushes the frontier, rivaling Qwen and Llama while adding open-reasoning tools and full data transparency with OlmoTrace and Dolma 3. Discover how this open-source-focused LLM could reshape research and deployment. #Olmo3 #Ai2 #Qwen #Llama

🔗 https://aidailypost.com/news/ai2s-olmo-3-family-challenges-qwen-llama-adds-open-reasoning-data

Here is puzzle for the reader. I generated a deep research report using AI2's Asta tool. The prompt I used can be seen on the left side in the weblink below. The generated report used 0 cited references. The puzzle question is why was the entire report generated by "LLM Memory" instead of citing any references? I think this case illustrates something interesting about the behavior of some deep research tools.

https://asta.allen.ai/share/37e27212-fd1a-4dd4-a0f9-036764d87b94

#research #AItools #Asta #AI2

Ai2 Asta

A scholarly research assistant that combines literature understanding and data-driven discovery. Asta uses 108M+ abstracts and 12M+ full-text papers to find, summarize, and analyze scientific evidence. A project from Ai2.

#AI2 Skylight app opens parts of the platform for public use https://app.skylight.earth/, anyone can explore AI powered detections of vessel activity at sea #ai4good
Skylight

Skylight

Galileo, an open-source multimodal model from #AI2 designed to process many kinds of earth observations at once—driving applications such as mapping agricultural land, detecting floods, and monitoring marine pollution https://www.nasaharvest.org/news/galileo-is-advancing-nasa-harvests-mission-to-safeguard-our-planet #ai4good #tech4good
A New Perspective from Space: How Galileo is Advancing NASA Harvest’s Mission to Safeguard Our Planet — NASA Harvest

Have you ever thought about how scientists keep track of what is happening all over the Earth? Thanks to satellites orbiting high above us, we have eyes in the sky that capture vast amounts of information every day. These satellites monitor everything from sprawling forests and melting glaciers to t

NASA Harvest
🚀 #NSF and #NVIDIA just handed #Ai2 a mountain of cash 💰 to build an "open AI #ecosystem," whatever that means. Meanwhile, the rest of us are still trying to figure out how to open a PDF. 😅 Looks like AI is going green 🌍, because it’s sure as hell not going open source.
https://allenai.org/blog/nsf-nvidia #OpenAI #AIInnovation #HackerNews #ngated
NSF and NVIDIA award Ai2 a combined $152M to support building a national level fully open AI ecosystem | Ai2

Ai2 has been awarded a combined $152 million from the U.S. National Science Foundation (NSF) and NVIDIA as part of a jointly funded project to advance our research and develop truly open AI models and solutions that will accelerate scientific discovery.

NSF and Nvidia award Ai2 $152M to support building an open AI ecosystem

https://allenai.org/blog/nsf-nvidia

#HackerNews #NSF #Nvidia #Ai2 #OpenAI #Ecosystem #Funding

NSF and NVIDIA award Ai2 a combined $152M to support building a national level fully open AI ecosystem | Ai2

Ai2 has been awarded a combined $152 million from the U.S. National Science Foundation (NSF) and NVIDIA as part of a jointly funded project to advance our research and develop truly open AI models and solutions that will accelerate scientific discovery.