Search: “benchmark”

We had Lin on stage: 'the future is millions of models — one per application, one per use case.' Jet delivered a masterclass on reinforcement fine-tuning. Rob joined @WorkOS for some hot takes on the

arXiv:2604.06558v1 Announce Type: new Abstract: We present the first systematic study of when target context helps molecular property prediction, evaluating context conditioning across 10 diverse prot

arXiv:2510.26241v5 Announce Type: replace-cross Abstract: Modern vision-language models (VLMs) excel at many multimodal tasks, yet their grasp of temporal information in video remains weak and has not

arXiv:2603.28906v2 Announce Type: replace Abstract: AGI has become the Holly Grail of AI with the promise of level intelligence and the major Tech companies around the world are investing unprecedente

arXiv:2602.22251v3 Announce Type: replace-cross Abstract: General-purpose 3D chemical modeling encompasses molecules and materials, requiring both generative and predictive capabilities. However, most

After playing with it a bit, Meta's Muse Spark Thinking is fine so far, but really doesn't match the current Big Three models. It also is a bit... weird. Like some strange language & tone, a little lo

The *Interconnects.ai* article argues that fears around releasing an open-weight version of Claude Mythos are overstated, noting that closed frontier models still lead open-weight ones in robust, ...

extremely fun jamming with Harrison on all things analytics, agents and evals! I have like 20 more hours worth of takes and opinions in this space and going on the pod uncorked them, more to come for

FlowInOne is a vision-centric multimodal image generation framework that reformulates multimodal generation as a purely visual flow, converting all inputs into visual prompts and enabling a clean i...

Google's Gemma 4 31B is a dense multimodal model from Google DeepMind now available on Together AI's serverless infrastructure via the endpoint `google/gemma-4-31B-it`. It features a 256K context ...

Grok is the AI to use if you value truth Grok 4.20 Non-Hallucination rate improved to even higher than previous highest Just days ago, it hit a record-breaking 78% Non-Hallucination Rate - already #1

Meh on the Lem Test as well https://x.com/emollick/status/2019478314767835634?s=20 Opus 4.6 saturates my Lem test, which I've done since GPT-3.5 SciFi author Stanislaw Lem wrote of two rival construct

NVIDIA's open-source project **Slinky** (developed by SchedMD, now part of NVIDIA) enables organizations to run full Slurm clusters directly on Kubernetes infrastructure by managing the complete li...

So we now have a pretty good picture of the state of the frontier AI model makers. US closed source models continue to lead. Google, OpenAI, and Anthropic stand well ahead of the pack, and may have si

ALTK-Evolve, published by IBM Research, is a memory system for AI agents that enables on-the-job learning by helping agents improve over time, learning from and using guidelines generated from pre...

Anthropic investigated the internal mechanisms of its latest unreleased model, Claude Mythos Preview, and what they found is 100% worth a read. Key things I pulled from Anthropic researchers' threads:

🚀 GLM-5.1 is now available on SiliconFlow Start a task, go to sleep. GLM-5.1 plans, executes, and self-improves for 8 hours and delivers high-quality results by morning. Still open-source. Big kudos t

I think the most obvious is that Meta has its own frontier model and can use that to extract additional value out of its customer base/explore new markets for its products. Very few companies can say

link to @HeidyKhlaaf’s sharp analysis: As someone who has audited dozens of safety-critical systems, built static analysis tools, and used most formal verification and security tools, here are some re

NEW: Meta announces Muse Spark. All you need to know: * It's their new multi-modal reasoning model. * Strong at multi-agent orchestration and multi-modal reasoning. * Contemplating mode orchestrates m

Seems like a good model from Meta that is still trailing the current series of releases. The most important thing to note is that it is not open weights. That was the main reason that Meta's models we

Nous Research's **Hermes Agent** is an open-source agentic framework by NousResearch that delivers significantly improved reliability when using GPT-5.x or Codex (OpenAI Codex subscription) models ...

Want more proof that Anthropic's PR has no idea what it's talking about? The talk of Mythos being 'their most aligned model ever'. They could perhaps truthfully speak about 'new high scores on our ali

Writing fiction seems to be a genuine weak spot for LLMs that is not improving as rapidly as almost every other area. There may be a lot of reasons why this is happening. It would be a really interest

Anthropic didn't release their latest model, Claude Mythos (system card PDF), today. They have instead made it available to a very restricted set of preview partners under their newly announced Projec

GLM-5.1 is Z.ai's (zai-org) next-generation open-source flagship model for agentic engineering, achieving state-of-the-art performance on SWE-Bench Pro and significantly outperforming its predecess...

Let’s deep dive into GLM model improvement by @Zai_org over the past 3 generations: 5.1, 5 and 4.7. GLM-5 was an improvement over 4.7 in similar ways, but 5.1 appears as a more rounded model with a fe

More on the @nytimes piece about that $1.8B, two-person, AI company ... not the paper's finest moment in quick retrospect. And in the healthcare context no less. Our friend @GaryMarcus was on this a f

Cognition released SWE-1.6, their latest software engineering model optimized for both intelligence and 'model UX,' now generally available in the Windsurf IDE. It is free for the next three month...

To run GLM-5.1 locally (744B params, 40B active MoE), full precision needs ~1.65TB disk + enterprise hardware like 8x H200/B200 GPUs. Minimum practical setup: Unsloth 2-bit GGUF quant (~220-236GB). Fi