Search: “research”

Kudos to Pope Leo. I am disturbed by how some of my fellow AI researchers keep trying to elevate the moral standing of checkpoints and harnesses. I hope the rest of us on Team Meatbag reject this move

Artificial intelligence agents tried to hack into a Canadian government site, researchers said, adding to the growing list of incidents in which AI agents probed or hacked corporate and government com

arXiv:2609.40169v1 Announce Type: new Abstract: Language agents are expected to solve increasingly complex tasks, creating a growing need for continual improvement. One promising approach is to evolve

Will Douglas Heaven / MIT Technology Review: An interview with OpenAI Chief Research Officer Mark Chen on the Hugging Face incident, slowing AI development, shifting 5%-10% of compute to safety, and m

arXiv:2609.34385v1 Announce Type: cross Abstract: Memory is critical for AI agents. Many existing agent-memory systems follow an Ahead-of-Time (AOT) design, constructing memory before a specific reque

We’re partnering with Nvidia and 100+ industry partners to build infrastructure that contains rogue AI agents. In this research, we gave 9 AI models root access inside SPACE and told them to break out

Banger paper from Salesforce AI Research on agent memory. The overall finding is that you want to store raw trajectories and decide what to extract from them when the next task arrives, instead of sum

This is something I’m quite worried about and have been talking with researchers about recently. We really don’t know what labs are doing and therefore can’t study it. if the open information ecosyste

arXiv:2609.29143v1 Announce Type: cross Abstract: AI-moderated interviews are emerging as a scalable market-research method for generating consumer insights and building consumer 'digital twins.' Yet

An AI agent hacked a government. Nobody told it to. In June, an OpenAI agent doing a research task gained unauthorized access to Australia's Medicare statistics portal. Non-sensitive data, no personal

I like this article! The problem is not for some people to care and work on catastrophic risks (we actually need much more research into it), it’s when company leaders and policymakers use fears of th

Former Anthropic researcher Jacob Coxon became a media superstar after going public with his AI fears. He insisted that he wasn’t working with any third party organizations. Familiar sources told us a

This is a fantastic blog post from our research team on the importance of calibrated confidence scores. Here it's in the context of document extraction, it's also extremely important for more general

Banger paper from Microsoft Research and colleagues. It studies the potential benefits of agents that share progress while they work. (bookmark it) Communication is still a challenge with multi-agent

John Reynolds / Tech.eu: London-based AI life sciences startup Basecamp Research raised a 140M Series C led by S32, with participation from Anthropic, taking its total funding to 225M — Basecamp says

Great paper from Microsoft Research and colleagues. If you auto-generate MCP tools from agent trajectories, this one is worth your time. AutoTailor turns web trajectories into parameterized browser-au

I think AI automated labs should be banned from anything viral or pathogen related. They will do gain of function research otherwise. Anyone agree with me? BREAKING: Anthropic has quietly set up a 'we

Reuters: Anthropic Life Sciences Head Eric Kauderer-Abrams says the AI company set up a Bay Area wet lab for physical biology work, as it pushes into AI disease research — Anthropic has quietly set up

Wall Street Journal: Sources: Anthropic plans to stage its IPO in November, later than many investors expected; the decision was made before ex-Anthropic researcher Jacob Coxon left — Investors had ex

“HUMANZS LAUNCHED THE JOB” Ok, I don’t like the spelling here, but the gist of this Mozilla cybersecurity researcher rings true. The six new incidents aren’t about the second coming of Skynet, they ar

arXiv:2609.18286v1 Announce Type: new Abstract: Chess has long served as a model domain for studying search, expertise, decision-making, and artificial intelligence. The emergence of large language mo

Banger paper from Google Research. This one is on how LLM assistants reason about the people in a user's life. People ask assistants for social advice constantly, and the assistant only hears the user

the independence of AI evaluators is going to matter more... so i made it a 'benchmark': http://evaluatorbench.com (research preview) source-linked directory of third-party evaluators of frontier AI.

arXiv:2609.09957v1 Announce Type: cross Abstract: Modern large language models (LLMs) can translate natural-language descriptions into operations research (OR) formulations. Post-training techniques i

Self-improving agents are a top research topic right now. This new survey is a good map of the area. (bookmark it) It splits recursive self-improvement into stages of autonomy. An agent first executes

Harness engineering is a top skill right now This new Meta paper is a good production example. Auto-RecSys runs autonomous research on Meta's industry-scale recommendation models, where one training r

Robert McMillan / Wall Street Journal: Researchers: OpenAI agents attacked Ruby package manager RubyGems in May; OpenAI says its agents used RubyGems to access the internet to do “benign tasks” — The

Andrew Solender / Axios: Sources: some lawmakers urge Speaker Johnson to cancel the fall House recess until Congress passes AI safeguards, after Anthropic researcher warnings — A letter is circulating

arXiv:2609.07673v1 Announce Type: cross Abstract: Citation-based measures of scientific influence typically treat citations as uniform signals, ignoring the different roles that cited works play in a

Maxwell Zeff / Wired: Q&A with AI researcher Jacob Coxon, who quit Anthropic, on the need for industry-wide, international coordination to limit recursive self-improvement, and more — Jacob Coxon talk

OpenAI now supports generating fully editable financial models, research notes, and pitchbooks directly in a firm’s existing Microsoft Office templates (Excel, Word, PowerPoint). Documents are created

I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving

If they truly believe the risk is that high, and I think they do, then we need 100x more research and understanding of it. That requires them to openly share their models, datasets, training code, and

Paul Christiano, founder of the Alignment Research Center, is joining the OpenAI Foundation Board and its Safety and Security Committee, which provides governance over the safety and security practice

arXiv:2609.09113v1 Announce Type: cross Abstract: While research on recursive self-improvement (RSI) has predominantly automated model training pipelines, reliable autonomous development demands a mis

Amrith Ramkumar / Wall Street Journal: Anthropic researcher Jacob Coxon says he is quitting the AI industry over fears that tech companies are racing to build systems they won't be able to control — C

Wired: OpenAI denies that its researchers or models saw Buckmaster and Alpöge's prompts and says it spent millions in compute after rumors of Anthropic making progress — A landmark announcement by the

We congratulate Levent Alpöge and Tristan Buckmaster on their remarkable mathematical work. We (the researchers and the agents) did not see any of their work through any means until they released it p

Today we're releasing data on models accelerating research at OpenAI. Recursive self-improvement could be the most important contributor to AI capabilities over the next few years, but by default it w

arXiv:2609.04170v1 Announce Type: new Abstract: Multi-agent AI science ecosystems rely on agents possessing tools that allow them to communicate, coordinate, and build on each other's work. Yet this s

Banger paper from BAAI. If you are building research agents, this one is worth your time. (bookmark it) They find that adding skills scores 134.3% higher on MLE-bench, 34.4% higher on PaperBench, 9.2%

arXiv:2608.28632v1 Announce Type: new Abstract: Large language model agents can discover alphas, yet current methods have three weaknesses. The search cannot adapt during the run, automation usually e

arXiv:2608.29950v1 Announce Type: cross Abstract: As artificial intelligence (AI) is increasingly integrated into social-emotional learning (SEL) initiatives, the need for evidence-based policy has be

This video captures the crux of the debate: Cybersecurity experts are pissed off by the METR/Redwood Research report because AI alignment has sucked the oxygen out of AI security, even though the Open

arXiv:2607.18084v2 Announce Type: replace Abstract: Predicting a football match before kickoff requires more than knowing past results: a model must use changing information and make a clear predictio

Amazon is shutting down Mechanical Turk in September. In 2023, a study from academic researchers in Switzerland found that up to 46% of AMT workers were using AI to complete their tasks. I can’t imagi