Knowledge catalogue
This pod was an incredible gift to the community: not only our first pod about @xAI, but Ethan really indulged on all our questions on how to train a SOTA Videogen world model, including specific area
arXiv:2605.26144v1 Announce Type: cross Abstract: We present VISTA (VIsual Spec-To-App Benchmark), a benchmark for evaluating the end-to-end web-app generation capabilities of LLM-based agents. Unlike
For a quarter century, the Google search box has been one of the most recognizable interfaces in computing: a thin white rectangle, a blinking cursor, a few typed words, and a list of blue links. On T
Today in AI Engineering (May 17) • Nous Research ships Hermes Agent v0.14.0: Grok subs, Codex runtime, Windows beta • LangSmith Engine releases trace issue clustering, drafts PRs and evals from prod t
Release b9180 of llama.cpp adds MTP (Multi-Token Prediction) support, including improvements to speculative decoding with the ability to rollback up to draft_max by storing GDN intermediates. The rele
The Gemini Live Agent Challenge is officially in the books! We challenged developers worldwide to break out of the traditional 'text box' paradigm by building next-generation AI agents. From our initi
One of the biggest challenges with agents is that they produce way more than just tokens. Tool calls. State updates. Intermediate reasoning. Subagent progress. File changes. Custom events. Structured
arXiv:2605.09497v1 Announce Type: new Abstract: Vision-language model (VLM) based web agents demonstrate impressive autonomous GUI interaction but remain vulnerable to deceptive interface elements. Ex
Executive Summary Since our February 2026 report on AI-related threat activity, Google Threat Intelligence Group (GTIG) has continued to track a maturing transition from nascent AI-enabled operations
A few major use cases for agentic coding for me: 1. Adhoc data visualizations. Anytime I have a question that can be answered quantitatively, I generate some code to make a plot. 2. Adhoc data annotat
arXiv:2601.06034v1 Announce Type: cross Abstract: Software testing is critical in the software development lifecycle, yet translating requirements into executable test scripts remains manual and error
arXiv:2508.19227v3 Announce Type: replace Abstract: Large language models (LLMs) are increasingly seen as assistants, copilots, and consultants, capable of supporting a wide range of tasks through nat
arXiv:2602.14276v2 Announce Type: replace Abstract: Modern computer-use agents (CUA) must perceive a screen as a structured state, what elements are visible, where they are, and what text they contain
arXiv:2604.26020v1 Announce Type: cross Abstract: Usability testing with experts and potential users can assess the effectiveness, efficiency, and user satisfaction of graphical user interfaces (GUIs)
arXiv:2604.24104v1 Announce Type: new Abstract: Fine-tuned autoregressive models for graph-to-sequence generation (G2S) often struggle with factual grounding and edit sensitivity. To tackle these issu
arXiv:2601.17736v2 Announce Type: replace-cross Abstract: Interactivity is crucial for effective data visualizations. However, it is often challenging to implement interactions for existing static vis
arXiv:2601.03790v3 Announce Type: replace-cross Abstract: Neologism-aware machine translation aims to translate source sentences containing neologisms into target languages. This field remains underex
Microsoft's MIT licensed VibeVoice speech-to-text model (think Whisper with speaker diarization) is really good - my notes on running the 5.71GB 4bit MLX conversion on an M5 MacBook, using about 60GB
arXiv:2604.22558v1 Announce Type: cross Abstract: As Multimodal Large Language Models (MLLMs) mature, GUI agents are evolving from static interactions to complex navigation. While Reinforcement Learni
arXiv:2603.19500v2 Announce Type: replace Abstract: We develop a method for producing vector sketches one part at a time. To do this, we train a multi-modal language model-based agent using a novel mu
arXiv:2604.21082v1 Announce Type: new Abstract: Training vision-language models (VLMs) for medical report generation is often hindered by the scarcity of high-quality annotated data. This work evaluat
arXiv:2604.19844v1 Announce Type: cross Abstract: Recent advances in embodied Vision-Language Agentic Systems (VLAS), powered by large vision-language models (LVLMs), enable AI systems to perceive and
arXiv:2604.19945v1 Announce Type: new Abstract: In this paper, we investigate the problem of how to effectively master tool-use to solve complex visual reasoning tasks for Multimodal Large Language Mo
By default, Ollama binds to port 11434 on localhost, which means it's accessible only on your own machine. Ollama has no built-in authentication and should be secured with firewall rules, VPN, or reve
arXiv:2604.17821v2 Announce Type: replace Abstract: Recent advancements in large language models (LLMs) have empowered autonomous web agents to execute natural language instructions directly on real-w
By combining the analytical depth of Looker with Google’s Agentic Data Cloud, the potential to transform how we model, interact with, and act on our data appears limitless. This week at Google Cloud N
arXiv:2604.18347v1 Announce Type: new Abstract: Vision Language Models (VLMs) achieved rapid progress in the recent years. However, despite their growth, VLMs development is heavily grounded on Englis
arXiv:2509.02547v5 Announce Type: replace-cross Abstract: The emergence of agentic reinforcement learning (Agentic RL) marks a paradigm shift from conventional reinforcement learning applied to large
arXiv:2601.05808v2 Announce Type: replace-cross Abstract: Large language models (LLMs) are expected to be trained to act as agents in various real-world environments, but this process relies on rich a
Based on the Reddit post title, Arrow appears to be a tool for processing SAM (Supplier Agreement Management) contracts stored in CSV and SQLite formats, with optional integration of Ollama to generat
arXiv:2604.14159v1 Announce Type: new Abstract: Mobile input method editors (IMEs) are the primary interface for text input, yet they remain constrained to manual typing and struggle to produce person
// Skill Learning for Autonomous Web Agents // Web agents can navigate a page, but ask them to repeat a checkout flow they already completed, and they start from scratch every time. This work introduc
arXiv:2604.14363v1 Announce Type: new Abstract: Multimodal language models systematically underperform on visual perception tasks, yet the structure underlying this failure remains poorly understood.
3/5 An example: In instance psf__requests-1724, the gold fix is 2 lines. Our agent’s functional fix was 8 lines. The LLM judge rejected the correct 8-liner as 'messy' and 'redundant,' choosing a clean
arXiv:2510.14420v4 Announce Type: replace-cross Abstract: Language models often struggle to follow multi-constraint instructions that are crucial for real-world applications. Existing reinforcement le
This r/StableDiffusion post appears to be a community discussion reaffirming Fooocus as a top-tier Stable Diffusion WebUI, particularly praised for its beginner-friendliness and output quality. Fooocu
OllamaGPT is a self-hosted, ChatGPT-style web interface that runs locally using Ollama as its backend LLM engine, requiring no API keys or external services. It is designed for developers and power us
arXiv:2604.13035v1 Announce Type: cross Abstract: Large Language Models (LLMs) and Vision-Language Models (VLMs) increasingly generate indoor scenes through intermediate structures such as layouts and
arXiv:2603.05044v2 Announce Type: replace Abstract: Current paradigms for training GUI agents are fundamentally limited by a reliance on either unsafe, non-reproducible live web interactions or costly
arXiv:2604.09813v1 Announce Type: new Abstract: Existing synthetic tool-use corpora are primarily designed for offline supervised fine-tuning, yet reinforcement learning (RL) requires executable envir
arXiv:2507.15640v2 Announce Type: replace-cross Abstract: Continual pre-training on small-scale task-specific data is an effective method for improving large language models in new target fields, yet
arXiv:2604.11514v1 Announce Type: cross Abstract: This work addresses test output prediction, a key challenge in test case generation. To improve the reliability of predicted outputs by LLMs, prior ap
arXiv:2603.24329v2 Announce Type: replace-cross Abstract: Multimodal LLMs are increasingly deployed as perceptual backbones for autonomous agents in 3D environments, from robotics to virtual worlds. T
arXiv:2603.27494v2 Announce Type: replace-cross Abstract: To enhance the perception and reasoning capabilities of multimodal large language models in complex visual scenes, recent research has introdu
arXiv:2510.06687v2 Announce Type: replace-cross Abstract: Semantic segmentation serves as a cornerstone of scene understanding in autonomous driving but continues to face significant challenges under
arXiv:2604.11716v1 Announce Type: new Abstract: Prior representative ReAct-style approaches in autonomous Software Engineering (SWE) typically lack the explicit System-2 reasoning required for deep an
arXiv:2604.04334v2 Announce Type: replace-cross Abstract: Researchers and practitioners are increasingly considering reinforcement learning to optimize decisions in complex domains like robotics and h
arXiv:2503.14075v3 Announce Type: replace-cross Abstract: Large vision-language models (VLMs) have demonstrated remarkable capabilities in open-world multimodal understanding, yet their high computati
This Reddit thread from r/StableDiffusion seeks community recommendations for Stable Diffusion base models capable of generating Western cartoon-style imagery, distinguishing this aesthetic from the m
A Reddit post in the r/StableDiffusion community titled 'App Feedback (Lower your Volume)' likely features a user sharing feedback about a Stable Diffusion-related application or interface that plays
This Reddit thread from r/StableDiffusion addresses a common image quality issue where Tensor Art — a cloud-based Stable Diffusion platform — produces outputs with heavy, unwanted color tints. The dis
This r/StableDiffusion post addresses a common troubleshooting scenario where a user has installed the `bitsandbytes` library but continues to encounter errors in their Stable Diffusion setup. Based o
This r/StableDiffusion post likely discusses a specific extension built for SD-Forge — a modified, performance-optimized fork of the AUTOMATIC1111 Stable Diffusion WebUI. SD-Forge features a reworked
A Reddit post from the r/StableDiffusion community in which a user shares an experience of being trolled, likely related to AI image generation workflows, model recommendations, or settings advice. Th
The specific Reddit post (r/ollama, ID `1si3yyn`) did not appear in the search results, and I was unable to directly fetch the Reddit URL. Based on the available context and related results, I cann...
This Reddit post from r/StableDiffusion discusses an SDXL (Stable Diffusion XL) image generation workflow, likely covering pipeline setup, prompting strategies, and tool configurations using interface
A Reddit post from the r/StableDiffusion community titled 'The classic UX you know and love' likely features a humorous or nostalgic reference to the user interface of a popular Stable Diffusion front
Auto-generated index of all tools mentioned across the wiki.
arXiv:2501.16150v3 Announce Type: replace Abstract: Agents for computer use (ACUs) are an emerging class of systems capable of executing complex tasks on digital devices -- such as desktops, mobile ph
arXiv:2604.08545v1 Announce Type: new Abstract: The advent of agentic multimodal models has empowered systems to actively interact with external environments. However, current agents suffer from a pro