Local Ai
ASUS UGen300 USB AI Accelerator 8GB for local inference
The ASUS UGen300 is a plug-and-play USB AI accelerator featuring a Hailo-10H processor that delivers up to 40 TOPS (INT4) of inference performance and 8GB of dedicated LPDDR4 memory, consuming just...
The ASUS UGen300 is a plug-and-play USB AI accelerator featuring a Hailo-10H processor that delivers up to 40 TOPS (INT4) of inference performance and 8GB of dedicated LPDDR4 memory, consuming just 2.5 watts of power. It connects via USB 3.1 Gen 2 Type-C and supports local, offline AI inference — including LLMs, vision-language models (VLMs), and Whisper — across Windows, Linux, and Android on both x86 and ARM platforms without requiring cloud connectivity. The device is compatible with major AI frameworks (TensorFlow, PyTorch, ONNX) and is backed by an online model zoo of 100+ pre-trained models, making it suited for developers, makers, and system integrators seeking portable edge AI acceleration.
Related
- Decided to make my own stable diffusion
- OK I installed bitsandbytes but still getting error - Help please - thanks
- Flux2 Klein 2 stage upscale?
- ComfyUI - disappearing workflows
Source: local-ai