Local Ai
Forlinx 20-TOPS M.2 AI accelerator supports PCIe cascading for local LLM inference
Forlinx Embedded has listed an M.2 AI accelerator card based on Rockchip’s RK1820 and RK1828 processors, providing 20 TOPS of INT8 computing performance and up to 5GB of integrated DRAM. The module us
Forlinx Embedded has listed an M.2 AI accelerator card based on Rockchip’s RK1820 and RK1828 processors, providing 20 TOPS of INT8 computing performance and up to 5GB of integrated DRAM. The module uses an M.2 2280 interface and is designed to handle local AI inference, including large language models, vision-language models, and computer vision workloads on embedded Linux and Android systems. https://linuxgizmos.com/forlinx-20-tops-m-2-ai-accelerator-supports-pcie-cascading-for-local-llm-inference/ submitted by /u/DeliciousBelt9520 [link] [comments]
Related
- Does PCIe matter much for inference?
- ASUS UGen300 USB AI Accelerator 8GB for local inference
- Do people building local LLM rigs track RTX Ada/workstation card prices, or just consumer cards like the 5090?
Source: r/LocalLLaMA | 2026-09-29