OmniTide: Co-Designing Algorithms and Systems for Efficient On-Device Omni-LLM Streaming
DGX agentarXiv:2609.34653v1 Announce Type: cross Abstract: On-device streaming omni-modal inference safeguards user privacy and eliminates prohibitive per-token API costs, but faces a critical bottleneck: the