As our customers scale to training robot models using millions of hours of our recordings, we needed to build a new kind of data infrastruct…

As our customers scale to training robot models using millions of hours of our recordings, we needed to build a new kind of data infrastructure. Terabytes of data delivered in minutes, and the capacity to deliver over a Petabyte per day to each of our customers, to multiple customers at the same time. That’s more than 10 Gigabytes a second, delivered into any cloud, wherever our customers need it. Using our customer portal, customers select precisely the data they want and it starts arriving in minutes at their destination, including AWS, GCP, Cloudflare, Hugging Face and any cloud provider who can handle the ingest speed. We’ve written about how we worked with @huggingface and @Cloudflare to build this secure, scalable infrastructure. Link in comments.

We just crossed 1,000,000 public datasets on Hugging Face! That's petabytes of data available that millions of AI builders are downloading, …
Hugging Face Jobs sounds like an incredible addition to LeRobot🤗 https://huggingface.co/docs/lerobot/v0.6.0/hardware_guide#hugging-face-job…
Great to see @CommonCrawl using and recommending @huggingface Buckets for large constantly evolving training datasets! If you have private m…
We are starting to be quite bullish about getting in the data infrastructure business. I just cloned 68 TB (while I only have a 4TB local di…

Source: Clem Delangue (X) | 2026-10-23

Related