TernFS — an exabyte scale, multi-region distributed filesystem

We designed TernFS to be a one-stop solution for most of our storage needs, going from relatively ‘cold’ storage of raw market data to short-lived random-access data used to communicate between GPU jobs running on our cluster.

As of September 2025, our TernFS deployment stores more than 500PB across 30,000 disks, 10,000 flash drives, and three data centres. At peak we serve multiple terabytes per second. To this day, we haven't lost a single byte.