Solving the world’s toughest problems requires complex and challenging analysis. Across the diverse fields in HPC, researchers create computational models to advance the understanding of our world and discover new possibilities. Whether in fluid mechanics, geosciences, oil and gas, genomics, climate modeling, intelligence, or network forensics—a vast amount of valuable data is being created and processed. Today’s HPC applications require massive parallel processing and storage that can support the ultra-high streaming performance—both writes and reads—that enable HPC workflows.
HPC workflows demand speed and scale. The computational analysis involved in HPC applications is important—sometimes these projects are even changing the world. HPC storage needs to deliver extreme performance and massive scale in a way that integrates seamlessly into the rest of the environment. And the HPC storage needs to provide ready access to data, wherever and whenever it’s needed, even at extreme scale. Quantum offers two different high-performance storage solutions for HPC workflows: StorNext® scale-out storage and QXS hybrid storage deployed with Lustre®. This solution brief focuses on Quantum QXS hybrid storage for Lustre environments.
Quantum QXS hybrid storage delivers the high-speed storage required by demanding HPC environments and the Lustre file system. To enable massively parallel reads, QXS hybrid storage includes an adaptive caching technology to accommodate dozens of independent streams of data without degrading throughput. Adaptive caching is a critical feature for HPC applications that depend upon reliable, high-performance data streaming.
The Lustre file system is an open-source file system widely used in high-performance computing environments because it enables high bandwidth and large-scale workloads. The Lustre architecture contains Object Storage Servers (OSS), Metadata Servers (MDS), and Lustre client nodes, all connected over a high-speed network. QXS hybrid storage from Quantum can be the cornerstone of an HPC solution that is fully redundant and optimized for performance—ensuring that mission-critical applications always have access to critical data. Together, Lustre and Quantum QXS hybrid storage enable the massive scale and blazing fast performance required for HPC modeling, simulation, and analysis.
Quantum QXS hybrid storage delivers extreme performance, even at petascale—with 12GBs/sec for reads, 5.7GBs/sec for writes, and 200,000 IOPS. With a redundant architecture that is both NEBS and MIL-SPEC compliant, the ruggedized reliability of QXS hybrid storage is ideal for demanding HPC environments. Quantum QXS hybrid storage—with its combination of speed, scale, and reliability—is the perfect fit for open-source Lustre deployments in HPC.