The Lustre* file system was purpose-built to provide sustained performance and scalability for storage in large-scale HPC clusters.
Lustre is POSIX-compliant, capable of handling "big data" volume for numbers of files and data shared concurrently across clustered servers. It offers wide scalability in both performance and storage capacity. According to top500.org, Lustre is the most widely-used file system in supercomputing, powering over 60 percent of the TOP100 supercomputing sites worldwide. Lustre has traditionally been employed in HPC environments that generate and process massive amounts of data for research, governmental, and industrial purposes; it has been referred to as one of the best breakthrough technologies for addressing the exascale and emerging "big data" challenges of tomorrow.
*Other names and brands may be claimed as the property of others.