EXTREME FILE SYSTEM PERFORMANCE ON SUPERMICRO SERVERS

PublishTime：2021-12-29

Weka's file system (WekaFS) is a fully distributed, parallel file system that was written entirely from scratch to deliver the highest performance file and object services by leveraging NVMeflash as its primary storage for persistent data across a wide range of applications. WekaFS will also, transparent to the application layer, seamlessly expand the filesystem namespace to include an extended layer built on any S3 compliant object storage system(see Figure 3and Figure 4for more details). There is no need for data migration software or complex scripts; all data resides in a single global namespace for easy access and management while maintaining the best performance. The intuitive graphical user interface allows a single administrator to quickly and easily manage hundreds of petabytes of data without any specialized storage training.
Weka's software delivers a more powerful and straightforward solution that would have traditionally required several disparate storage systems to leverage existing technologies in new ways and augment them with engineering innovations. The resulting software solution provides high performance for all workloads (big and small files, reads and writes, random, sequential, and metadata heavy). Furthermore, it is designed to run on a server infrastructure that does not rely on specialized hardware assist. As future hardware innovations come to market, WekaFS is well-positioned to leverage emerging technologies for the continued delivery of best cost and performance. The system can be expanded online to handle more demanding performance or store more capacity with no service interruption.
■ Configuration
In 2018, WekaIO set a number of benchmark records using the previous generation 2U 4-Node X11 BigTwin® ¹. Now, in 2021, Supermicro has launched next-generation X12 BigTwin hardware, featuring 3rdGenerationIntel®Xeon®Scalable Processors supporting up to 40 cores, higher instructions per clock, and two 512-bit FMA units. This is a huge advantage, as AVX-512 doubles the data registers compared to the AVX2extension for the x86 instruction set. Beyond the computing power, Supermicro X12 BigTwin can now access data faster with twice the NVMe storage & I/O performance utilizing PCI-E4.0, increasing WekaFS performance significantly over the previous generation of NVMe drives.
● There are two WEKA reference configurations to choose from, based on Supermicro’s flagship green computing platform, X12 BigTwin. Both options offer top-tier performance with 6 or 12 NVMe PCI-E4.0storagedrives, 256GB of memory, and 32 CPU cores per host.
● Both options offer a raw capacity of up to 7.7PB/rack or 367TB/system, using 15.3TB NVMe PCI-E4.0storage drives
O 2U 4-Node Capacity (21 systems x 6 drives x 4 nodes x 15.3TB = 7.7PB per 42U Rack)
O 2U 2-Node Capacity (21 systems x 12 drives x 2nodes x 15.3TB = 7.7PB per 42U Rack)
● High-performance Kioxia NVMe PCI-E 4.0 drives with measured performance of 6.9 GB/s of throughput and 1.6 MIOPs vs. 3.3 GB/s of throughput and 800 KIOPs for NVMe PCI-E 3.0 drives.
●Key Advantages:
O 2U 4-Node X12 BigTwin offers up to 20% power efficiency than four traditional 1U servers and optimized cost models for entry-level to mid-sized deployments. Improved thermal performance over X11 BigTwin, as shown in Figure 2.
O 2U 2-Node X12 BigTwin offers optimal performance, storage, and operational advantages for mid-sized to hyperscale deployments.

Brand of Product：	SUPERMICRO
Part#：	SYS-220BT-HNTR 、 SYS-220BT-DNTR More Part#
Product Category：	Servers More
Application：	More
Data Type：	Solutions More
Safety & Environment Standards：	More
Operating Temperature：	Please see the document for details
Qualification Grade：	More
Qualification Approval：	More
Package：
Language：	English Chinese Chinese and English Japanese
Date of Creation：	April2021
Version Number：
Data Encoding：
Data Size：	3.3 MB

Download

+1 Like
Add to Favorites

Recommend

Technical Resources

More>

All reproduced articles on this site are for the purpose of conveying more information and clearly indicate the source. If media or individuals who do not want to be reproduced can contact us, which will be deleted.

Integrated Circuits