MemryX, a technology startup originating from the University of Michigan, has launched a $149 product M.2 module [PDF] Designed to provide efficient artificial intelligence processing capabilities for compact computing systems. This module targets edge computing applications where power efficiency and compact design are critical.
Packaging four MemryX MX3 AI accelerator dies into the standard M.2 2280 form factor allows the module to be easily integrated into systems equipped with PCIe Gen 3 M.2 slots. It is said that each MX3 chip can provide 6 TOPS (tera operations per second), providing a total of up to 24 TOPS of computing power, while consuming only 6 to 8 watts. It also supports a range of data formats, including 4-bit, 8-bit, 16-bit weights and BFloat16. Notably, the mod operates without active cooling, instead relying on the included passive heatsink to manage thermal performance.
Philonix The MemryX MX3 M.2 module has been tested to evaluate its performance and usability as an AI accelerator. The module installs on a system running Ubuntu 24.04 LTS with an M.2 PCIe Gen 3 slot, and is very simple to integrate thanks to MemryX’s open source drivers and developer tools. The 24 TOPS performance of the module’s four MemryX MX3 chips is said to be sufficient for a variety of inference workloads, especially those optimized for 8-bit weights.
The review also highlighted the module’s strong software compatibility, support for frameworks such as TensorFlow and ONNX, and its efficiency in running small and medium-sized artificial intelligence models. Each MX3 chip supports up to 10.5 million 8-bit parameters, and the module’s four chips can handle a total of up to 42 million parameters. This limitation is due to the lack of onboard DRAM. MemryX plans to solve this problem by launching a new PCIe card in 2025, which will be equipped with more MX3 AI chips.
Priced at $149, the MX3 M.2 module is an affordable option for developers and organizations looking to add AI processing capabilities to edge devices. MemryX has also announced that the mod will be available at the upcoming Consumer Electronics Show (CES) 2025 in Las Vegas plans to demonstrate the performance of the MX3 in a variety of practical applications, further highlighting its versatility.