Apple explore LLM on flash (run large lang model on iDevices?)

Dec 23, 2023 ·

Apple is exploring the use of Low Level Memory (LLM) on flash storage, a technology that could bring increased speed and capacity to iPhones and laptops. LLM is a form of Non-Volatile Memory Express (NVMe) that allows for rapid access speeds up to 10 times faster than traditional hard drives. It is also more energy efficient, meaning it can run longer on battery power.

By using LLM on flash storage, Apple would be able to significantly improve the performance of its devices. This would make its products even more attractive to customers, as more processing power would mean more capabilities from the products. Additionally, this technology could possibly allow Apple to increase the memory capacity of its devices as well as their battery life.

The technology has already been implemented in some MacBooks, with reports suggesting that Apple is looking into bringing it to iPhones and other devices in the future. It is likely that Apple will utilize the same technology used in these computers, which is based on the PCIe 4.0 interface, in order to achieve maximum performance.

Apple is always looking for ways to keep its products ahead of the competition, and the use of LLM on flash storage could provide a significant advantage. Although it may take some time to develop, the advances this technology could bring could make Apple's devices stand out even more in the market.