Credit: Robert Triggs / Android Authority
- A recent Apple research paper has detailed its solution for bringing on-device generative AI to iPhones.
- The approach reduces the need for plenty of RAM, suggesting that this solution could enable on-device AI on older iPhones.
We’re expecting loads of Android flagship phones to offer on-device generative AI capabilities in 2024, but Apple has been pretty quiet in this regard. Now, a new research paper published by the company has revealed how the company could get AI running locally on its iPhones.
The Financial Times spotted an Apple research paper that details a solution for running large language models (LLMs) on devices with limited RAM. The paper reveals how Apple could keep the “model parameters” in storage and bring chunks of them to the device’s RAM as needed, as opposed to loading the entire model into RAM.