I have no privileged knowledge, but suspect this work from Microsoft is a good analog for how we will see Apple approaching AI. Small models trained on focused, curated data: https://arstechnica.com/information-technology/2024/04/microsofts-phi-3-shows-the-surprising-power-of-small-locally-run-ai-language-models/