This is also the XPU using scenario In my mind too. “Whisper on NPU, LLMs on iGPU, document embeddings on CPU! Full use of #AIPC through #OpenVINO to implement scenarios like chat with documents and voice guided assistant that generates code. Everything on our new Lunar Lake platform that was just announced.”
Whisper on NPU, LLMs on iGPU, document embeddings on CPU! Full use of #AIPC through #OpenVINO to implement scenarios like chat with documents and voice guided assistant that generates code. Everything on our new Lunar Lake platform that was just announced. Pipelines are running locally, so documents and queries that you use never exposed to cloud. No need for network connection to use it, working from airplane unlocked. #SLMs that run locally is very promising direction in my opinion. We should not expect miracles in terms of actual knowledge from those models, #RAG-like pipelines will drive knowledge based context for model to analyze and respond. SLMs should be more about skill, not actual knowledge. https://lnkd.in/d27MDvPd Guy Boudoukh, Moshe Wasserblat, Ekaterina Aidova and team, great work on putting it together!
