See how to run Llama 3 and another LLM locally on an NPU laptop, exploring performance limits and possibilities for everyday users.
Overview
I plan to show how my npu laptop can run llama3 locally, and explain limitations and opportunities
Structure
brief explanation of what I am going to demo
Demo with llama3
Demo with a different model, still have to decide which one. To make the demo more engaging I could make a poll in the room to see which model the audience would like to test
