Members-Only
Recent Talks & Demos are for members only
You must be an AI Tinkerers active member to view these talks and demos.
September 07, 2024
·
Dubai
Llama 3 local, no GPU
This talk demonstrates running Llama3 locally on an NPU laptop without a GPU, explores its limitations and opportunities, and includes a live model selection poll.
Video
Overview
I plan to show how my npu laptop can run llama3 locally, and explain limitations and opportunities
Structure
-
brief explanation of what I am going to demo
-
Demo with llama3
-
Demo with a different model, still have to decide which one. To make the demo more engaging I could make a poll in the room to see which model the audience would like to test
Tech stack