Members-Only
Recent Talks & Demos are for members only
You must be an AI Tinkerers active member to view these talks and demos.
August 23, 2025
·
Dubai
Llama Whisper Large-Scale AutoGrading
Demo of a large‑scale autograding system handling 1 million users and 25 k concurrent sessions, using Whisper, Llama, multi‑cloud deployment, and prompt tuning.
Overview
I implemented a full scale autograding solution for written and spoken answers for 1million userbasr 25k concurrent users.
We used whisper and llama. On different providers to meet the scale.
Tech stack