Demo of a large‑scale autograding system handling 1 million users and 25 k concurrent sessions, using Whisper, Llama, multi‑cloud deployment, and prompt tuning.
Overview
I implemented a full scale autograding solution for written and spoken answers for 1million userbasr 25k concurrent users.
We used whisper and llama. On different providers to meet the scale.
