Home About Projects Writing Notes Adventures Books Say Hello
All Projects
✓ Live

Street Food Shuffle: AI Scoring

Snap a photo of your plate at the end of a round of Street Food Shuffle and your phone adds up the points. The photo never leaves the phone.

D-FINEMobileNetV3PyTorchONNX Runtime WebReactSupabaseNetlifyClaude Code
Street Food Shuffle key art: the game logo with Kulfi, Bhukkad and Ice Gola cards and the street food characters

Street Food Shuffle is my card game about Indian street food. Scoring a round means counting combos across a messy table: a Vada with a Pav, three Manchurians in a stack, a Chutney that doubles whatever it sits on. It is the slowest part of the game, so I built a scorer for it. You take a photo of your plate and the app adds up the points.

It is live at https://streetfoodshuffle.online/score.

How it works

How I tested it

I trained on 228 photographed plates and set every threshold on those alone. Then I froze the whole pipeline and scored it once on 200 fresh photos from two new game sessions. The labels for those photos were written from the photos alone, without seeing what the reader said, and I checked every one by hand.

On that fresh set the reader got the score right on 86% of plates and read 83% of plates completely right, with nothing to correct. About one plate in six needs a correction, and most of those come with a question that points at the problem.

What is next

The misses cluster in two places: long fans of puri cards, where only the bottom strip of each card shows, and cards almost fully hidden under a stack. Both are rare in the training photos, so the next round of training adds exactly those.