May the 4th, y'all
If we rename AI agents to "nerfs", then this can be my official job title.
Collector Vision - Scanner Playground Demo (Open Source)
Demonstrating the latest version of CollectorVision -- my open-source card scanning library that I'm releasing to the public. This is a demonstration of my online playground demo for running custom code when users scan cards. It supports Magic: The Gathering currently, with…
Watch on YouTube →CollectorVision Part 8: The Sol Ring Benchmark — Testing Card Recognition on the Hardest Case
Sol Ring is ranked 1 on EDHREC — the most-played card in Commander, by a wide margin. It also happens to be one of the hardest cards for an image recognition system to get right. The reason is the artwork. The most common Sol Ring printing uses the Mike Bierek illustration, and…
Read more →CollectorVision Part 7: Card Accuracy vs. Edition Accuracy
When people ask how accurate a card scanner is, they usually mean one thing, but the question actually has two different answers depending on what you care about. Understanding the difference matters if you're trying to evaluate whether a system is good enough for your use case.…
Read more →CollectorVision Part 6: The Hybrid Split — Local Inference, Server Lookup
Part 6 of the CollectorVision series. Part 1 has the overview. There are three ways to deploy CollectorVision, depending on where you want the computation to happen and how much bandwidth you have. --- Fully local The Python library and the browser scanner both run entirely on…
Read more →CollectorVision Part 5: The Browser Scanner — Full ML Pipeline in a Web Page
Part 5 of the CollectorVision series. Part 1 has the overview. The browser scanner runs the entire pipeline — corner detection, perspective warp, neural embedding, catalog search — inside a web page, with no server. It's hosted at https://hanclinto.github.io/CollectorVision/.…
Read more →CollectorVision Part 4: Running It Locally — Python Library and REST Server
Part 4 of the CollectorVision series. Part 1 has the overview. This post covers the practical side: installing the library, running it against a webcam, and the REST server. Post 6 goes deeper into the deployment split — when to run everything locally versus offloading catalog…
Read more →CollectorVision Part 3: Milo — Embedding 108,000 Cards into 128 Numbers
Part 3 of the CollectorVision series. Part 1 has the overview. After Cornelius finds the card and the perspective is corrected, you have a clean 252 × 352 crop. The next problem is figuring out which of 108,000 cards it is. --- Why not a classifier? The obvious approach is to…
Read more →CollectorVision Part 2: Cornelius — How the Corner Detector Finds Cards in the Wild
Part 2 of the CollectorVision series. Part 1 has the overview. Before you can identify a card you have to find it. Cornelius is the model responsible for that — it takes a camera frame and predicts where the four corners of the card are. This sounds easy. It's not. --- What the…
Read more →CollectorVision: Identifying Trading Cards with On-Device Machine Learning
I've been working on a card scanner for Magic: The Gathering for a while now and wanted to write up how it works. The short version: you show it a card, it tells you what it is. It handles held cards, sleeved cards, skewed angles, phone cameras. The whole thing runs locally —…
Read more →