What went wrong with Zillow’s $500 million AI-based home purchasing program? It was a host of factors, but it highlights a unique problem in AI.
It turns out you can’t just set up an AI model and let it crank for years. You need to pay attention to something called drift. There are ways of telling if your AI model is drifting by monitoring model accuracy, outputs, and inputs on an ongoing basis and re-balancing them.