Testing AI – by building Minesweeper
People are trying it evaluate how good AI agents are by giving them a variety of tasks. Ars Technica decided to test different agents by telling them to make Minesweeper.
While now dated, how people are testing AI solutions is an ongoing problem. I do remember these early tests being a clear demonstration that AI was now capable of making working solutions from just vibe-coded slop.