What does it take to design successful products around AI capabilities? GitHub Copilot was one of the first at-scale products built on top of generative AI, serving the millions of software developers who collaborate every day in both enterprises and open source communities. It’s easy to create compelling demos with AI, but achieving reliability and delivering value required us to explore different interaction patterns, discover effective strategies for prompting the models, and figure out how to define and measure “good” despite the model outputs being nondeterministic. Weaving intelligence into products is a new frontier, and we’ll share wisdom gleaned during our journey.