The rapidly changing landscape of Generative AI is revolutionizing the way we think about and do business. As use cases reveal both the opportunities and risks of this technology, new regulation is likely to take shape and highly regulated industries must find ways to stay ahead and excel. We discuss technological, cultural, ethical, and process considerations for deploying solutions based on LLMs in high regulated industries.