Abstract Tabletop exercises examining weather-related hazards are not uncommon but are often built around somewhat generic scenarios that only touch on the meteorological communication environment at a very shallow level. A recent exercise in central Oklahoma sought to change that. A local emergency manager, personnel from a National Weather Service (NWS) forecast office, and a severe weather researcher with a background in exercise design and facilitation worked together to create and deliver a realistic severe weather simulation. Exercise participants were exposed to detailed forecast information via NWSChat—a dedicated communication tool used to connect NWS forecasters, emergency managers, and media members for real-time information sharing. NWS forecasters were able to both actively play in the exercise due to the use of NWSChat and observe how local decision-makers interpreted and utilized the impact-based decision support service (IDSS) graphics and short-term forecast updates. The collaborative approach of developing a detailed scenario with numerous real-world IDSS graphics, along with the use of NWSChat for real-time delivery, resulted in overwhelmingly positive feedback from the participants. The local emergency management office identified numerous areas for improvement in communicating real-time forecast information across their jurisdiction, along with gaps in current plans and resources. Meanwhile, the NWS forecast office had the opportunity to experiment with using the new NWSChat platform in a high-impact severe weather environment before a real-world event took place. Forecasters also gained insight into current IDSS graphic interpretation, noting areas for improved messaging to end users, such as adding storm motion to existing severe weather graphics.