The emergence of ChatGPT, a conversational AI developed by OpenAI, has raised profound questions about its impact on the traditional university experience. This article addresses the pervasive discourse surrounding ChatGPT by investigating the actual capabilities of AI writing at the undergraduate level. To study the strengths and limitations of AI in the classroom, we conducted a survey experiment involving faculty assessment of essays generated by ChatGPT. Contrary to concerns of diminishing academic rigor and standards, our findings suggest that ChatGPT’s effectiveness is influenced by user knowledge, indicating potential for symbiotic integration into pedagogical approaches. Rather than spell the end of the college essay, we suggest that ChatGPT offers opportunities to open discussions about information literacy and verification of information. For universities, our study suggests revising university AI-usage policies and incorporating AI into teaching and learning objectives.