Text-to-3D Non-Deformable Animation: A Proof-of-Concept System using Natural Language Descriptions

Abstract

The ability to generate 3D animations from natural language descriptions has significant potential in various fields, including entertainment, education, and computer-aided design. This research paper presents a novel proof-of-concept system that transforms text prompts into complete and simple 3D animations. The system architecture comprises two main components: extraction and scene creation. In the extraction phase, a transformer model identifies the necessary objects from the text prompt, generates their geometric representations as vertices and edges, and creates a script describing the animations. The scene creation phase involves constructing the 3D objects, adding them to the scene, and rendering the animation based on the generated script. The implementation details, including the technologies and tools used, code snippets, and challenges faced, are thoroughly discussed. Qualitative and quantitative evaluations are conducted to assess the system's performance, highlighting its strengths and limitations compared to existing text-to-animation approaches. Potential applications of the proposed system are explored, ranging from rapid prototyping of 3D animations to interactive storytelling and educational tools. Furthermore, future research directions, such as improving scalability, generalization, and real-world deployment, are outlined. The research presented in this paper contributes to the emerging field of text-to-animation generation and paves the way for further advancements in transforming natural language descriptions into engaging and immersive 3D experiences.