NVIDIA Unveils New AI Plugins for Unreal Engine 5 at Unreal Fest Seattle 2024

Unreal Fest Seattle 2024 kicked off recently, and NVIDIA has just announced an exciting lineup of AI-powered plugins for Unreal Engine 5, streamlining the creation of MetaHuman characters on Windows PCs. These groundbreaking tools are set to transform the way developers integrate AI into their games and applications, offering faster, more efficient workflows and improved scalability.

NVIDIA Simplifies AI-Powered MetaHuman Deployment with New ACE Plugins and Microservices

Key Highlights: NVIDIA’s New Unreal Engine 5 ACE Plugins

• Audio2Face-3D Plugin:

• Brings AI-powered lip sync and facial animation directly into Unreal Engine 5 for seamless character creation.

• Nemotron-Mini 4B Instruct Plugin:

• Provides AI-generated responses, enabling more dynamic, interactive character dialogues.

• Retrieval Augmented Generation (RAG) Plugin:

• Enhances character interactions with contextual information, adding depth to AI-powered conversations.

New Tools for Autodesk Maya: Audio2Face-3D Plugin

• Autodesk Maya users can now enjoy high-quality, audio-driven facial animations with NVIDIA’s Audio2Face-3D Plugin.
• Developers can customize and integrate this tool into other digital content creation workflows, bridging Maya and Unreal Engine 5 for smoother production.

Unreal Engine 5 Renderer Microservice with Pixel Streaming

• NVIDIA leverages Unreal Pixel Streaming technology to support the ACE Animation Graph microservice and Linux OS.
• Developers can now stream high-fidelity MetaHuman characters to any device using WebRTC, enabling real-time, high-quality rendering.

Benefits for Developers

• Simplified AI Integration: These tools streamline the process of incorporating AI-powered digital humans into games and apps.
• Optimized Performance: Expect low latency and reduced memory usage on Windows PCs, ideal for intensive game development.
• Cloud Scalability: Easily scale up with cloud-based deployment options for more complex projects.
• Customizable Tools: Developers gain access to source code for tailored development, allowing full customization to suit specific project needs.

Get Early Access

• Developers can apply for early access to download the Unreal Engine 5 renderer microservice, including support for the Animation Graph microservice and Linux OS.
• The Maya ACE plugin is now available for download on GitHub.

These innovations mark a major leap forward for developers, offering cutting-edge tools to build realistic AI-powered characters more efficiently. Stay tuned for more updates from Unreal Fest Seattle 2024!

For questions or further information, feel free to reach out.