NVIDIA and Unreal Engine 5 Enhance AI-Powered MetaHuman Deployment
The post NVIDIA and Unreal Engine 5 Enhance AI-Powered MetaHuman Deployment appeared on BitcoinEthereumNews.com.
Rebeca Moen Oct 02, 2024 06:20 NVIDIA introduces new Unreal Engine 5 plugins for AI-powered MetaHuman characters, simplifying deployment with ACE technology. At Unreal Fest 2024, NVIDIA unveiled new Unreal Engine 5 on-device plugins for NVIDIA ACE, designed to streamline the creation and deployment of AI-powered MetaHuman characters on Windows PCs. According to NVIDIA Technical Blog, ACE is a suite of digital human technologies providing speech, intelligence, and animation powered by generative AI. New Plugins and Features The latest release includes the Audio2Face-3D plugin for AI-driven facial animations in Autodesk Maya. This plugin offers a simplified interface to expedite avatar development in Maya, complete with source code for further customization in other digital content creation tools. NVIDIA has also developed an Unreal Engine 5 renderer microservice utilizing Epic’s Unreal Pixel Streaming technology. This microservice supports the NVIDIA ACE Animation Graph Microservice and Linux OS in early access. The Animation Graph Microservice enables realistic character movements, and with Unreal Pixel Streaming, developers can stream MetaHuman creations to any device. Enhanced Developer Resources The NVIDIA ACE Unreal Engine 5 sample project guides developers in integrating ACE into their applications. The project expands the number of on-device ACE plugins, including: Audio2Face-3D for lip sync and facial animation The Nemotron Mini 4B Instruct model for response generation Retrieval-augmented generation (RAG) for contextual information These microservices are optimized for low latency and minimal memory usage on Windows PCs, allowing developers to create responsive MetaHuman characters efficiently. Streamline 3D Animation with Maya ACE Plugin Autodesk Maya, known for its high-performance animation capabilities, now supports the Audio2Face-3D plugin, facilitating high-quality, audio-driven facial animations. The plugin’s user interface allows for seamless transition to Unreal Engine 5, and the source code can be tailored for other digital content tools. To begin, developers should generate an API key or download…
Filed under: News - @ October 2, 2024 6:20 am