Sony is diving deep into artificial intelligence, with a leaked video showcasing AI-Powered PlayStation Characters of Aloy from the Horizon franchise. This cutting-edge experiment hints at the future of gaming, where AI-powered characters could revolutionize player interaction.
Sony’s AI Experiment with PlayStation Characters Revealed
An internal prototype featuring an AI-powered Aloy from Horizon Forbidden West has surfaced, thanks to an anonymous leak. The footage, originally uploaded to YouTube, was swiftly removed following a copyright claim from Muso, a company known for protecting Sony Interactive Entertainment’s intellectual property.
The video, narrated by Sharwin Raghoebardajal, Director of Software Engineering at Sony Interactive Entertainment, demonstrates how Aloy can hold real-time conversations with players using voice commands. This AI-enhanced Aloy not only responds with a synthesized voice but also exhibits realistic facial animations, creating an immersive gaming experience.
AI Tech Powering the Future of PlayStation
The demo employs OpenAI’s Whisper for speech-to-text processing, with GPT-4 and Llama 3 handling conversation and decision-making. Sony’s proprietary Emotional Voice Synthesis (EVS) system generates Aloy’s speech, while its Mockingbird technology animates her facial expressions to match the dialogue.
While the demonstration was initially tested on PC, Sony has reportedly experimented with running parts of this AI technology on PlayStation 5 with minimal performance overhead. This innovation was first revealed internally a year ago and later showcased in an advanced form at the Sony Technology Exchange Fair (STEF) in Tokyo last November.
The Rise of AI NPCs in Gaming
Sony isn’t alone in exploring AI-driven game characters. Nvidia has been actively developing its own AI-powered NPCs under the ACE project, allowing players to engage in open-ended conversations with game characters. The company partnered with Inworld AI to create Covert Protocol, a playable demonstration of this evolving technology.
Similarly, Microsoft is collaborating with Inworld AI to bring generative AI characters and dynamic storylines to Xbox, using its Muse AI model to streamline game development.
AI’s Impact on Game Development Sparks Debate
The gaming industry is already grappling with AI’s growing influence, particularly amid widespread layoffs. According to a Game Developers Conference (GDC) 2024 survey, nearly half (49%) of developers report AI tools being utilized in their workplaces, with 31% personally incorporating them into their workflow.
Sony’s AI advancements are likely to fuel further discussions about the technology’s role in game creation, just ahead of GDC next week in San Francisco. While the leaked video has been removed, its existence underscores the shifting landscape of video game development and raises critical questions about AI’s effect on voice actors, game designers, and immersive storytelling.
Despite multiple requests for comment, Sony has yet to respond regarding the video’s removal or provide further insight into its AI-powered PlayStation experiments. Stay tuned for more updates as the story unfolds.