Akali — K/DA Live AR Dance Performance, LPL Summer Finals 2019

Riot Games  ·  LPL Summer Finals  ·  Shanghai Mercedes-Benz Arena  ·  September 2019

LPL 2019:
K/DA Virtual Idol

First Industry First
60M Viewers
3 Continents
Live Unscripted AR

Following the K/DA AR debut at Worlds 2018, the goal was to push further — not just a scripted performance, but a live, unscripted AR character interacting with the real world in front of millions of viewers. Virtual idols were the dominant entertainment form in China. Akali, K/DA's breakout champion, was the obvious choice. The result was three distinct public-facing moments that together demonstrated something new: a virtual character with a genuine, living presence.

"We found that the most compelling cases for AR character use had taken place in live, unscripted expressions. There is something magical and authentic when a virtual character interacts 'in the moment' that goes beyond a fully scripted and pre-recorded expression."

— Kevin Scharff, Production Director

Beat 1 of 3

The Invitation

Before the event, Akali addressed the fans directly — a promotional teaser welcoming viewers to Shanghai and setting the stage for what was coming. A virtual character existing in the world, not just on a stage.

Akali — Welcome to Shanghai · Promotional teaser  ·  K/DA  ·  LPL Summer Finals 2019.

K/DA Akali — LPL 2019 promotional image

K/DA Akali  ·  LPL 2019 promotional campaign.

The Venue

The event took place at Shanghai's Mercedes-Benz Arena as part of the 2019 League of Legends Pro League Finals — the largest regional esports event of the year in Riot's largest player region. With 18,000 fans in the venue and 60M viewers on broadcast, it was the highest-stakes live production environment imaginable for a first-of-its-kind AR experience.

Kevin Scharff at the Mercedes-Benz Arena, Shanghai

Arriving at the Mercedes-Benz Arena, Shanghai.

Load-in and set construction — Mercedes-Benz Arena

Load-in and set construction — the arena being prepared for show night.

Inside the Mercedes-Benz Arena during LPL Finals play

Inside the arena during LPL Finals match play.

Beat 2 of 3

The Performance

Akali performed live at the LPL Summer Finals opening ceremonies in front of 18,000 fans and 60M broadcast viewers. The production spanned three continents: choreography and body mocap at Animatrik in Los Angeles, facial capture tech and actress rehearsal with Cubic Motion in Manchester, and the live event at the Mercedes-Benz Arena in Shanghai.

Akali live AR dance performance — LPL Summer Finals 2019

Akali — Live AR Dance Performance · LPL Summer Finals, Shanghai Mercedes-Benz Arena, September 2019. Motion capture from Los Angeles, performed live in front of 18,000 fans and 60M viewers.

LA Mocap BTS — giving feedback on the performance

Los Angeles  ·  Giving performance feedback during body mocap at Animatrik.

LA Mocap BTS — blocking out the action

Los Angeles  ·  Blocking out the choreography sequence.

Shanghai — rehearsal and technical run-throughs

Shanghai  ·  Rehearsal and technical run-throughs at the arena.

Beat 3 of 3

The Conversation

During the finals match, Akali sat down for a live, unscripted on-camera interview with host Candice — broadcast in real time to 60M viewers. The first time a virtual AR character had conducted an unscripted live interview on a broadcast stage. Facial capture performed live in Manchester by a voice and motion actress, composited in real time in Shanghai via Cubic Motion's Persona system.

Live AR interview — Akali and host Candice, LPL Summer Finals 2019

Akali & Host Candice — Live AR Interview · Unscripted, live on broadcast. Facial capture in Manchester, composited in real time in Shanghai. An industry first.

Pixotope case study — Riot Games LPL 2019

Pixotope / The Future Group  ·  Case Study · How Riot Games brought a virtual K/DA idol to life at LPL 2019. Read the case study →

Technical testing at Cubic Motion, Manchester UK

Manchester, UK  ·  Technical testing at Cubic Motion.

On-site rehearsals — Shanghai Mercedes-Benz Arena

Shanghai  ·  On-site rehearsals at the Mercedes-Benz Arena.

Mocap volume on-site — Shanghai LPL Finals

Shanghai  ·  Mocap volume on-site during the LPL Finals.

The Technology

The first live broadcast combining real-time ray tracing and real-time facial animation simultaneously, at 59.94 fps, composited in under 17ms per frame. Four Pixotope AR platforms deployed (3 live + 1 backup). Three camera angles: jib arm, free-roaming Steadicam, high aerial.

Riot Games Character Asset Creation Pixotope / The Future Group AR platform & real-time compositing Cubic Motion Facial capture (Persona system), rig rebuild Animatrik Film Design Body Motion Capture Stype Live camera tracking (3 cameras) Nvidia RTX Real-time ray tracing GPU hardware Unreal Engine 4 Real-time rendering engine

Want more details? Pixotope published a full breakdown of the AR technology and pipeline behind this production — the real-time ray tracing, facial capture, camera tracking, and live compositing that made it possible.

Read the Pixotope Case Study →

The Collaboration

"We worked together across three continents for this experience — in Los Angeles for the original motion capture of the dance beat, in Shanghai for casting, modeling, location scouting, and pre-visualization, and in Manchester for a technical test and capture of the live interview, and finally in Shanghai for the live event. The key to the success was the collaboration and seamless integration of Riot teams in LA and China with world-class partners in Pixotope, Animatrik, and Cubic Motion."

— Kevin Scharff
LA Mocap Shoot — Animatrik Film Design, Los Angeles

Los Angeles  ·  LA Mocap Shoot at Animatrik Film Design.

Manchester Technical Test — Cubic Motion

Manchester, UK  ·  Manchester Technical Test with Cubic Motion.

Crew celebrating at the Shanghai event

Shanghai  ·  Some of the crew celebrating at the LPL event.