View-dependent AD
View-dependent AD makes audio descriptions respond to where the user is looking in VR. In our demo, descriptions play only when a performer, like a singer or guitarist, is in the viewer’s central focus, defined within a 5-degree angle. This range matches our natural “focal view,” which is the part of our vision we pay closest attention to. When the performer moves out of this focus area, the description stops automatically. We can adjust this angle based on how close performers are to each other, ensuring the right descriptions trigger at the right time.
This VR scene features several performers, each with brief descriptions covering parts of the performance. The drummer, however, has a longer, detailed AD that runs from start to finish, closely matching each of his actions. Full, extended ADs for the other performers are planned and will be created with input from professional AD creators.
Thank you!
If you’d like to share any feedback or stay updated on new developments, I’d love to hear from you! Feel free to reach out; your insights help make this project even better. Thanks for exploring the demo!