A person in motion capture gear interacts with a digital environment on a large screen, with various virtual elements like columns and lighting effects displayed in a 3D scene.

Among the historic brick buildings of the Brooklyn Navy Yard is one of New York City’s most exciting emerging media playgrounds. And it’s open for NYU students to explore. NYU Tandon @ the Yard is home to a 14,000-square-foot media lab and research facility that includes two production studios and multiple systems for working with emerging media technology. From its volumetric capture stage to its roller coaster simulator to New York City’s second largest motion capture studio, this is the place to be if you’re interested in the future of media.

“It’s a really exciting place for students because this is about as close to the real world as it gets,” says R. Luke DuBois. He’s an associate professor in NYU Tandon School of Engineering’s Integrated Design and Media program. He’s also faculty director of Tandon @ the Yard. In addition to its new technologies, the Yard partners with more than a dozen production and technology companies. What’s more, these companies work in the studio, giving students direct access to professionals. DuBois adds, “We’re in New York City and we’re an engineering school. So, we have this great opportunity to do really cool things with entertainment, media, and culture.”

Spend Your Summer @ the Yard

Annika Huiwei Wen is a senior majoring in Interactive Media Arts at NYU Shanghai. She took part in Tandon’s Undergraduate Summer Research Program (UGSRP) and spent her summer conducting research at the Yard.

“The Yard aligns well with my major and my interests in emerging media technologies,” she says. “Its advanced virtual production facilities caught my attention. I took a motion capture class before to understand the basic pipeline, but I was excited to learn and gain more hands-on experience with these technologies.”

Throughout the summer, Annika did just that. She explored new techniques, experimented with new technologies, and expanded her skill set. One of her favorite research projects included working across numerous mediums. “We compared three techniques—volumetric capture, motion capture, and in-camera visual effects—and evaluated their effectiveness against traditional media methods,” she explains. “We then used them to produce an experimental fashion film.”

Two people wearing virtual reality and augmented reality headsets engage in an interactive experience in a tech lab, with a digital environment displayed on a screen behind them.
Making Emerging Media Accessible

One of the Yard’s main goals is creating technology that is available to all. Student researchers experiment in building cost-effective systems so smaller companies and artists will be able to use this emerging media for their own projects in the future.

“If you want a future where you have 3D video on YouTube or a future where an indie film company can use virtual production, it has to get cheaper,” says DuBois. “We’re really interested in making this technology more available to everyone. To do this, we have to come up with workflows to make it more equitable. And that’s what we do.”

For example, DuBois explains that current volumetric capture studios come with a high price tag. But at the Yard, student researchers have used software hacks and large-scale LED screens to recreate a product that feels and looks the same at a fraction of the price. “Of course, everything we do is really, really high quality and really, really professionally done,” DuBois clarifies. “But we’ve created it in a way that it’s not out of the scope for a modest company to use it.”

A group of people collaborates around a laptop, focusing intently on the screen, with one person providing guidance while the others observe and discuss.
Getting Involved @ the Yard

While there are currently no undergraduate classes offered at NYU Tandon @ the Yard, there are plenty of ways for you to get involved. In addition to the UGSRP, students can take part in Vertically Integrated Projects (VIPs) at the Yard. VIPs are multi-year, multidisciplinary projects that emphasize innovative and research-active education. Additionally, the Yard’s events are open to all. Events are a great way for students to explore, learn, and connect with industry leaders. Finally, DuBois encourages students to simply come by and hang out.

“This experience has definitely expanded my knowledge of emerging media techniques,” concludes Annika. “By understanding these technologies, we can better harness their potential for innovative media production projects. And having the role of a motion capture technician on my résumé will be a significant advantage.”

Kelly McHugh-Stewart is Assistant Director of Content Strategy and Development for NYU’s University Relations and Public Affairs Office of Marketing Communications. Through her writing, she seeks out and enjoys telling stories that help people understand the world through a new lens. Kelly holds an MFA in Creative Writing from The New School and a BA in Journalism and Mass Communications from Kansas State University. Her reporting and personal essays have appeared in the New York Times, The Washington Post, Reader’s Digest, CNN Opinion, and Sports Illustrated, among others.