BETA
This is a BETA experience. You may opt-out by clicking here

More From Forbes

Edit Story

AI In Hollywood Draws Heavy Crowd For New Kind Of Filmmaking

Following
Updated May 20, 2024, 09:43am EDT

This time last year, most of Hollywood was out of work, grinding through two strikes prolonged partly by fears about artificial intelligence. This time this year, it seemed like most of Hollywood was at a downtown Los Angeles production center, to learn how they could use AI to make their next movie or TV show.

The occasion was the second “AI on the Lot,” a conference that drew 850 registrants Thursday to Los Angeles Center Studios, where they crammed into a theater and meeting center and a nearby sound stage outfitted for virtual production, to talk through the nitty gritty of workflows, opportunities and headaches caused by the burgeoning availability of powerful new tools.

“I feel like I'm so far behind,” said Josie Kaye, a long-time Groundlings performer and actor/writer/cinematographer. “I started using AI in January. I know people who have been using it for a year.”

Kaye said she has used AI tools to create social-media content and music videos, including one for an improvisational rapper whose lyrics about a man eating a pineapple would have been challenging to illustrate in video otherwise. With the writer and actor strikes behind them, Kaye said more and more Hollywood professionals are exploring AI’s possibilities.

“There's optimistic hesitance,” said Adobe’s director of product marketing for pro video & film Meagan Keane, a former filmmaker. “Coming out of the strikes especially, it’s important for all creative disciplines to be aware (of what AI can do). But really, creatives are hungry to be creative. When we really dig in (with professionals), there’s a lot of optimism about how much they can create.”

Many others at the conference, on stage and in various conversations, showed off their increasingly sophisticated use of various AI tools.

AI is already transforming industries from farming to manufacturing, healthcare to retail. But entertainment and media have seen an avalanche of specialized programs in recent months, many of which are being rapidly updated and repeatedly improved, said keynote speaker Renard Jenkins, president and CEO of I2A2 Technologies, Labs and Studios. Jenkins is a former Warner Bros. and PBS executive, and president of technology standards body Society of Motion Picture and Television Engineers.

Already, Jenkins said, fashion and other kinds of still photography (other than at live events), have been disrupted, as have 2D and 3D animation. Now other sectors are seeing big changes. Some of the best-known general tools, such as Midjourney, Stable Diffusion and Open AI’s ChatGPT are being widely used.

Adobe’s Adobe various software packages already have capabilities powered by its Firefly AI to generate still images from text, pick the best take of a scene, and assemble rough edits. The company recently announced its Premiere Pro video editing software will add the ability to slightly extend a video clip to better allow a too-short scene to “breathe,” Keane said. That capability is expected to fully debut by year’s end.

Adobe is trying to enhance “peak productivity, removing all these things that creatives don't want to be doing,” Keane said. “Creatives are fearful, I get that, but there's so much that AI can be doing to give them time back to be creative.”

Many startups, meanwhile, provide specialized capabilities like upscaling video resolution, cloning voices, matching video to audio, creating sound effects and more.

The industry is now, one attendee said, in the third stage of its AI era, figuring out how to make all those programs work together to create real shows. Creators have plenty of choices, as Jenkins and others detailed.

“(Viggle 2.0) came out a few months ago, and is kind of changing the game in creating still images,” said Jenkins. “It does give you the opportunity to see where things are going to go with the pieces you're working on. This is probably one of the tools that's going to help you join the (AI) party.”

Three of the 50 filmmakers who created pieces of Our T2 Remake, a tongue-in-cheek “remake” of Terminator 2 (a trailer is available on YouTube and at t2remake.com) said they tapped a wide range of tools. The list included video generators Leonardo.AI, Pika Labs, and Runway, editor CapCut, music creators Suno and MusicBed, lip-synching tools SyncLabs and D-ID, Envato for sound effects, and voice generator Eleven Labs, among others.

“I've learned a lot,” said Matthew Wenhardt, who called himself a “gen AI filmmaker.” In creating his segment of the T2 project, “That was my first (AI-stylized) video. I would definitely change my work flow. I would probably do some sort of live action (filming) and translate that.”

Jenkins deconstructed a widely distributed Sora.ai video clip of a Dalmatian puppy climbing from one window sill to another, saying, “They didn't quite get it right. An animator could take the same image and make the dog(’s walking) look more realistic.”

That said, OpenAI-owned Sora has already been updated in the few months since that clip was unveiled (it remains in beta and is not widely available), and is dramatically better at creating realistic movement, Jenkins said.

“If you take a look at how far they've come with Sora, it is mind-bendingly frightening how far they've progressed,” Jenkins said.

And not everyone at the conference was sanguine about AI’s potential impacts on their own corner of creativity.

David Slade directed the hugely influential interactive Bandersnatch episode of Netflix’s Netflix long-running sci-fi anthology series Black Mirror. During the strikes, he began experimenting with AI tools, and found much to like about what was possible, but also some concerns.

“What I found to be incredibly lonely about the process is that I couldn't involve actors,” Slade said. “I spent years and years and years (as a director) explaining to people what I want. I'm getting what I want. It looks like my work. But I really want actors to be involved.”

The potential loss of creative collaboration with actors and others is an important issue, he said, that shouldn’t be discounted, especially for an industry that has depended on that ineffable alchemy to fuel many of its greatest creations.

Other attendees voiced their own concerns about the inevitable, if not always acknowledged, job loss that will come from AI as it more fully inserts itself into the industry.

“They’re all delusional,” said a 32-year-old TV writer after listening to a session on the potential uses of AI’s Large Language Models. The television business is already struggling, with legacy cable and broadcast networks reducing scripted programming, or even shutting down, while streaming services have been reducing their spending on new shows.

ChatGPT and other text-focused AI tools can quickly generate scenes, software code, dialog, even prompts for text-to-video and other kinds of software. That could doom the mid-career jobs in writers rooms across Hollywood, making it difficult to train the next generation of showrunners, said the writer, who declined to give her name.

Her concerns mirror those raised by many in the Writers Guild of America last year when they successfully pushed for a new contract that guaranteed minimum staffing levels in TV writers rooms. Even with protections like that, plenty in Hollywood’s creative class remain worried amid the exhilaration.

Follow me on Twitter or LinkedInCheck out my website

Join The Conversation

Comments 

One Community. Many Voices. Create a free account to share your thoughts. 

Read our community guidelines .

Forbes Community Guidelines

Our community is about connecting people through open and thoughtful conversations. We want our readers to share their views and exchange ideas and facts in a safe space.

In order to do so, please follow the posting rules in our site's Terms of Service.  We've summarized some of those key rules below. Simply put, keep it civil.

Your post will be rejected if we notice that it seems to contain:

  • False or intentionally out-of-context or misleading information
  • Spam
  • Insults, profanity, incoherent, obscene or inflammatory language or threats of any kind
  • Attacks on the identity of other commenters or the article's author
  • Content that otherwise violates our site's terms.

User accounts will be blocked if we notice or believe that users are engaged in:

  • Continuous attempts to re-post comments that have been previously moderated/rejected
  • Racist, sexist, homophobic or other discriminatory comments
  • Attempts or tactics that put the site security at risk
  • Actions that otherwise violate our site's terms.

So, how can you be a power user?

  • Stay on topic and share your insights
  • Feel free to be clear and thoughtful to get your point across
  • ‘Like’ or ‘Dislike’ to show your point of view.
  • Protect your community.
  • Use the report tool to alert us when someone breaks the rules.

Thanks for reading our community guidelines. Please read the full list of posting rules found in our site's Terms of Service.