Adobe and GenAI
In this weeks fxpodcast, we sit down with Alexandra Castin, head of Adobes Firefly generative AI team, to discuss the evolution of generative AI, Adobes unique approach to ethical content creation, and the groundbreaking work behind Firefly.This podcast is not sponsored, but is based on research done for thenew Field Guide to Generative AI. fxguides Mike Seymour was commissioned by NVIDIA to unpack the impact of generative AI on the media and entertainment industries, offering practical applications, ethical considerations, and a roadmap for the future.The Field Guide is free and can be downloaded here: Field Guide to Generative AI. From GANs to Multimodal ModelsAs you will hear in the fxpodcast, Adobes journey with generative AI began in 2020, when Adobe introduced Neural Filters in Photoshop. At the time, the focus was on using GANs (Generative Adversarial Networks) to generate new pixels for creative edits. Today, Adobes scope has expanded dramatically to include Diffusion Models, Transformers, and cutting-edge architectures.For me, the core principle of generative AI hasnt changedits about the computer understanding user intent and synthesizing responses from training data, Alexandra explains. The models have evolved to not only understand and generate text but also create and enhance images, videos, audio, and even 3D assets.Adobe is uniquely positioned in this space, as its product portfolio spans nearly every creative medium. With Firefly, theyve embraced multimodal generative AI to create tools that cater to text, images, audio, video, and beyond.All these images are generated with Adobe Firefly from text alone, with no other input.FireflyFirefly is Adobes flagship generative AI platform, now integrated into industry-leading tools like Photoshop, Illustrator, and Premiere Pro. According to Alexandra, Fireflys strength lies in its training data: At its core is a set of high-quality data we have the right to train on. Thats what sets Firefly apartits both powerful and safe for commercial use.One standout feature is Photoshops Generative Fill, which Alexandra describes as a co-pilot for creatives. Users can guide Photoshop with text prompts, allowing Firefly to generate precise visual results. The technology has democratized generative AI, making it accessible and practical for VFX professionals and enthusiasts alike.Ensuring Ethical AIAdobe has been a staple of the creative community for over four decades, and with Firefly, theyve prioritized respecting artists rights and intellectual property. Alexandra points to Adobes commitment to clean training material as foundational to Fireflys strategy.Weve implemented guide rails to guarantee that Firefly wont generate recognizable characters, trademarks, or logos, she says. This safeguard ensures that users work remains free from unintentional infringementa critical consideration in the commercial space.The C2PA Initiative: Building Trust in MediaOne of Adobes most significant contributions to the generative AI landscape is its leadership in the Coalition for Content Provenance and Authenticity (C2PA). Launched in 2018 from Adobe Research, the initiative addresses the growing concern around misinformation and content authenticity.Think of it like a nutrition label for digital media, Alexandra explains. The goal is to provide transparency about how a piece of content was created, so users can make informed decisions about what theyre consuming.The initiative has attracted over 3,000 organizations, including camera manufacturers, media companies, and AI model creators. By embedding content credentials into outputs, the C2PA aims to establish a universal standard for verifying authenticitya crucial step as generative content continues to explode.Looking AheadAs the generative AI landscape evolves, Firefly represents Adobes commitment to balancing innovation with ethical responsibility. By building tools that empower creators while protecting intellectual property, Adobe is aiming to build a future where generative AI becomes an indispensable part of creative workflows.Join us on this weeks fxpodcast as we dive deeper with Alexandra Castin into the future of generative AI, Adobes strategic plans, and the lessons learned along the way.