Workshop: Leveraging AI for Multimedia Design
This workshop introduces participants to AI tools that enhance multimedia design workflows. Through hands-on exercises, participants will learn how to use AI to generate images, videos, and audio, exploring the creative potential and ethical considerations of AI-driven design. Participants will gain practical skills with free versions of AI tools and a clear understanding of AI’s role in boosting creativity and efficiency in multimedia design.
- Before and Then After Case Study – AI workflow for working on a movie
- HappyFinish.com – Toby Roberts
- AI in the Arts Showcase – DTC 338 Spring 2024
- An Open Education Resource for working with Generative AI:
Dynamic AI Co-Creation: A Human-Centered Approach
Creating with AI Tools
Open and start free accounts with:
Vizcom – sketch to image
MidJourney – image style and variation
RunwayML – video clips, “camera” movement
Udio – music generation
1: Sketch Your Vision
Sketch an image in Vizcom or on paper (and upload a photo of your sketch).
Use Vizcom to convert your sketch into a high-quality digital image with a prompt and various settings.
3: Explore Styles with MidJourney
Upload the Vizcom-generated image to MidJourney and experiment with different styles using text prompts (e.g., cinematic, watercolor, abstract, photo realistic).
4: Generate Video with RunwayML
Use RunwayML to generate simple motion effects for the image (zoom, pan, etc.), turning it into a short video. Use the style number to generate other video clips in the same image style.
5: Add Sound with Udio
Generate sound or background music using Udio and apply it to your video clip.
6: EDit video
Gather video and sound clips and edit a short sequence in Premiere Pro.
Closing Discussion
- What worked well? What challenges were faced? How did AI impacted creative decisions?
- Explore ethical implications of using AI in design and art, including issues of originality, authorship, and the role of human creativity.
- Discuss future trends in AI-driven multimedia design and the skills designers will need to adapt.
AI Tools for Multimedia Design
Images:
- ChatGPT (OpenAI) – AI-powered language model for writing, brainstorming, and idea generation.
- Stable Diffusion – An open-source AI model that generates detailed images from text prompts, allowing for customization and fine-tuning by users.
- Vizcom – AI-based sketch-to-render tool that turns sketches into digital illustrations.
- PromeAI – An intuitive AI tool that turns hand-drawn sketches into fully rendered images with impressive detail, often used for creative and design projects.
- Adobe Firefly – Adobe’s generative AI tool that enables image generation and editing with advanced features integrated into the Adobe Creative Cloud suite.
- Topaz Gigapixel AI – A tool designed to enlarge images without losing detail, using AI to improve image sharpness and clarity, making it ideal for photographers and designers.
- MidJourney – AI-driven image generator that creates stylized images based on text prompts.
- DALL·E 2 (OpenAI) – Text-to-image AI model that generates detailed, customizable images from prompts.
Video:
- RunwayML – AI video editing and animation tool that creates dynamic videos and effects.
- Lumen5 – AI-powered tool for creating video presentations from text.
Audio:
- Udio – AI tool for generating custom soundtracks and sound effects.
- Descript – AI-powered audio and video editing platform with transcription and voice generation.
- ElevenLabs is a very good voice generator and sound effects generator at a good price.
- Stable Audio (stability ai) is an audio and music generator
- Suno 3.0 is a good for audio and music generation