Week 7 • Generative Cinema
To Do This Week
In Class
Generative Video Options
- Runway — Text-to-video generation, editing, and cinematic motion tools (Gen-2 / Gen-3).
- Runway YouTube Tutorials — Official training videos and creative workflows.
- Flow — Frame interpolation and slow-motion tool for maintaining smooth motion across generated clips.
- Midjourney — Image generation for concept art, look development, and style seeding.
- Sora 2 — OpenAI’s next-generation text-to-video model capable of extended cinematic sequences.
- Pika Labs — fast prompt-based video generation with editing tools
- ElevenLabs — AI voice and sound synthesis for narration, dialogue, and expressive performances.
- Udio — cinematic and ambient score creation
- Stable Audio — sound effects and loops from text prompts
In-Class Exercise: Three-Shot Mini-Narrative (with Sound)
Goal: Create a 10–20 second mini-narrative composed of three AI-generated shots with sound. The sequence should tell a simple story or convey an emotional progression (beginning / middle / end) while maintaining a consistent visual and sonic style.
Steps:- Concept: Sketch a simple idea—a moment, dream, or encounter. Think visually and emotionally rather than plot-heavy.
- Generate Source Images: Use Midjourney or Runway to create initial keyframes or stills. Keep track of seed numbers or reuse the same base image for consistency.
- Generate Shots: In Runway, Flow, Sora, or Pika Labs input the same visual style (seed, camera description, color palette). Use the same character, environment, and tone keywords for each shot.
- Edit: Combine the three clips in Adobe Premiere. Use fades or sound bridges to link shots smoothly.
- Sound: Create or mix a brief soundtrack using ElevenLabs, Suno 2, Udio, or Stable Audio. You may include ambient sound, foley, or AI-generated voice lines.
- Export: 16:9, 720p or 1080p, under 30 seconds. Upload to YouTube or Vimeo and post the link in Canvas.
- Use the same seed number or reference image when generating multiple shots.
- Copy-paste style parameters (color scheme, lighting, lens type, camera movement) between prompts.
- When possible, feed one frame or output back as a starting image for the next shot.
- Stick with a single aspect ratio (16:9) and lighting setup.
- Reference a specific filmmaker or film stock for coherence (e.g., “soft chiaroscuro lighting, Kodak Portra 400”).
STYLE REFERENCES
Camera & Film Types
- Camcorder: Film grain, noise, and saturation, reminiscent of VHS tape.
- DSLR: Superior resolution, sharpness, and clarity.
- GoPro / GoPro Video: Fish-eye effect, often in the form of a selfie.
- Disposable Camera: Fixed-focus 35mm lens.
- Polaroid: High black point and faded effects.
- Fujifilm Superia: High-performance, high-speed color negative film with fine-grain.
- Instax: Daylight color film with a high gloss finish.
- Kodak Ektar: Retro hues or poppy contrast.
- Kodak Gold 200: Crisp and clear results for bright, sunny days.
- Kodak Portra: Vivid colors, light, and textures in a crisp format.
- Velvia: High-saturation film.
- Lomo: Oversaturated, high-contrast look with a soft blur.
- CinemaScope: Old filming technique known for its 2.35:1 aspect ratio.
- Kodak 400TX / Tri-X 400TX: Fine-grain black and white images.
- VistaVision: High-resolution widescreen format using 35mm film.
- Technirama: Double the resolution of anamorphic 35mm film.
- Tintype: Direct positive images on thin metal coated with dark lacquer or enamel.
- Calotype / Talbotype: Paper coated with silver iodide, vintage look.
- Ambrotype: Underexposed glass negatives placed against a dark background.
- Daguerreotype: Highly detailed images on copper plated with silver, without using a negative.
Camera Angles
- Eye-level: A neutral camera angle at the subject’s eye level, providing a natural perspective.
- Low-angle: Looks up at the subject from below, emphasizing dominance or power.
- High-angle: Looks down at the subject, making it appear smaller or less significant.
- Dutch angle: (Canted or tilted) Creates disorientation or unease.
- Overhead: Looks directly down on the subject from above, offering a unique perspective.
- Bird’s-eye view: Captures scenes from a high vantage point, providing scale and context.
- Drone view: Aerial angle achieved using a drone.
- Worm’s-eye view: Looks up from ground level, creating a dramatic perspective.
- Ground-level view: Captures subjects from near the ground, often neutral in perspective.
- Side view: Captures the subject from the side for dynamic compositions.
- Off-center view: Subject is not centered, creating visual tension or energy.
Shot Types
- Close-up (CU): Focuses on a face or detail to emphasize emotion or importance.
- Extreme close-up: Tightly frames a small detail or feature, highlighting its significance.
- Wide shot: Shows the subject within its environment for context.
- Extreme wide shot: Establishes a large location or spatial relationship.
- Medium shot: Frames the subject from the waist up, common for dialogue.
- Medium-full shot (American shot): Frames the subject from knees or mid-thighs up.
- Over-the-shoulder shot: Looks over one subject’s shoulder toward another, creating spatial depth.
Lighting Styles
- Natural Light: Uses available light sources for realism and subtlety.
- Key Light: Main source defining direction and intensity of illumination.
- Fill Light: Softens shadows cast by the key light.
- Backlight: Separates subject from background, adding dimensionality.
- Rim Light: Creates a thin light outline around the subject’s edges.
- Top Light: Casts downward shadows, adding drama or mystery.
- Side Light: Adds depth and texture, often used in film noir.
- High Key Lighting: Bright and even; minimizes shadows for upbeat tones.
- Low Key Lighting: Strong contrasts and shadows for suspense or intensity.
- Rembrandt Lighting: 45° angled key light forming a small cheek highlight.
- Three-Point Lighting: Classic setup: key, fill, and backlight for full control.
- Chiaroscuro: Dramatic contrasts between light and dark for visual intensity.
- Practical Lighting: Uses in-scene sources (lamps, candles) for realism.
- Candlelight: Warm, soft illumination for intimacy or period looks.
- Silhouette: Backlighting that obscures features for bold outlines.
- Soft Lighting: Diffused light producing gentle, flattering shadows.
- Hard Lighting: Direct, sharp light creating defined shadows and intensity.
- Bounce Light: Reflected off surfaces for soft, indirect illumination.
- Practical Effects: Realistic effects like flickering flames or dappled sunlight.
- Stylized Lighting: Experimental or expressive lighting for avant-garde aesthetics.