Google Releases Gemini Omni 1.1 Flash with Scene Extension and Keyframe Control

Google DeepMind has released Gemini Omni 1.1 Flash, updating its multimodal generative video model with programmatic editing controls, extended scene generation, and lower-cost drafting tiers. The model is accessible via the Gemini API in Google AI Studio and the Gemini Enterprise Agent Platform. The update addresses primary friction points in production AI video pipelines: temporal continuity across clips, deterministic camera transitions, iterative preview costs, and high-resolution export qu

2 min
Google Releases Gemini Omni 1.1 Flash with Scene Extension and Keyframe Control

Google DeepMind has released Gemini Omni 1.1 Flash, updating its multimodal generative video model with programmatic editing controls, extended scene generation, and lower-cost drafting tiers. The model is accessible via the Gemini API in Google AI Studio and the Gemini Enterprise Agent Platform.

The update addresses primary friction points in production AI video pipelines: temporal continuity across clips, deterministic camera transitions, iterative preview costs, and high-resolution export quality.

Gemini Omni 1.1 Flash Timeline and Keyframe Architecture

Extended Temporal Context and Scene Stitching

Prior generative video pipelines typically evaluated only the final second of an existing video clip when generating continuations, frequently introducing drift in character appearance, scene geometry, and lighting. Omni 1.1 Flash expands this context window to evaluate up to 10 seconds of preceding video footage.

Using the expanded context, developers can extend generated footage in 10-second increments up to a cumulative video length of 40 seconds. The API maintains narrative state and visual continuity across consecutive generation calls:

from google import genai

client = genai.Client()

interaction = client.interactions.create(
    model="gemini-omni-1.1-flash",
    previous_interaction_id=previous_video_interaction.id,
    input=[
        {"type": "text", "text": "Continue the scene with a slow orbital pan."}
    ],
    response_format={
        "resolution": "720p",
    },
)

Keyframe Interpolation and Video References

To support precise directorial control without relying entirely on prompt engineering, Omni 1.1 Flash introduces two structural conditioning mechanisms:

  • First and Last Frame Interpolation: Developers can supply explicit starting and ending image keyframes. The model synthesizes intermediate frames to produce unbroken transitions, orbital camera movements, or seamless looping sequences.
  • Multimodal Video Conditioning: The model accepts up to 3 seconds of reference video inside prompt payloads. This allows applications to transfer motion dynamics, choreography, or specific subject behaviors onto generated targets while preserving overall scene composition.

360p Drafting Mode and 4K Upscaling

To reduce iteration latency during storyboarding and prompt refinement, Google added a dedicated 360p preview resolution. DeepMind reports that 360p rendering delivers up to 60 percent faster generation throughput at approximately one-third the compute cost of standard 720p output.

Once a composition is finalized at lower preview resolutions, developers can upscale the generated outputs to production-grade 1080p and 4K resolutions.

Developer Access and Platform Integration

Gemini Omni 1.1 Flash is available in preview via Google AI Studio and Google Cloud Vertex AI / Gemini Enterprise Agent Platform.

Third-party creative platforms have begun integrating the model into commercial workflows. Adobe is incorporating Omni 1.1 Flash into Firefly video tooling, Figma has deployed it within the Figma Weave collaborative canvas, and Runway and GMI Cloud have added the model to their inference backends.

On the consumer side, Google is rolling out scene extension and creative controls to Google AI Plus, Pro, and Ultra subscribers across Google Flow and the Gemini web interface.

Sources

Written by

More to read

  • LLM Red Teaming and Automated Adversarial Testing in Production: Comparing Garak, Microsoft PyRIT, Promptfoo Red Team, and HarmBench

    Manual penetration testing and bespoke adversarial prompt engineering cannot scale to modern production LLM systems. As language models transition from isolated completion endpoints to stateful autonomous agents with tool-calling capabilities, file system access, and external retrieval pipelines, their attack surface expands combinatorially. Static test suites and manual prompt probing fail to catch subtle multi-turn jailbreaks, prompt injections, and indirect data poisoning vulnerabilities befo

    1 min
  • Model Merging in Weight Space: Mathematical Foundations of Task Vectors, TIES-Merging, DARE, and Spherical Linear Interpolation

    Training large language models across multiple downstream domains typically requires expensive multi-task supervised fine-tuning (SFT) or sequential continual learning. Both paths present steep practical challenges: multi-task training demands simultaneous access to massive, curated datasets and massive compute budgets, while sequential fine-tuning suffers from catastrophic forgetting. Model merging has emerged as a data-free, compute-efficient alternative. By combining the parameters of multip

    1 min
  • Salesforce and Anthropic Launch Claudeforce to Embed 37 CRM Actions Inside Claude

    Salesforce and Anthropic have expanded their enterprise collaboration with the release of Claudeforce, an integration that embeds Salesforce customer relationship management tools and data execution directly inside Anthropic's Claude interface. The integration launches with a dedicated plugin, "Salesforce in Claude," containing 37 pre-built sales skills. Rather than acting strictly as a conversational assistant for generating text, the tool connects Claude's reasoning capabilities directly to S

    1 min