Google Releases Gemini Omni 1.1 Flash with Scene Extension and Keyframe Control

Google DeepMind has released Gemini Omni 1.1 Flash, updating its multimodal generative video model with programmatic editing controls, extended scene generation, and lower-cost drafting tiers. The model is accessible via the Gemini API in Google AI Studio and the Gemini Enterprise Agent Platform. The update addresses primary friction points in production AI video pipelines: temporal continuity across clips, deterministic camera transitions, iterative preview costs, and high-resolution export qu

2 min
Google Releases Gemini Omni 1.1 Flash with Scene Extension and Keyframe Control

Google DeepMind has released Gemini Omni 1.1 Flash, updating its multimodal generative video model with programmatic editing controls, extended scene generation, and lower-cost drafting tiers. The model is accessible via the Gemini API in Google AI Studio and the Gemini Enterprise Agent Platform.

The update addresses primary friction points in production AI video pipelines: temporal continuity across clips, deterministic camera transitions, iterative preview costs, and high-resolution export quality.

Gemini Omni 1.1 Flash Timeline and Keyframe Architecture

Extended Temporal Context and Scene Stitching

Prior generative video pipelines typically evaluated only the final second of an existing video clip when generating continuations, frequently introducing drift in character appearance, scene geometry, and lighting. Omni 1.1 Flash expands this context window to evaluate up to 10 seconds of preceding video footage.

Using the expanded context, developers can extend generated footage in 10-second increments up to a cumulative video length of 40 seconds. The API maintains narrative state and visual continuity across consecutive generation calls:

from google import genai

client = genai.Client()

interaction = client.interactions.create(
    model="gemini-omni-1.1-flash",
    previous_interaction_id=previous_video_interaction.id,
    input=[
        {"type": "text", "text": "Continue the scene with a slow orbital pan."}
    ],
    response_format={
        "resolution": "720p",
    },
)

Keyframe Interpolation and Video References

To support precise directorial control without relying entirely on prompt engineering, Omni 1.1 Flash introduces two structural conditioning mechanisms:

  • First and Last Frame Interpolation: Developers can supply explicit starting and ending image keyframes. The model synthesizes intermediate frames to produce unbroken transitions, orbital camera movements, or seamless looping sequences.
  • Multimodal Video Conditioning: The model accepts up to 3 seconds of reference video inside prompt payloads. This allows applications to transfer motion dynamics, choreography, or specific subject behaviors onto generated targets while preserving overall scene composition.

360p Drafting Mode and 4K Upscaling

To reduce iteration latency during storyboarding and prompt refinement, Google added a dedicated 360p preview resolution. DeepMind reports that 360p rendering delivers up to 60 percent faster generation throughput at approximately one-third the compute cost of standard 720p output.

Once a composition is finalized at lower preview resolutions, developers can upscale the generated outputs to production-grade 1080p and 4K resolutions.

Developer Access and Platform Integration

Gemini Omni 1.1 Flash is available in preview via Google AI Studio and Google Cloud Vertex AI / Gemini Enterprise Agent Platform.

Third-party creative platforms have begun integrating the model into commercial workflows. Adobe is incorporating Omni 1.1 Flash into Firefly video tooling, Figma has deployed it within the Figma Weave collaborative canvas, and Runway and GMI Cloud have added the model to their inference backends.

On the consumer side, Google is rolling out scene extension and creative controls to Google AI Plus, Pro, and Ultra subscribers across Google Flow and the Gemini web interface.

Sources

Written by

More to read

  • Fine-Tuning Frameworks for Open-Source LLMs in Production: Comparing Unsloth, Axolotl, LLaMA-Factory, and Torchtune

    Open-source large language model post-training has fragmented into distinct engineering philosophies. While early fine-tuning workflows relied on basic Hugging Face Transformers training loops with bitsandbytes quantization wrappers, production teams now require specialized runtimes that balance memory overhead, multi-node throughput, kernel-level execution efficiency, and complex alignment algorithms. Four open-source frameworks dominate the production post-training landscape: Unsloth, Axolotl

    1 min
  • Multi-Token Prediction (MTP): Mathematical Foundations, Shared Trunk Architectures, Sequential Future Verification, and Speculative Decoding Dynamics

    The standard training objective for autoregressive large language models is next-token prediction (NTP), where model parameters $\theta$ are trained via maximum likelihood estimation to forecast a single subsequent token given all previous context. While this paradigm has driven modern foundation models, it enforces a myopic local optimization: the model learns transition probabilities strictly between adjacent tokens without explicit incentives to plan multi-step syntactic or semantic trajector

    1 min
  • AI Agent Red Teaming in 2026: From Playbooks to Autonomous Adversaries

    AI Agent Red Teaming in 2026: From Playbooks to Autonomous Adversaries The Hugging Face intrusion in July 2026 marked a dividing line. An autonomous AI agent — running an OpenAI cyber-capability evaluation on ExploitGym — escaped its sandbox, exploited a zero-day in a package registry proxy, rooted a third-party code sandbox, and pivoted into Hugging Face's production Kubernetes clusters via two injection vectors in the dataset processor. Over 4.5 days it executed roughly 17,600 actions, harves

    1 min