Meet Cloudflare Clef-omni: A 30B-A3B Multimodal Decision Model for Audio, Video, Image and Text


Cloudflare has released Clef-omni, a new open-weight member of its Clef decision model family. Clef-omni is a Cloudflare decision model that scores text, images, audio and video in 1 call. It arrived on October 9, 2026, 8 days after the original Clef and Clef-flash launch. The same update cut Clef-flash pricing below TypeSafe’s Jev and made hosted Clef roughly 2x faster. For developers, this removes the transcription and captioning steps that multimodal agent pipelines usually need.

TL;DR

  • Size: 30B total, 3B active parameters (MoE); 64,000-token context on Workers AI
  • Runs on: Workers AI as @cf/cloudflare/clef-omni; self-hosting tested on a single H200, about 64 GB GPU memory in bfloat16
  • Performance: Close to Clef on routing and intent tasks, behind it on most reasoning and workflow evals
  • Best: 97.7 macro-F1 on CLINC150+OOS, top of the 4 Clef and Jev models
  • Worst: 2.6 accuracy on POP909-CL, and 47.4 on GPQA Diamond versus Jev’s 78.3
  • Bottom line:
    • Best: one call decides across 4 modalities.
    • Worst: weaker accuracy than text-focused Clef on hard reasoning.

What is a decision model?

A decision model returns typed answers with probabilities instead of generated text. You send a state and a schema of questions. The model returns a probability for every allowed option. Clef supports 3 question types: noul (true or false), choice and score. The format follows the Jev and SystemOne API from TypeSafe AI.

How does Clef-omni work?

Clef-omni is post-trained from Qwen3-Omni-30B-A3B-Instruct. Cloudflare keeps the comprehension backbone and drops the text-to-speech output path. The model runs a single prefill pass over the full payload. Video frames and audio are synced into 1 sequence for joint processing.

A small joint schema head then scores the options. Each valid option first gathers evidence from the input. Field vectors then cross-attend across the full context to compute confidence scores. Cloudflare froze the Qwen3 backbone and trained LoRA adapters. Training combined label-smoothed cross-entropy with Brier score calibration.

Supported inputs on Workers AI, per the developer docs:

  • Images: up to 4, PNG, JPEG or WebP, 64 to 1,024 tokens each
  • Audio: up to 4 clips, WAV or MP3, 300 seconds each, about 780 tokens per minute
  • Video: up to 2 clips, MP4 or WebM, 60 seconds each, sampled at 2 frames per second
  • Questions: 1 to 64 per request

Cloudflare reports text decisions in about 130 ms at the median and images in about 150 ms. A 21-second video with sound scores in about 1.5 seconds.

How does Clef-omni perform on benchmarks?

Cloudflare compared Clef-omni against Clef, Clef-flash and Jev on its Decision Index run. Clef-omni leads on intent classification: 94.8 macro-F1 on BANKING77 and 97.7 on CLINC150+OOS. It also tops Amazon ESCI at 57.8.

It trails elsewhere. Home appliances case-exact accuracy is 69.3, versus 97.73 for Clef-flash. When2Call accuracy is 63.3, versus 80.97 for Jev. On TypeSafe’s workflow evals, Clef-omni scores below Clef in all 5 reported metrics.



Source link

  • Related Posts

    What is Decision 3.0? vLLM Semantic Router’s New Open Decision Models

    The vLLM Semantic Router team has released Decision 3.0, a family of multimodal decision models. Decision 3.0 multimodal decision models read text, JSON and images, then answer typed questions about…

    OrcaRouter Releases OrcaCyber Zero 1.5 Cybersecurity Model With 1M Context

    OrcaRouter has released OrcaCyber Zero 1.5, a model for authorized vulnerability research. The model is the successor to OrcaCyber Zero 1.0, which shipped on September…

    Leave a Reply

    Your email address will not be published. Required fields are marked *