Wowza Video Intelligence Framework Demos & Walkthroughs | Wowza

Wowza Video Intelligence Framework Demos & Walkthroughs

See how to use VIF to detect objects, understand scenes, apply vision-language models, and trigger custom workflows on the video you already stream.

Wowza’s Video Intelligence Framework (VIF) is the intelligence layer inside your video pipeline, and emits detections through five simultaneous output channels that feed into your VMS, dispatch console, control center, and observability stacks. Act on events in seconds using the cameras and systems you already operate.

Five simultaneous output channels

  1. Enriched HLS In-band ID3 timed metadata for ad insertion, telemetry, and chain of custody.
  2. Burned-in overlays Annotations drawn on live video, with bounding boxes and confidence scores.
  3. JSONL logs Structured and formatted logging for tools like Splunk and Elasticsearch.
  4. Webhooks Real-time alerts in dispatch systems, PagerDuty, ServiceNow, and Datadog.
  5. Custom Java Listeners Your business logic inside Wowza Streaming Engine.

Detect Objects with VIF

RF-DETR, trained on 80 classes out of the box

VIF ships with RF-DETR pre-trained on 80 common COCO classes, so you can detect people, vehicles, and everyday objects on a live stream with no training required. When you need classes the default model does not cover, use a guided Google Colab notebook to train and import a custom model.

Understand Scenes with VIF

Match scenes against natural-language descriptions

VIF includes a CLIP-based model that scores live scenes against natural-language descriptions instead of a fixed class list. VIF matches each frame against a plain language description for open-ended situations a fixed 80-class detector cannot express.

Use VLMs with VIF

Add a vision-language reasoning layer on top of detection

Vision-language models add a reasoning layer on top of object detection. VIF routes selected frames to a VLM that returns descriptions of a scene rather than a single fixed label. VLM inference runs much slower than object detection, so the effective pattern uses object detection as the trigger and the VLM as the second-stage analyst you call once something fires.

Trigger Custom Workflows with VIF

Turn detections into actions in the systems you already run

VIF turns detections into actions by emitting every event through five output channels, so results land in the tools teams use today. The same detection can annotate the video, notify an external system, write to a log, and trigger custom code at the same time.

Deploy VIF alongside Wowza Streaming Engine without re-architecting your pipeline

Add detection to the cameras and feeds you already run, while keeping ingest and delivery configurations as is.

~8 720p streams at 10 FPS on one NVIDIA T4 15–20 Concurrent streams on an NVIDIA L4 ~10 ms Per frame for RF-DETR on Turing-class hardware

Walkthroughs

Set it up, then make it yours

On-prem, edge, air-gapped, containerized

How to set up and use Wowza Video Intelligence Framework

Get up and running with Wowza Video Intelligence Framework, connect your live stream, and push data into tools like Datadog.

Custom model flexibility

How to train custom models for Wowza Video Intelligence Framework

Train, integrate, and validate custom AI models in Wowza Video Intelligence Framework through a guided workflow.

See it on your streams

Wowza Streaming Engine captures your feeds. Video Intelligence Framework extracts the data.

VIF sits in the streaming pipeline underneath the applications your teams already run, and delivers detections into your VMS, dispatch, SIEM, and observability platforms through webhooks, in-band ID3 timed metadata, burned-in overlays, JSONL logs, and Java Listeners. Get a closer look today.