Mildly AI
Mildly AI
Computer Vision · Real-Time Analytics · AI Product Engineering

StreetSense: Turning Traffic Cameras into Actionable Intelligence

From idea to integrated traffic-monitoring system in three weeks.

Product
StreetSense
Client
Major AI & technology group
Published
October 2026
Scope of work
Computer vision · AI integration · Real-time systems · Python · Full-stack engineering · Product design
  • ~3 weeks
    Core build, from idea to integrated system
  • End-to-end
    AI system, from camera feed to operator decision
  • No new hardware
    Designed to use existing camera feeds
Product demo

Engineering demonstration using public video feeds. Not independently benchmarked.

Engagement: AI technology demonstration · Delivery: Integrated computer-vision system built in ~3 weeks

The problem

Traffic management relies heavily on cameras, but video alone doesn’t tell operators where attention is needed. Could existing cameras become intelligent monitoring systems, without new roadside hardware?

See StreetSense in action

StreetSense tracking view: vehicles detected and tracked with IDs, per-vehicle speed estimates and zone-level congestion overlays on a live highway camera feed
Vehicle tracking, speed estimates and zone-level traffic metrics on a live feed.

The workflow at a glance

StreetSense raising an automatic collision alert with a confidence score, while the incident appears as pending review
1. Alert: an incident is flagged automatically and queued for review.
StreetSense incident details panel showing the captured frame, detection type, confidence, workflow status and an AI-written description of the incident
2. Interpretation: a vision-language model describes the captured frame for the operator.
Operator confirming an incident response with frame evidence, incident type, notes and dispatch options
3. Decision: the operator confirms, adds notes and chooses the response.
StreetSense operator dashboard: a confirmed collision alert with confidence, workflow status, captured frame evidence and actions to confirm, mark as false positive or request a secondary check
4. Confirmed: the operator’s decision is recorded in the incident queue, with frame evidence alongside.

Identifying overlays and text blurred throughout.

What we built

01
Traffic camera feed
Existing cameras, no new roadside hardware
02
Computer vision
Specialised YOLO detection, re-identification & tracking, homography speed
03
Traffic analytics
Congestion, throughput, thresholds
04
AI-assisted incident review
Vision analysis when needed; rule-based metric alerts
05
Operator dashboard
Review evidence, confirm, update status

Road detection defines where to look. A specialised YOLO model, chosen over the standard one for lower latency and for tracking distant vehicles, detects cars, and a re-identification algorithm matches the same car across frames to track its trajectory. Homography maps image coordinates to real-world road coordinates, so trajectories become speed estimates. Together these feed congestion, throughput and abnormal-flow metrics, with rule-based alerts when thresholds are crossed. When a potential incident needs investigating, vision-language models interpret selected frames. Operators stay in control: AI acts as an analyst, not an autonomous decision-maker.

Three weeks, idea to integrated system

Week 1
Camera selection & video ingestion
Week 2
Vehicle detection, tracking & real-time streaming
Week 3
Congestion analytics, AI frame interpretation, persistent alerts & operator workflows

Beyond the model

StreetSense integrates existing models into a working system rather than training a new one. The engineering was in everything around them: video ingestion, resilient stream processing, low-latency updates, tracking, analytics, evidence storage and the interactive UI. The hard parts were practical ones: video/frame synchronisation, unstable streams, noisy congestion estimates and coordinating several real-time services.

Demonstrated to industry

StreetSense was presented to a major AI and technology group, receiving positive feedback on its technical execution and potential applications in intelligent traffic management. While not commercially deployed, the demonstration showed how existing camera feeds could support a more intelligent, operator-focused traffic monitoring system.

What it demonstrated

Computer vision, real-time data, AI-assisted analysis and human decision-making in one end-to-end system, and how a small AI-enabled team turns an ambiguous opportunity into working software quickly.

Capabilities: Computer vision · AI integration · Real-time systems · Python · Full-stack engineering · Product design

Get in Touch

Have one product or workflow where AI should make a difference?

Let's discuss the business problem, what's been tried, and whether there's a practical next step.

Not sure if AI is the right answer? That's a perfectly good starting point.