Video Image Detection and #surveillancecapitalism

Security Technical 1 Minute

Open source tools and computational power have progressed, but there’s a world wide race out there to weave the latest theories and algorithms with cheap small batch hardware. May the most accurate win. Advances in video processing and purpose-built computing centers mean that you don’t need to run super computers to do this. You need simply provide your stream to an ingestion point in the cloud.

Okutama-Action with action detection annotation. Ground truth bounding boxes are displayed, along with the actions performed. Colours represent IDs. Standing hand shaking with red-class object? That’s a no-no according to the ministry of health. You are docked 13 civic credits!

The Competition, Public vs. Private Software

Annually, the Multi Object Tracking Benchmark releases the ranks of multiple object tracking software upon a set of standardized videos. These samples are run against various platforms, algorithms, and software to express how effective they were at reporting the “Ground Truth”

A common collection of “training” datasets that software evaluates against to compete for fastest accuracy

Typically, the unified evaluation framework provided meaningful results of the effectiveness of software which boiled to the following metrics:

  • Accuracy and Rank
  • Number of Mostly Tracked/Lost objects
  • False positives/negatives
  • Tracker speed in frames per second

https://motchallenge.net/data/2D_MOT_2015/#download

Open Source Projects Abound

Certainly there’s a tonne of open source project for computer vision. See Github for snippets and full on executables ready to take a stream.

Here’s an open source Python-based single object tracker.   In this one, the camera moves. https://github.com/STVIR/pysot

SORT is a barebones implementation of a visual multiple object tracking framework https://github.com/abewley/sort#using-sort-in-your-own-project

Crowd analysis? https://github.com/tsenst/CrowdFlow

How about computational cell tracking using BayesianTracker

Published by Patrick Best, RiPPUL

A background of 20 years in technology, wireless telecommunications, and operational excellence. More if you count my BBS days. Specialties: 24x7 Global Environments, Business & Technology Strategy, Information Security & Technology Governance, Big Data and Virtualisation Assurance Focuses: Risk Management, Business Continuity Management, Disaster Recovery Planning, Technical Architecture, Process Improvement, Independent Coaching/Mentoring of Technical Talent

Published