Automated Discovery of Network Cameras in Heterogeneous Web Pages

Published in ACM Transactions on Internet Technology, 22(1), Article 15, 2021

Network cameras provide real-time visual data useful for traffic analysis, emergency response, and security, but collecting it is difficult because every organization publishes through a differently structured website and interface. Prior approaches parse each target site by hand.

This work analyzes heterogeneous web page structures, identifies characteristics common across 73 sample network camera websites, and uses them to build an automated discovery module that crawls and aggregates camera data at scale — extracting 57,364 network cameras from 237,257 unique web pages.

Authors: Ryan Dailey, Aniesh Chawla, Andrew Liu, Sripath Mishra, Ling Zhang, Josh Majors, Yung-Hsiang Lu, George K. Thiruvathukal
Venue: ACM Transactions on Internet Technology, Volume 22, Issue 1

Links

Recommended citation: Ryan Dailey, Aniesh Chawla, Andrew Liu, Sripath Mishra, Ling Zhang, Josh Majors, Yung-Hsiang Lu, George K. Thiruvathukal. "Automated Discovery of Network Cameras in Heterogeneous Web Pages." ACM Transactions on Internet Technology, 22(1), Article 15, 2021, pp. 1–25.
Download Paper