STAR: Screen Time and Actor Recognition in Video Content
2024 The German Conference on Pattern Recognition (GCPR)
Accurately measuring the duration of actors' presence in videos is a challenging task that goes beyond actor recognition. We propose the STAR pipeline, the new model designed to analyze the time performers appear on screen across diverse video content, including movies and TV shows. The proposed model has been successfully deployed and tested by the Czech TV infrastructure provider. Our pipeline uses machine learning techniques for shot detection, face detection, tracking, recognition, and introduces a novel shot-based method for calculating screen time. We present extensive experiments proving the robustness and real-time performance of our approach. Alongside the pipeline, we introduce the STAR dataset to address the need for high-quality benchmarks in evaluating screen time models, now available for download.