Skip to Content

Research Project KIGVI

Project name: KIGVI - Automatic AI-supported composition of video news clips
Department:Engineering - Media Technology
Project head:Prof. Dr.-Ing. Matthias Narroschke

Project staff:

 

Project partner:Qvest GmbH, Köln
Duration: May 1, 2021 - October 31, 2026
Funding institution or client: Funded BMFTR project (FH-Kooperativ funding code 13FH544KX9)

The aim of the project is to develop an innovative solution for AI-based reportage creation that extracts suitable sections from video sequences and compiles them into a broadcast-ready report. On social networks and news portals, short video reports are increasingly replacing conventional text reports in order to attract users' attention. For video content providers, the cost-effective and efficient production of short video reports is therefore particularly important. Until now, video reports have been created manually, which is time-consuming and costly.

The project therefore aims to develop a system that can automatically evaluate quality and compose a report suitable for broadcast. The development can be divided into two core topics. On the one hand, an AI model that extracts suitable video segments from existing video sequences and, on the other hand, another model that generates the video report from the extracted segments. To this end, suitable parameters describing relevant quality characteristics are to be automatically estimated for the extracted video segments.

In addition to purely technical characteristics such as image resolution and conformity to video standards, content-related and stylistic characteristics are also to be defined and corresponding parameters estimated. These include, for example, categorizing the segments into “background material,” “recording,” “interview,” or “original sound sequence,” or adhering to the “golden ratio” in the image. Based on the estimated parameters, the corresponding video sections are to be composed into a broadcast-ready report using the second AI model. In particular, genre-dependent pattern sequences for reports, which are usually different, such as for sports news, product presentations, or political reports, are to be taken into account.
 

Publications & Presentations

  • D. Quandt, P. Altmeyer, W. Ruppel, and M. Narroschke,
    "KI-gestützter Videoschnitt für Nachrichtenclips",
    FKTG Journal, 3-2024
  • D. Quandt, 
    "AI-supported video editing framework for news clips",
    9th VDE/ITG Graduate Summer School on Video Compression and Processing (SVCP) 2024, Ruedesheim, Germany
  • D. Quandt, 
    "Automated AI-based video composition of video News Clips",
    EBU Production Technology Seminar 2025, Geneva, Switzerland