Technologies Supporting the Summarization of Video Sequences

The AGH Department of Telecommunications obtained funding for the project “Technologies Supporting the Summarization of Video Sequences” under the Joint Venture of the National Center for Research and Development and the National Science Center to support the practical use of basic research results – TANGO.

The R&D (Research and Development) manager of the project is Mikołaj Leszczuk, DSc, and the other people involved were Michał Grega, PhD, Lucjan Janowski, DSc, and Jakub Nawała, MSc.

The main objective of the proposed project is to raise the technological readiness of the results of the “Access to Multilingual Information and Opinions” (AMIS) baseline project to the Technology Readiness Level (TRL) VII, where it is possible to demonstrate the technology prototype under operational conditions, and conducting pre-implementation conceptual works.

More precisely, the goal of R&D is to create/develop techniques (algorithms and their implementations) supporting the creation of video sequence summarization systems. The technologies created will be based primarily on the so-called Quality Indicators (QI), which analyze audio-video content (video sequences) and assign numerical values ​​(“weights”) to its individual fragments. Such QIs allow to determine to what extent a given fragment (e.g. shot) can be interesting for the user, as well as what is the assessment of its audiovisual quality. The project is expected to deliver summarization technologies that take QI values ​​into account during the process of summarizing (abstracting) the original content. The project assumes both the creation/development of the initial solutions of both individual QIs and the entire tools for creating visual summaries, previously created by the AGH Department of Telecommunications. The result of the AMIS project was a news summary system. The implementation of the project will allow for the creation of a technology of near commercialization adapted to the current requirements of audiovisual content – both as a whole and as individual selected components.

At the same time, the aim of the project is to carry out conceptual work aimed at determining the economic use of research results, conducting market analyzes, acquiring partners interested in research and development cooperation and implementation of the project results and developing a strategy of activities aimed at securing the rights to intellectual property protection of research results.