Video Quality Indicators

Here you can download the indicators. You can download them for free, use it for research, but please refer to its original source (corresponding paper + link to this site).

The project is available as one executable file that performs all the calculations on the .yuv input file or as separated indicators implemented in MATLAB.

Single executable:

Original Image

Bash/Batch script:

Apart from the single executable file that calculates indicators using the RAW videos, you can download here a BASH/BATCH script that utilizes the ffmpeg tools in order to process whole folders of videos saved with normal extensions like: .avi, .mkv, etc.

The only prerequisite is to have the ffmpeg tools installed.

Python script:

If you need to process the large amount of YUV videos and create the large spread sheet comprising all the results you can download here the python script written by Fredrik Pihl.

In order to use it you need to install the “xlsxwriter” Python module and rename all the video files according to the following convention: NAME_WIDTHxHEIGHT_FPS_….yuv. The last prerequisite is to have the “mitsuLinuxMultithread” binary in the same directory as this script.

MATLAB scripts: (DEPRECATED)

What is more, we are providing you with each separate indicator implemented as the MATLAB script.

Although it is present here, we do not recommend to use this version of the indicators.

List of implemented indicators:

  1. Commercial Black
  2. Blockiness
  3. Block Loss
  4. Blur
  5. Contrast
  6. Exposure
  7. Flickering
  8. Freezing
  9. Interlacing
  10. Letter-boxing
  11. Noise
  12. Pillar-boxing
  13. Slicing
  14. Spatial Activity
  15. Temporal Activity
WskaźnikiRange of results (min/max)Monotonicity relative to distortionThe value for image without distortionComment
Commercial Blackmin. = 0 (blackout did not occur)
max. = 1 (blackout occurred)
Greater value → greater distortion (in this case distortion occurs)0Indicator treats every unitary frame as blackout (regardless of color).
Blockinessmin. = 0
max. = 3570 (values goes to infinity therefore the results were limited)
Greater value → less visible distortionFrom 0.9 to 1.01
Block Lossmin. = 0
max. ≈ 100 – 200
Greater value → more visible distortionFrom 0 to 5Indicator returns -1 if the image has a width or height less than 256 pixels.
Blurmin. = 0
max. ≈ 70
Greater value → more visible distortionFrom 0 to 5
Contrastmin. = 0
max. ≈ 120
Greater value → higher contrastFrom 45 to 55
Exposuremin. = 0
max. = 255
Greater value → greater exposure timeFrom 115 to 125
Flickeringmin. = 0
max. = 8
Greater value → more visible distortionFor time window with a length of 8 frames typical value is around 0.125Indicator operates on observation window = number of consecutive frames taken into account when calculating flicker blocks indicator. Result is returned only at the end of the observation window, during the window, the indicator returns -1.
Freezingmin. = 0
max. = 1
Greater value → greater distortion (in this case distortion occurs)0Indicator is coupled with the results of Temporal Activity indicator.
Interlacingmin. = 0
max. = 1
Greater value → greater distortion0
Letter-boxingmin. = 0
max. = 1
Greater value → greater distortion0Value 1 means that the entire frame is smooth (blackout).
Noisemin. = 0
max. = 30
Greater value → greater distortionFrom 0 to 3.5
Pillar-boxingmin. = 0
max. = 1
Greater value → greater distortion0Value 1 means that the entire frame is smooth (blackout).
Slicingmin. ≈ 0
max. = &infin
≈ 0Indicator does not work correctly.
Spatial Activitymin. = 0
max. ≈ 270
Greater value → greater Spatial ActivityFrom 0 to 60
Temporal Activitymin. = 0
max. = 255 (for fullHD)
Greater value → greater Temporal ActivityFrom 0 to 20Range of results depends on size of the test image.
List of implemented indicators

Video Indicators

Blockiness

Blockiness indicator

Romaniak, Piotr; Janowski, Lucjan; Leszczuk, Mikołaj; Papir, Zdzisław

Perceptual quality assessment for H. 264/AVC compression Inproceedings

In: 2012 IEEE consumer communications and networking conference (CCNC), pp. 597–602, IEEE 2012.

BibTeX

Blur

Blur indicator

Romaniak, Piotr; Janowski, Lucjan; Leszczuk, Mikołaj; Papir, Zdzisław

Perceptual quality assessment for H. 264/AVC compression Inproceedings

In: 2012 IEEE consumer communications and networking conference (CCNC), pp. 597–602, IEEE 2012.

BibTeX

Mu, Mu; Romaniak, Piotr; Mauthe, Andreas; Leszczuk, Mikołaj; Janowski, Lucjan; Cerqueira, Eduardo

Framework for the integrated video quality assessment Journal Article

In: Multimedia Tools and Applications, 61 (3), pp. 787–817, 2012.

BibTeX

Exposure time distortion

Exposure time distortion indicator

Leszczuk, Mikołaj

Assessing task-based video quality—a journey from subjective psycho-physical experiments to objective quality models Inproceedings

In: International Conference on Multimedia Communications, Services and Security, pp. 91–99, Springer, Berlin, Heidelberg 2011.

BibTeX

Interlace

Interlace indicator

Janowski, Lucjan; Papir, Zdzisław

Modeling subjective tests of quality of experience with a generalized linear model Inproceedings

In: 2009 International Workshop on Quality of Multimedia Experience, pp. 35–40, IEEE 2009.

BibTeX

Noise

Noise indicator

Janowski, Lucjan; Papir, Zdzisław

Modeling subjective tests of quality of experience with a generalized linear model Inproceedings

In: 2009 International Workshop on Quality of Multimedia Experience, pp. 35–40, IEEE 2009.

BibTeX

Framing

Framing indicator

Cerqueira, Eduardo; Zeadally, Sherali; Leszczuk, Mikołaj; Curado, Marilia; Mauthe, Andreas

Recent advances in multimedia networking Journal Article

In: Multimedia Tools and Applications, 54 (3), pp. 635–647, 2011.

BibTeX

Spatial activity

Spatial activity indicator

Romaniak, Piotr; Janowski, Lucjan; Leszczuk, Mikołaj; Papir, Zdzisław

Perceptual quality assessment for H. 264/AVC compression Inproceedings

In: 2012 IEEE consumer communications and networking conference (CCNC), pp. 597–602, IEEE 2012.

BibTeX

Temporal activity

Temporal activity

Romaniak, Piotr; Janowski, Lucjan; Leszczuk, Mikołaj; Papir, Zdzisław

Perceptual quality assessment for H. 264/AVC compression Inproceedings

In: 2012 IEEE consumer communications and networking conference (CCNC), pp. 597–602, IEEE 2012.

BibTeX

Flickering

Flickering indicator

Romaniak, Piotr; Janowski, Lucjan; Leszczuk, Mikołaj; Papir, Zdzisław

Perceptual quality assessment for H. 264/AVC compression Inproceedings

In: 2012 IEEE consumer communications and networking conference (CCNC), pp. 597–602, IEEE 2012.

BibTeX

Commercial Black

Commercial Black indicator

Cerqueira, Eduardo; Zeadally, Sherali; Leszczuk, Mikołaj; Curado, Marilia; Mauthe, Andreas

Recent advances in multimedia networking Journal Article

In: Multimedia Tools and Applications, 54 (3), pp. 635–647, 2011.

BibTeX

Pillar-boxing

Pillar-boxing indicator

Letter-boxing

Letter-boxing indicator

Brightness

Brightness indicator

Leszczuk, Mikołaj; Hanusiak, Mateusz; Farias, Mylene CQ; Wyckens, Emmanuel; Heston, George

Recent developments in visual quality monitoring by key performance indicators Journal Article

In: Multimedia Tools and Applications, 75 (17), pp. 10745–10767, 2016.

BibTeX

Contrast

Contrast indicator

Slicing

Slicing indicator

Leszczuk, Mikołaj; Hanusiak, Mateusz; Farias, Mylene CQ; Wyckens, Emmanuel; Heston, George

Recent developments in visual quality monitoring by key performance indicators Journal Article

In: Multimedia Tools and Applications, 75 (17), pp. 10745–10767, 2016.

BibTeX

Block loss

Block loss indicator

Leszczuk, Mikołaj; Hanusiak, Mateusz; Farias, Mylene CQ; Wyckens, Emmanuel; Heston, George

Recent developments in visual quality monitoring by key performance indicators Journal Article

In: Multimedia Tools and Applications, 75 (17), pp. 10745–10767, 2016.

BibTeX

Audio indicators

Mute

Mute indicator

Leszczuk, Mikołaj; Hanusiak, Mateusz; Farias, Mylene CQ; Wyckens, Emmanuel; Heston, George

Recent developments in visual quality monitoring by key performance indicators Journal Article

In: Multimedia Tools and Applications, 75 (17), pp. 10745–10767, 2016.

BibTeX

Clipping

Clipping indicator

Leszczuk, Mikołaj; Hanusiak, Mateusz; Farias, Mylene CQ; Wyckens, Emmanuel; Heston, George

Recent developments in visual quality monitoring by key performance indicators Journal Article

In: Multimedia Tools and Applications, 75 (17), pp. 10745–10767, 2016.

BibTeX