vaapih264dec: hangs when decoding a defect stream

Submitted by Thomas Scheuermann

Link to original bug (#795770)

Description

If a defective stream is decoded by gstreamer with vaapi, the pipeline hangs and can't be stopped anymore with setting the pipeline state to GST_STATE_NULL. This call will block forever.

A pcap stream to reproduce this can be found here:
https://barcozone-my.sharepoint.com/:u:/g/personal/thomas_scheuermann_barco_com/EQ8TkhCtzEpFoc3RkFzcpBoBZTxhPF1xERHu6XwFhMwBpQ?e=NhTqE0

The pcap file can be played with
sudo tcpreplay-edit -l 0 -i <network interface> --pnat=172.23.0.26:<local address>,172.20.51.163:<remote address> --enet-dmac=<remote mac> gstlock2.pcap

The pipeline can be started the following way:
gst-launch-1.0 udpsrc uri="udp://0.0.0.0:34338" ! application/x-rtp,encoding-name=H264 ! rtph264depay ! h264parse ! vaapih264dec ! vaapisink

The pipeline doesn't hang if avdec_h264 is used.

Regards,
Thomas

Version: 1.14.0