Skip HEVC frame from displaying by adjustin DTS or duration in bitstream or container

[zn]

Is it possible to make hevc ts bitstream modification (or remux to mkv or other container to adjust DTS)
to make it possible to skip/drop specific frame(s) during playback (frame decoded, but not visible)
Video is 50fps, previous or next frame can be displayed to be in sync with audio

Does any containers have specific field to skip displaying decoded frame? Which options do I have?
To set 0 duration time for this frame on container level
To set 0 duration time for this frame on stream level
To set DTS equal to next frame DTS on container level
To set DTS equal to next frame DTS on stream level
To set DTS equal to start or end of video time on container level
To set DTS equal to start or end of video time on stream level

[benwaggoner]

This could be done in VP9 with Golden Frames or AV1 with alt-ref frames, but I'm not aware of any broadly compatible mechanism to do it with HEVC. You're on the right track with having the duration of the frame be really short, but I bet some players would still sometimes display it for a frame.

Forcing the frame to be a non-reference b-frame would probably help, since it wouldn't need to be decoded in the first place. Would that be viable for your purposes.

I'm guessing that stream level is more likely to work than container level. I'd try the 0 duration or DTS=next frame at the stream level first, and see what different players do with it.

What's the goal/scenario here? There might be other routes to doing the same thing. Like encoding stereoscopic video where the hidden frames only exist in the non-reference eye or something.