Video often ends up paused when using skip forward/back on AppleTV

I often use the skip forward/back (hold finger near edge of remote touch area and press) to skip through commercials or back a bit. However, when doing this, the video very often ends up paused, so I have to manually hit the play/pause button to resume video. This makes it tougher to manually skip through a commercial break (since there is no video preview, it's easier to skip a bunch of times than move the play bar carefully a few minutes).

The video I am watching is MPEG2 files downloaded from my Tivo (things I intend to watch faster-than-realtime via VLC).