Seeking +/- 10s on tvOS misbehaving for second click

On tvOS, one can seek forward/backwards by 10 seconds by clicking on the left/right side of the apple tv remote. When doing this the first time, it works fine. After clicking once, while keeping the finger on the touchpad on the remote, the seekbar still displays the +/- 10s indicator, indicating that another click still would do another +/- 10s skip, but in practice, the second click instead pauses the playback. To avoid the issue, one has to lift the finger from the remote for each seeked step, which is annoying and different from the native playback controls on the apple tv.