When we fast-forward an animated image, we have a frame we want to display. That frame may depend on other frames which have not yet been decoded.

When we decode those in-between frames without displaying them, those frames are not kept around for the next iteration of the animation's loop. This means the next iteration requires re-decoding those skipped frames.