One simple but relatively effective approach is exponential rolling averages, which is kind of a blend of the two approaches. Rather than throwing out the old data completely, you multiply the old speed by some smoothing factor, then add the new delta multiplied by the complement of that smoothing factor. This has the effect of giving greater weight to more recent measurements, but some weight to older measurements, meaning it won't jump around as wildly.