It should be fine to fall back to a crop, because an integral (sub)pixel shift would mean all coefficients will be zero, except for one of them which will be 1, making it the same as a crop. But the other frames shouldn't be this blurry. I assume spline16resize similarly reduces to a crop when possible, but it doesn't exhibit this problem.