The spell has to be of the correct type (arcane or divine), on their spell list, and the caster has to have the appropriate ability score (INT 13 in the case of a wizard trying to cast haste).
If all that is true, but the person trying to activate the scroll has a lower caster level than that of the scroll, they must make a caster level check (1d20+caster level) with a DC equal to the scroll's caster level+1 in order to cast the scroll successfully. If they fail, they must make a DC5 Wisdom check in order to avoid a scroll mishap.
(Taken from here.)
So the short answer is, yes, but with more difficulty.