Agénor |
The two rules do not stem from the same ideas being modelled.
The idea behind AoO against someone casting is that the spellcaster's defenses are lowered while she is performing the required gestures and changing and having the mental concentration necessary to funnel the magical energies.
Spells cast as Swift Actions have all these gestures and concentration last so little time that there is no opening to be exploited by an opponent.
Being grappled prevents one from performing the gestures and changing and concentrating with the usual relative ease therefore a Concentration check is required.