Invisible via Invisibility, not Improved Invisibility, so at what point during the action does he become visible? Since the flyby states that the standard action (the attack action) takes place at any point during their movement, I would think the creature would turn visible at the moment of attack and then begin provoking with his movement from that point on, including leaving the target's square.
Sound right?
Yes.