Aside from possibly causing your particular goddess to become quite UNHAPPY with you for disregarding the "sign of her favor" by killing it (or "letting it die") and using its body for purely mechanical benefits... I got nothing to add.
I have to admit, that's a tough thing to sell to Calistria. I could start with my character not deliberately "letting it die",. But a Protector is a Protector and its lifespan is quite short due to the things a protector does. Need to find a way to explain why I don't bring the wasp back to life though. I mean, it does come to life quite a lot during the day, and in different forms as well. Might argue that I add to the power of the wasp familiar by adding more versatility. All for the sake of revenge of course.
It talks about 'any of the choices available to a wizard' rather than 'any of the choices which you personally might be able to make, Sir Calistrian occultist necromancer'. You might have a familiar and a soulbound puppet separately (I'm not sure that even wasp familiar bans a soulbound puppet); there's no indication that feats affecting the first affect the second also.
Interesting thought. How would that interact with the wasp stats though? If a soulbound puppet does not count as a familiar for the wasp familiar feat restrictions, it cannot count as a familiar for the stat improvement to Imp. Might need to take the feat twice then.