Heavy armor was not completely useless against the earliest firearms. Spike's Deadliest Warrior show had a few episodes where this came into play, and determined that a late-medieval knight's plate armor would reliable stop a bullet from a flintlock pistol, but not from a blunderbuss. Also, musketeers had breastplates specifically designed for maximum deflection so (hopefully) bullets would ricochet off them.
