5 foot steps can't be taken in difficult terrain, so you can't use Step Up (Misc actions rules for 5 foot steps). The Following Step feat lets you move 10 feet, so it seems like you could use it to move 5 feet in difficult terrain. Though a strict following of the rules would still let you not do so since it is considered a "5 foot step", depends on your GM. Normally when your movement is hampered, by wearing heavy armor, or a heavy load, you can still take 5 foot steps, so they should work fine. Unless your movement is so hampered you can only move 5 feet a round, then you're really screwed.