Well, if you charge, run, or withdraw, you ignore it's drawback, otherwise it still applies. Permanency and feather step will create a more permanent solution. If you have 5 or more levels in Oracle with the Heavens Mystery, the Lure of the Heavens revelation will do it as well.
