For my campaign/AP(s) we are often with 5 people. I went with keeping everyone a level behind where "the book" states they should be (we don't bother with keeping track of XP) and everything works out well.
One addendum: I keep everyone a level behind AFTER the first book in an AP.