If you take the rules exactly as they are written, it says that you can move up to your speed towards any square in the path. So you can stop in an adjacent square and then perform an AoO while the opponent just charges by.
Edit: Note that the opponent only has to stop when you end your movement in the path of the charge, meaning AoOs also work with non-reach weapons.