Hmm.. an idea to weigh-in on this.
Obviously the goal here is to find a solution outside of RAW as there is A LEVEL OF AMBIGUITY in the rules.
Yes, there are some distinct rules (such as not threatening creatures adjacent to yourself when using a Pole-Arm).
However, one of the 'aspects' of the lack of facing rules in Pathfinder is the representation, that although you 'occupy' the 5' square in which you are located, you are not COMPLETELY encompassing it (hence that humans are not flesh cubes).
What does combat theoretically mean? You are continually moving, dancing, dodging, ducking, shrugging, swinging within your own space.
Same goes for the Ogre - the Ogre is not a distinct 10x10x10 Block. He is more like 8' tall, 6' in shoulder breadth, and likely a few feet of depth. (maybe more for the torso region). However, knees and elbows bend, Weapons flail about in that area, etc.
Let's assume for a moment that not every adventurer is Chuck Norris:
Human Fighter, armed with <insert pole-arm here> swings at ADJACENT ogre. What is he really doing? He's arching back (within his square), and making wide-arcing swings to clinch this Ogre in the thigh, the shoulder, the hind area of the backside. Or coming down with a massive overhand swing to the face.
THAT BEING SAID, what is the Ogre doing during this fight? He's going to see Mr. Puny Fighter, laugh, and reach down (with hand or club) and intercept that swing before it gathers momentum.
What's my point? You ever try to use a fulcrum? If you don't get enough momentum in a swing or kick before pull-back, it fails. (hence why people can walk DIRECTLY behind a horse and prevent themselves from being kicked, as opposed to two feet where the horse and draw and get all kinds of power behind the shot.)
This being said - coming into the conversation I almost wanted to opt for "no, part of the object is far enough away -- let them swing."
However, at this point - I would have to conclude either:
A) You take a penalty to-hit (either -1 for fighting up-hill) or Soft Cover, or
B) No, with the target so close and the nature of combat - all your swings against this target would be instantly negated as a natural course of the fight.