| Chemlak |
Pathfinder Adventure Path, Lost Omens, Rulebook, Starfinder Roleplaying Game Subscriber
Quote:
The cavalier takes a –2 penalty to his Armor Class, except against attacks made by the target of his challenge.
If the attack is not from the target of the challenge, the cavalier takes the penalty. So unless he's challenging the trap, caltrops, or natural hazard, he takes the penalty against them.