it mentions under weapon finesse that you can use your dex for combat maneuvers like disarm, sunder and trip, because you use your weapon with such checks. most others maneuvers need agile maneuvers to apply dex. but what about dirty tricks? what if my swashbuckler takes a swipe with is rapier(weapon) at his foes eyes to blind them?
Well, a PC could also use a hammer to bull rush a foe, a quarterstaff to reposition them, a sword to drag them etc..
But rewarding player's creativity with mechanical advantages has drawbacks. It favors creative players (who already have an edge at RP) over the others and it can result in creativity feeling like a must (during a tough encounter) - which makes it stop being fun.
So I'd rule 'No, get Agile Maneuvers for all these standard action* maneuvers.'.
* I mean the default action cost, feats etc. can of course reduce it sometimes.