You can take 'flying blade' to use your swashbuckler abilities with agile thrown weapons.
Light hammers are agile.
At 1st level you can turn up with a sack of hammers and throw them at people while insisting that what you're doing is technically swashbuckling.
What's not to love?