I don't think anyone can really comment until we find out more about the houserule mentality that's penalizing you skill points for weapon choice. I've never heard anything like it.
Str-Necessary
Dex-Necessary
Con-Good
Int-Meh
Wis-Meh
Cha-Necessary at least up to 16
With 4+Int skill points, you shouldn't need a very high Int. If you want a +1 mod, that's feasible.
Will is a good save for you, and while it's always nice to have the bonus from high Wis, you probably don't need to worry about that much.
If you want TWFing pretty much off the bat, you'll need 15 Dex.
Charisma is going to need to go up to 16 by level 16, but that really shouldn't be difficult to do with even a 14 to start, and even easier if you'll have access to stat boosting items.
Strength would need to be high, but you could easily have enough points left over for this.
Finally, a bit of Con never hurt anyone, not to mention a melee combatant, but Fort is a good save for you too. So, 12 might be nice here, maybe some more.
So:
Str 15
Dex 15
Con 12
Int 12
Wis 10
Cha 14
That takes 23 points, leaving enough to bump Cha up to 15 if you want, giving you 15 Str/Dex/Cha, 12 Con and Int, and 10 Wisdom.
If you wanted to lower Int back down to 10 and leave Cha at 14, you could easily get a 14 in Con as well, giving you 15 Str/Dex, 14 Con/Cha, and 10 Int/Wis.
I'm not sure what race you're playing, but I would assume the most suitable racial bonus would be towards strength.
If you went human and alternates from the ARG are available, you can go Dual Talent, which gives you a +2 on two stats of your choice, but it loses you the extra feat and skills per level. Could make for some good possibilities though.
Even so however, I think you might be able to manage with a starting Strength of 17, followed by a level increase to 18 at 4.
Now, important question regarding this would be: How likely do you think it is to have access to the items you'd want. Will you have trouble getting a Belt of Dex or a Headband of Cha? You won't need the former until level 8 or 9 (when you can pick up Improved Two-weapon fighting) and until level 13, you'll be fine on all of your spellcasting needs, while a +2 Cha would see you through the rest of your spellcasting.
If you think it should be no problem, you can even lower Cha a bit more to free up stat points, and rely on a Headband once you get to the spells you can't cast normally. Somewhat more dangerous, as you'll be out of your higher level spellcasting should you lose it, but it's a possibility.
All in all, I think the build can certainly work. You might be lacking on hit and damage (rather... you probably will be lacking on hit and damage) compared to a Full BAB and 20 Strength character. But I think it could work.
Just some thoughts on how I might go about building it though. I can't claim to necessarily always have awesome characters however, so no guarantees. But hey, food for thought :P
I should also note that my glance over the Vanguard has been cursory and I only picked up the gist of it. I've never heard of them before this, so I'm not magnificently familiar with how they function except in how I can relate to other martial/caster hybrid classes.
Edit: Also. If races are no qualm, Nagaji and Suli might be notable as races that receive a +2 to both Strength and Charisma. They both have a racial penalty to Int, but if you took 2 points out of Charisma for something like 12 or 13 before the racial beefed it up to 14/15, you could easily afford 12 Int to still break even and have more points left over to spend in other areas. Some more to think about.
Of course, the same could be done with Humans with Dual Talent, but they wouldn't receive any other racial abilities. They wouldn't have the Int penalty though either.
I started out with a katana arcane bond because i liked the idea that it was masterwork to begin with and repaired itself each night so it was always sharp...
We had a chance to change our builds between adventure paths and I've switched to more of a nature type wizard recently so now i'm using an arcane bonded bokken. Basically a club with a better crit threat range due to superior balance and design. I'm such a hippie.
Dual katana vanguard does sound like fun though.
When did Charisma, intelligence, and strength become skills?
Who extends their wisdoms? How is it done? Sounds painful.
I suspect this is an issue of translating foreign PFRPG terms back into English.