The feat at the end states "Special If you select this feat at 1st level, you receive your pilgrim's token for free. Alternately, if you have a religious symbol, it is already attuned" does that mean Icould use this as a Divine Focus instead of Emblazoned Armament? Or what does it do?
One of 2 things happen when you take the feat.
1. You have a small item of no particular value that you obtained or carried on your pilgrimage. Maybe it's a rock fragment that crumbled off the side of a holy site, or whatever. You gain the feat benefits while carrying this item.
2. You already own a holy symbol. It can be used as a divine focus like any other holy symbol can (for characters like clerics that can use religious symbols on place of material components). You carried this holy symbol on your pilgrimage and it is also the item you need to have on your person to gain the benefits of this feat.
Sweet, so I don't need it in my hand, it can be in my pocket while I cast a spell like Silence?
No.
If a holy symbol is also your pilgrim's token, it only needs to be on your person to get the benefits of Pilgrim's Token. Nothing changes about how you use that token as a divine focus.