Where can I find the construction costs for buildings, forts, castles, dungeons etc.?
At the moment, it's not really out yet. I believe Ultimate Campaign will have that, which comes out next month. In the meantime, I'd suggest using 3rd Edition's Stronghold Builder's Guide.