You could have a city which they can observe - but not interact with.
Possibly a shadowy projection which provides concealment for the barbarians.
If the barbs kept popping up and driving them off; this should intregue them and make them want to find out more.