Sorry, had not had this bubbled up to me. I can confirm that this is how it is intended to work. Craggy highlands are mountains -- in other words, they are "soft barriers." Unlike water or similar, they don't just stop you outright. And unlike the enemy towers, they don't require you to get NPC involvement. Like real mountains, they just take a while to traverse.