Happily, this is not a bug! The buildings with the double perk tokens have two paths off their first room: one that is a dead end and one that is not. If you go back to the left to the next screen over, you'll see the entrance where you came into the building. Right next to that door is a door leading left, and that goes to the perk token.