Honestly, buildings requiring their resource to build fall into a peculiar trap. In one settlement, I tried to build enough houses and farmed to feed and house everyone, and then ran straight out of wood. But it costs something like 200 wood to build a woodcutter's building..
What about changing it around a tad? It would require none of the resource it requires to build to build a level 1 building (so a level 1 woodcutter's shop could be fairly cheap, basically only requiring labor), but its also fairly ineffective.. then upgrading it, which costs wood, would yield what you have now.
The important part is that you are able to gather the resource without having the resource - If you never can build a granite thing because you spent all your granite, there should be a way to recover from that in a purely city-building sense, not requiring adventuring to other settlements.