If you do the math, it still doesn't work. Just to build a barracks with any real function, you need (presuming resources like pig farms are elsewhere): a butcher, a smithy, and a barracks. That's 1/3 of your tile cap right there. If you need something else specialized like a smelter for steel, or a brewery for ale, then forget about it. And so on. Literally this is what we started with, but it was intensely uncomfortable as a way to play even to me.