More numbers that don't require 10,000 people:
The DMG lists a small town as 900-2,000 people. Assuming 1,500, that's 500*1,500*10=7,500,000 cubic feet. Divided up, that's 60,000 cubic feet per cube, which is about 64,000, which has a cubic root of 40. 40*9=360, *2 is 720. Reducing our ambitions to a small town probably cuts construction time in half and material cost by at least 8.
A golem for a single family to live in would probably require about 1,000 square feet, or 10,000 cubic feet in the torso, for cubes of about 80 cubic feet each. That's a cubic root of 4. Four times nine is 36, times two is 72 feet tall. (This house would probably have three or four floors of 8x28 feet each, big enough for two or three rooms each.) This golem would be normal-Colossal and therefore take about 16 times as long, probably a month or two of work. Oh, and just to note...
If we went insane, and had a city-sized golem inhabited by house!golems, it would need to be something like 16 times as tall (somewhere almost 200,000 feet tall, or almost 40 miles tall) and take three decades or so of work to build, not counting the almost-a-millennium it would take to actually make those 10,000 golems. If we had a few hundred apprentices, we could do it. Otherwise? Not without immortality. (And 30,000-50,000 people.)