If you are talking about shelter...
Phase -1: FOOD. No shelter before food, please. I'll continue to oppose any work done on housing until we have 2 days of food at night. I insist, urge, mandate, any-action, anyway.
Phase 0: Finish up the dirt wall. A proper cover can make us fight much, much more effectively.
Meanwhile, if needed, another makeshift shelter, in SE of the fire. It seems we do not need much time to set it up.
Phase 1: Mud huts. They will be in the SW direction of the fire, and would become our future workshops. 3 or 4, each houses 2, will suffice. Our supply of branches and mud should be adequate.
Phase 1.5: We can pull down the original shelter for Phase 2.
Phase 2: Extend the watch tower into a wooden barracks/armory. It will become our sleeping area in the meantime, until phase 3 is completed. We have more than enough wood for that.
Phase 2.5: Churn out more bricks. We may pull down the second shelter if we need space.
Phase 2.75: Finish off the dirt wall with bricks on the outer side, for a vertical surface. This would need somewhere like 500+ bricks for a rough estimate.
Phase 3: Brick houses for everyone. Each would require somewhere like 100 bricks, sans roof. Of course, we can just continue with mud huts.
p.s. Maybe its from where I live IRL. A house? that is already a real, real luxury, unless you are blessed with good ancenstry that entitles you a parcel of land to build your personal 3-storey house (700sqft per floor), and most of them sell this right for half a million anyway. Most of us have only 100-200 sqft per person, in multistorey apartments. So you can see housing be on very, very low on my list.