It's worth mentioning, there are TWO traits which will directly impact your overall survivability. Your 1st rank Armor Talent and your 1st Rank Weapon Talent of choice.
I went probably 15 levels only spending two points on 1-handed, and on light armor. The game was getting fairly brutal. So I went and spent another point on each skill....and my survivability jumped about 50%.
Also, read this.
http://forums.bethsoft.com/index.php?/topic/1266212-2469-armor-3199-damage-using-smithing-alchemy-enchanting-only-31-perks/It gives a break down of the passive bonuses you get from crafting and enchanting, somewhat. Basically, with 100 enchanting and blacksmithing, your basic armor value is something like 200%? stronger. With absolutely zero perks.
I think a lot of people fail to realize what contributes to the game getting more difficult and what enhances their survivability. I purposefully avoided the traits that made me do more damage or take less damage.....but there's a tipping point. Consider that max armor and damage values are around 2000+......your dinky 200 armor at level 30 isn't doing much to help you, and a guy with worse gear but better perk distribution will actually have 2 to 3x your armor value. Which is why you see people with 300 armor in Ebony getting their ass handed to them, while light armor fighters aren't suffering at all.
But just to re-iterate: perks have a huge impact on the final value of most of your shiz. Investing in all the "neat" stuff over the boring passive stuff is why people are getting reamed.