Extra Credits did an episode on this with some good suggestions.
https://www.youtube.com/watch?v=ZfUfUc9fANc&list=UUCODtTcd5M1JavPCOr_Uydg(They get to Steam about halfway through the episode.)
I think Steam is working on some of these things (has even implemented one or two of those suggestions), and at least they're trying to fix the problems, but yeah, there's still a long way to go. I agree 100% that they need to lay off pushing the AAA titles, although it's easy to see why they do (big profit margin on those). They're releasing more indie games than ever before, yet we never hear about most of them. They keywords/tags are a good idea, but they need to be regulated. Assuming everything will balance out when the mob gets to work on it is just naive.
I'm not a player of very many AAA titles. I play mostly indie games. Yet with all the new functionality on their updated store, none of it is geared towards finding the indie games I want. It's all "look at the hottest new releases!" "look at our biggest sellers!" "look at the games we'd make the most money on!" This is the same as it's always been. Now it's just highlighted even more shamelessly.
I think my favorite suggestion from the EC video is that we should be able to search keywords by how frequently they're used in reviews. The reviews are really the most useful source of information about the games, and for games without a metascore, it's the most important factor I consider when I'm going to buy a game. But right now, the only way to look at reviews is to actually read through them one at a time, in the order Steam gives them to you. Having a little keyword cloud for each game with most common words from reviews would be spectacular. I could find games based on real keywords used to describe the game by people who take the time to review it, rather than the tags people put on the games which are just a mess.
Also, why is Steam blue now?