After hours of pulling my hair our from reinstalling flash etc, I realized CCleaner was causing me grief with steam. I have a brand new gaming PC (3 days old) and was trying to figure out for the life of me why Steam looks like this.
http://dl.dropbox.com/u/5554506/steam.jpg
It then became strange when the images in that scrolling section changed to new ones, and the new images worked flawlessly, but previously broken images remained broken. I then knew it had something to do with a cache and after finding a forum on Steam I narrowed it down to CCleaner. That's what the Steam CCleaner option does to my Steam game.
Windows 7 Home Premium 64 bit, brand new install. Restarting Windows/Steam does not fix the issue. I even attempted a Steam repair but it failed due to an error (likely caused from the damage from CCleaner maybe?)
Edit: Update! I went into steam/config files and deleted 2 folders htmlcache and something else and I opened steam again and the missing images were fixed.