This is actually the first I've heard of having a 0 bytes album. I don't use WMP11, however I know how to completely kill the WMP10 library.
Warning this will cause you to have to completely rebuild the library in WMP, it however will NOT touch any of your music files (this is of course a CCleaner winapp2.ini add-on):
CODE
[Windows Media Player (Flush Library)]
; This doesn't delete your music or videos, it only
; removes the list in the WMP Library so that it can
; quickly, and instantly be cleaned for later
; rebuilding.
;
; Warning: Only enable this cleaner when it's needed,
; then immediately disable it to avoid having to
; constantly rebuild the WMP Library which can take many
; minutes or longer with large music and video collections.
LangSecRef=3023
Detect=HKCU\Software\Microsoft\MediaPlayer\Player
Default=False
FileKey1=%userprofile%\Local Settings\Application Data\Microsoft\Media Player|*.wmdb
Edit: The above cleaner works with WMP10, I have no idea if it works in WMP11 though.