First of all, keep asking questions! It's what this forum is for!
Secondly, if you click on 'Browse' in iTunes, with your library opened up, (browse should be in the upper right hand corner), then iTunes will open up a window within the library. Just select 'Albums' from the list, and it will show you all the albums you have.
And yes, when you put all your music onto your iPod, it will automatically arrange the songs into the right albums and genres ect...