I know what you mean. I spent my last 2 weekends sorting, filing, and organizing my photos. I made back ups on external hard drives, thumb drives, and discs. So now I have numerous exteral drives, thumb drives, and discs that I have to keep track of! Many of my pictures are irreplaceable so I have made several copies of each.
It is just... so much work! I have to really sit down and get it done though. I have lost pictures before and that is much worse than the time taken sorting them :)
And once you lose them, you can never get them back. I think that this is the reason I am so anal and back them up in so many devices!!