Couldn't agree more. I HATE when music starts playing while I visit another photographers website. I don't want to hear music, I want to see photos.
Putting music in your website is also taking a big risk in regards to customers. Some people won't like your "indie-rock-new-age-crap-garage-band" song that accompanies the photo of a newborn...which totally makes no sense....thus turning the potential "customer" off to your photography before they even get past the first photo.
On the flip side, I have been to sights of concert photographers that are done well, with music FROM the band that they're displaying and it changes with each photo to match the photo...that's a cool idea, but its' also a VERY niche market. So...choose wisely.