For copyrighted material, it's wrong. Is people walking into your house and removing some of your wage money wrong? That's exactly what music sharing is. Taking something you didn't pay for.
Then again, if it's not copyrighted, then it belongs to everyone, so how can it be wrong?