I've downloaded via torrent just fine hundreds of times. My ISP only got mad once when I left something out seeding for others to download. I assume because in that case I'm the one distributing copies, so that's when copyright law can really bring out the big guns.
If you're only a user but not a dealer they don't seem to care.