It's very normal with high gain particularly if you have other equipment running eg computers, lights, and it's worse with single coils than humbuckers. What guitar and pups do you have?
Lots of things can contribute to noise e.g. earthing, shielding or lack of it in your guitar, your guitar leads, lights on dimmer switches, other devices plugged in on the same ring mains etc.