This is well and truly the PC causing the noise. Had the Helix plugged into a different outlet and the same noise. I tried the Helix in my wife's laptop and although there is a very high pitched (but quiet) whine the horrendous noise from my PC is not there.
May have to sneakily use my work laptop which is more powerful than my wife's when doing microphone related work.