If it sounds too compressed it is usually caused by too high gain or with too dominant low frequencies
the trick, even in the recording studio, is not to have an amplifier with exaggerated gain, just use a little trick, use an amplifier that is very responsive to palm muting or a combination of pedal + amp and realize a different preset for L channel and R channel.
Basically the stock cabs of the helix has a very dark and undefined sound, you can work around this by using a combination of the 4x12 T75 and a touch of equalizer to reduce the mids and increase the treble a little.
My favourite metal amp was Badonk and ENGL, with a touch on the bias you can correct many part of the sound.
If you share you preset and describe what guitar you use I can give you more precise suggestions