I would suggest a different block setup - treat it like a real rig. Your pic shows the reverb and delay after the IR block.
The following is a template I use and then I switch out the preamps and IR's for different tones.
Vol>Wah>OD>NS>Preamp>(FX LOOP: Delay, Reverb, EQ)>IR.
The order of blocks will have an affect on the overall sound.
I'm not familiar with the OwnHammer IR's - I've been using Sigma Audio. They provide 5 mic placements for the IR's and the mic placements do have a huge impact on the tone as well.
You'll also want to put a high and low pass filter on the IR's - I set the lows at 80KHZ and the Highs at 8000Khz.
Don't give up yet - it takes some experimentation!