I just purchased a 500x this past weekend, and I have owned the 500 since it's release. So the X sounds exactly the same you just can work it more because of the extra processing. I am selling my old 500 to a friend and for him where he does not use a lot of complicated setups as neither does another friend of mine; upgrading is not really going to give them a lot.
But for me I usually have a couple of patches that require a lot of effects, that I now can do with the 500x. The example would be I now have a patch with a screamer -> split pitch glides (one +12 the other -12) -> Amp -> 2 delays -> to Spring Reverb. That was never possible before, but now it is.
The only other noticeable change is the footswitches. I do like the circle of light round the switches, but they feel the same to me and sound the same.
If you got the 500 for 400$ and these changes are worth 100$ then go for it. If you got the 500 and you paid 500$ I would exchange it. You should have 2 weeks or 30 days I can't remember.