Honest answer: probably not, unless specific pain points from the XM5 bother you.
What's actually different:
The XM6 folds again (the XM5 didn't), has better call quality with more microphones, a slightly improved ANC processor, and can play music while charging. That's the meaningful list.
What didn't change:
Battery life is still 30 hours. Sound quality is similar. Comfort is similar (same shallow earcups). The overall experience is 90% the same.
When upgrading makes sense:
You travel a lot and the XM5's bulky case annoyed you. The return of folding makes the XM6 more practical for frequent travelers.
You take a lot of calls. The XM5's microphone was mediocre. The XM6's six-microphone array is better.
You run out of battery and wish you could keep listening while charging. Now you can.
When to skip:
Your XM5 works fine. You don't travel frequently. You rarely take calls. You're not bothered by the non-folding design.
The price factor:
The XM6 launched at $450. If you can find an XM5 on sale for $280-320, that's better value unless the XM6's improvements matter to you.
Coming from XM4 or earlier?
Then yes, upgrade. Two generations of improvement make a real difference.