Considering a wheel swap - what should I know?

I guess you need also to unmount the snubber.

Try penetrating oil at the gap between inner bearing ring and axle (repeatedly), let it sit for 24 hours.
Lay the bike at the right side meanwhile, with a bit of luck the oil might reach also the inner bearing.