Shims are usually removed as the bearing wears. Adding a shim has me puzzled. Do you mean you need to remove a shim?
If so, they do not have to be exactly the same on each side, just as close as you can easily do. If removing that one shim gets you the required clearance, do so and drive on but be ready for new bearings soon.