Maybe the axle is offset a tad or one of the spacers is installed backwards or on the wrong side.