I did have the same problem and had to buy a new alu spacer at the dealership. It was correctly torqued and with the flat side of the bolt against the spacer.

Some idiot at Yamaha made the spacer out of alu instead of steel, just like the axle. Because of the high torque the axle digs into the softer alu spacer.