Here is the tool I was talking about.

Aluminum rod with a small cone on the end.

The bearing fits over the center nub and that helps center the bearing.

The green area is lower than the outer edge, so only the outer edge contacts the bearing (the tool only presses on the outer race).