That requires a special tool.
First, you have to drill out the punch marks, which "stake in" the bearing retainer. Use a 1/8" or so drill bit, and go no deeper than 1/8".
The special tool that you need engages those four slots, and screws the bearing retainer out. A lot of people try to remove the bearing retainer using a punch and a hammer. BIG MISTAKE! The bearing retainer is aluminum, and you can fuck it up very quickly.
I wasn't able to find the tool needed to take the retainer out. I had to make it.