I think next time I have to do the wheel bearings I'll make a tool out of threaded rod, two nuts, and three "legs" where the legs will fit in the notches I made in the spacers, then tighten the two nuts down, then hit the rod with a mallet on the opposite end and it'll knock the bearings out with ease. I was just trying to set myself up so I wouldn't have to cut the bearings out again next time. It would still be rather difficult as is to do with a screwdriver.
Come to think of it, the blind pulley would probably fit now in the notches I made as well...