The reason shop manual tells you not to just drive it out with a punch and a hammer is that if you just went nuts and smacked it really hard, you might damage the upper column bearing. You can see that bearing in your picture. It surrounds the hole in the column where the steering shaft is...