there is just about enough wiggle room to get that upper trim out without breaking the plastic, I have managed on mine in the past. once the screws are tight though it wont go anywhere if you loose a bit of those lugs, could just trim them down slightly rather than snap off entirely
Going on from this; if the spline is removed from the column, can the ignition switch housing simply be slid off once its bolt is removed?