Typebar alignment is like adjusting camber, caster, and toe-in on a car, changing one affects one or both of the others.
You can very gently bend (almost imperceptibly) to affect the angle of the letter, but since the A key is so far left, that bend is going to affect the vertical position as well, so you'd have to compensate by just giving the long stem of the typebar a little flex in the direction to move the letter. You may want to try this out on a machine that you don't care as much for. Regarding your E key, it sounds like it's worn at the pivot point. More correctly, the heavy pivot wire has a groove in it most likely since the typebars are made of harder steel. You can adjust this by moving the wire about the width of one typebar in the segment but beware, you may find that all your type is out of alignment once this is done.
Regardless, don't fret, just have fun.