Starter can stay. You need itty bitty fingers to gt the oil pan bolts over the x-member area.
Rotate the crank until throws on the 1,2 cylinders are up, this will give a little extra space. On mine I removed the motor mount bolts, and jacked the motor up to gain enough clearance to clear the flywheel.
Good luck.