Ya, all the shifter linkage needs to be in full operation and properly adjusted. All the way up to the steering column!!!! When you move the shifter, does the collar on your steering column just in front of the wheel rotate???
BTW, there's no adjustment to speak of on the N safety switch. The adjustments have to be made under the car at the rod attachment point.