If your engine RPMs are dropping significantly when you turn on the AC, that might account for it.
The other item is all the ducts are vacuum actuated. I recommend you try this to tell what is going on.
1. Duplicate the issue - Start the car, AC off... Note the "Good" vacuum reading
2. Turn AC on to "Norm"
3. Did the Vacuum drop? If yes, move the selector to "Vent" to turn compressor off.
4. Did the Vacuum stay the same or raise back up?
If the vacuum reading drops on AC and not on vent, then the AC compressor may be loading the engine down, reducing the vac. (Alternator too... cooling fan runs on high too) If this is a big change in RPM, than the computer may not be adjusting for this, or the compressor is faulty (Bad bearings or internals)
If the vacuum is the same for Norm and Vent settings regardless of the AC compressor on or off, then you may have a dash vacuum leak that only appears when the dash vents are selected/open.
When I turn my AC on, there is a momentary drop in RPM (and vacuum) until the ECM changes the idle settings to compensate. If I were to guess, the IAC (Idle Air CTRL valve) and TPS may need adjusting. If these are improperly set, the ability to adjust for loads at idle may already be maxed out and can't do it.
Hope this helps!