I have ripped an intercooler seam and the car would lose boost in high gear.
I'm not saying it can't happen; I'm just trying to conjecture as to why. Load should make no difference as pressure is pressure inside the intercooler. Unless it lowers exhaust pressure as a result of the boost loss. Maybe the turbo can overcome the rip in the lower gears, but when the engine eats more in high gear, the rip causes the compressor to run out of steam?