10-man Barnet fell to defeat in the North East, as Gateshead rallied in the second half to pick up all three points.
The Bees took a 24th-minute lead when Shaq Coulthirst played a delightful ball over the top of the Gateshead defence, setting up Ephron Mason-Clark who made no mistake, slotting past Aynsley Pears from close range.
Gateshead should have levelled shortly after, Steven Rigg getting in behind but his first shot hit the post and his rebound went wide.
Just before the break, the match would swing back into the hosts favour when Coulthirst was shown a second yellow card for simulation.
The hosts levelled three minutes after the restart. Olley got on the end of a cross from Thomson and slid past Cousins from close range.
The hosts applied more pressure on the 10-man Bees and took the lead when Tom White curled home from the edge of the box.