The Magpies took the lead in the 20th minute when Rovers failed to deal with a corner from the left and Richard Duffy reacted quickest to prod home from close range, his third goal of the campaign.
However, the hosts equalised just before the break through James Coppinger, who was on hand to rifle Matty Blair's low cross across Adam Collin and into the far corner of the Notts net.
And not long after the restart, Rovers were in the lead as Coppinger turned provider, whipping in a cross that Mathieu Baudry headed into the top corner.
Just after the hour, Kevin Nolan's charges thought they had equalised when a Michael O'Connor corner was nodded home by Haydn Hollis, but the flag was inexplicably up to snuff out the goal.
Notts launched everything they had in attack in second-half injury time as Collin went up for a corner, but Rovers managed to break and, with the goal unguarded, substitute Andy Williams guided the ball into an empty net to seal their win.
Share your thoughts about the game and about this match report on Pride of Nottingham by signing up to the website, visiting the forum and joining in the chat.