The visitors raced into the lead at Meadow Lane after just eight minutes through Jake Taylor's tap-in.
Jayden Stockley, the Grecians' top scorer, then struck the decisive second just before half-time.
Jon Stead scored a second-half penalty after Shola Ameobi was hauled down in the box but the Magpies couldn't find an equaliser and so it ended 2-1.
Pride of Nottingham was at the Lane to watch the action unfold and took plenty of photos of the Notts fans.
Have a look through our gallery in this week's Faces of PON, published on our Facebook page, and don't forget to tag yourself and your loved ones!
Share your thoughts about this week's Faces of PON on Pride of Nottingham by signing up to the website, visiting the forum and joining in the chat with hundreds of fellow Notts County fans.
Fancy showcasing your brand or business on Pride of Nottingham? Click here to find out more about sponsorship and advertising opportunities with us.