The Magpies drew 1-1 with the Swans in the first game to secure a replay at the Liberty Stadium, with a fifth-round meeting at Sheffield Wednesday up for grabs.
County's League Two form in January was wobbly but the team got back to winning ways against the Railwaymen in front of a packed Meadow Lane on Saturday.
The result kept the club in the division's automatic promotion places and, on the back of the win, Nolan is eager for the team to get back out onto the pitch promptly.
“I am really looking forward to it,” he told the Nottingham Post. "When you win games you just want to be back out on the pitch.
“There’s a lot of work to be done from now until Tuesday, but we will enjoy this result for a bit.
“I know Swansea had another good result at the weekend so it will be a tough one, but we go there full of confidence.”
Share your thoughts about this news story on Pride of Nottingham by signing up to the website, visiting the forum and joining in the chat with hundreds of fellow Notts County fans.
Fancy showcasing your brand or business on Pride of Nottingham? Click here to find out more about sponsorship and advertising opportunities with us.