Paul Oldroyd fired the hosts in front and striker Jamie Tyler made it 2-0 at the interval to villagers, the Ayton defence keeping the pacey Chris Weetman at bay.
Milburn gave the hosts a three-goal lead early in the second half with a stunning 20-yard shot into the top corner of the net, and although player-boss Ray Thorpe reduced the arrears midway through the half, two cracking goals in quick succession from the tireless Milburn completed his hat-trick and made sure of the first win of the season for Ayton.
Defender Jake Adams was the pick of the home team, but all the players performed well in a great all-round display to lift them off the foot of the table for the first time this season.
At the other end of the table Seamer Sports Reserves claimed a 3-2 win at Falsgrave Athletic to take top spot.
Dan Jewitt, Marcus Mockridge and Joe Turner were on target for the visitors.
Duchess kept their own promotion ambitions on track with a 2-1 home win against a determined Cayton Corinthians Reserves outfit.
Luke Midgley put Paul McBean’s side in front in the first half direct from a corner, and after the interval Tom Hicks doubled their lead with a fine goal from a good cross by Chris Ryan.
Harry Sleep’s superb strike gave Cayton hope of grabbing a late point but the hosts held on against a hard-working Cayton side.
Danny Hague was named as the man of the match for Duchess, while Sleep was the star man for Cayton.
Striker Mikey Barker banged in five goals as Edgehill Reserves returned to winning ways with an 8-1 rout of basement club Snainton.
Maciey Kapczynski, Andrew Noon and 16-year-old right-back Josh Wallace also netted, the letter also sharing the man of the match award with central midfielder Alistair Jennings, 18, Wallace impressing at full-back and when he was switched to the left wing in the second half.
Josh Evans netted for the visitors.
Newlands Park claimed top spot in Division One thanks to a hard-earned 5-1 win at Hunmanby United.
Dan Freer put Park ahead on 10 minutes and the in-form Liam Buglass added a second on 27 minutes.
Four minutes later Freer made it 3-0 and the score remained that way until half-time.
Jamie Gallagher and Matty Griffiths also netted after the break with James Pinder replying for a Hunmanby side who played well despite the scoreline.
Gallagher and Buglass were the joint men of the match for Newlands.
Eastway Sports extended their lead at the top of Division Three with a 7-4 success in a keenly-contested match at Commercial.
Rob Whitehead led the way for the victors with a first-half hat-trick while player-boss Eric Hall added two with goals for Mark Taylor, and Sam Walker completing their scoring.
Commercial man of the match Ryan Somers hammered in a hat-trick from central midfield, with a Macca Youngson header completing their tally, Liam Bare also shining at centre-back for the hosts.
Sherburn scored a last-gasp goal to snatch an excellent 2-1 home win against a strengthened Filey Town 3rds team.
Paul Mills got away from his marker, first-teamer Ben Briggs, to get one on one with Kyle Scaife, who is also usually in goal for Town’s Division One side, and the forward’s first shot was saved by Scaife but he managed to force in the rebound.
Aaron Howard smashed a fearsome drive past Jordan Lee on the half-hour mark to bring the scores level.
Lee then made a couple of cracking saves to keep the hosts in it, and after the break Scaife also made two superb stops to maintain the 1-1 scoreline.
Just as the game seemed to be heading for a draw, sub Daz Temple crossed to fellow sub Matty Pickard, who capped his return from injury with a winning header in the 90th minute.
Lee Plant was named as the man of the match for the visitors, while keeper Lee was the Sherburn star man for his crucial saves when the scores were level.
A hat-trick from Aidan McCallion steered a bolstered Westover Wasps Reserves line-up to a 5-2 home win against third-placed Sleights Reserves.
McCallion, who is a first-team regular, scored a fine hat-trick, while another first-teamer, Liam Mintoft, got on the scoresheet and the duo were the joint-men of the match for Rob McPherson’s side.
An own goal put the hosts in front, and although Rob Ingham put the Whitby side level, McCallion restored the lead for Wasp, only for Jim Neil to make it 2-2 at the break.
McCallion’s class then shone through as he finished off a fine piece of play from Jack South, and struck a second to make it 4-2, Mintoft capping the win for Wasps.
Mike Brennan was the man of the match for Sleights.