Boro play host to Whitby Town on Saturday, 3pm kick-off, looking to avenge their 2-0 defeat at the Turnbull Ground in September.
Kelly, who played for Boro during their time based in Bridlington, was confirmed as the new Athletic manager on Monday afternoon.
This came less than 24 hours after the club parted company with John Deacey after a run of six defeats on the trot.
His first game in charge is the clash with Whitby.
He said: “I have to prepare the lads for the Whitby game, no body expects anything of us and I believe if the players perform well we can take something from the game.
“We were disciplined and professional throughout Tuesday’s game and to see the likes of James Walshaw and Michael Coulson giving it 100% at the end of the game is really positive.
“Irrespective of the result we needed to get back to winning ways and it puts us in good stead for Saturday.”
Kelly is impressed by the calibre of players at the club.
He added: “We have some extremely strong players in the squad, Tommy Taylor is the best keeper in the league and to have talented players in front of him helps push the team forward.
“This team shouldn’t be in this current position and I have been brought in to change that.
“I think I’ll be able to get the best out of the players, I like to man-manage and ensure that they perform to their best.
“As everyone gets to know me it’ll hopefully build the trust and they can see how positive I am.”
Saturday’s derby is pay on the gate, and Boro fans are only able to gain access through the Boro Gates entrance. The fixture will be segregated.