Hereford found themselves 11 points behind top-of-the-table Yeovil after going down to a solitary Justin Jackson goal in their Nationwide Conference clash at Nene Park.
Jackson beat the Hereford off-side trap to net the decisive goal after 55 minutes and settle a game in which there was little to choose between the two sides, although Diamonds played the last 21 minutes with just 10 men.
Hereford fielded their new signing, former Northern Ireland international Jimmy Quinn who has recently been playing for Northwich Victoria.
The ex-Swindon manager showed that, even at the age of 40, he can still be a force at this level and came up with Hereford's best opportunity after 24 minutes.
Quinn got in a powerful header from Michael McIndoe's free-kick and, although goalkeeper Billy Turley was unable to hold the effort, Jim Rodwell was on hand to hack the ball to safety.
Despite the presence of Quinn in the Hereford attack and the highly-rated, and priced, Jackson and Duane Darby in the Diamonds front-line, neither goalkeeper was overworked.
Darby's most notable contributions to the game came in eight second-half minutes when he picked up two cautions, one for ungentlemanly conduct and the other for a foul on John Snape. It was the former Hull man's second sending-off in successive games.
Hereford were under pressure in the early stages but rallied to produce their first on-target effort on 16 minutes through Paul Parry who cut in from the right.
But after this, apart from Quinn's effort, Hereford produced few first-half threats and Diamonds did little better with their best attempt coming from an Andy Burgess drive which goalkeeper Scott Cooksey gathered easily.
After Jackson's goal, Gary Mills had Diamonds best opportunity but again shot straight at Cooksey after bursting past Ian Wright and Tony James.
Wright forced Turley to tip a goal-bound effort over following a Williams corner three minutes from the end, but Diamonds held on for a victory which kept them just a point behind Yeovil.
Hereford: Cooksey, Lane, Clarke, Robinson, Wright, James, Parry (sub Quiggin 69 mins), Snape, Quinn, Williams, McIndoe. Subs not used: Elmes, Baker, Gardiner, Wall.
Rushden: Turley, Mustafa, Setchell, Mills, Rodwell, Warburton, Butterworth, Brady, Jackson, Darby, Burgess. Subs not used: Sigere, Collins, Wormull, Peters, Naylor.
Referee: AS Hogg (Sheffield).
Attendance: 4,188.
Comments: Our rules
We want our comments to be a lively and valuable part of our community - a place where readers can debate and engage with the most important local issues. The ability to comment on our stories is a privilege, not a right, however, and that privilege may be withdrawn if it is abused or misused.
Please report any comments that break our rules.
Read the rules hereComments are closed on this article