The defining moment came early on when the hosts' keeper was red-carded for taking Gareth Ward out as the Colliery striker attempted to go round him. David Best put the subsequent free-kick over the top and Ryan Tolley made a magnificent one-handed save to keep it level before Ward found the bottom corner after great work from Rich Bradley, James Bradley, Danny Glassell and Simon Davis.
It was 2-0 five minutes later when winger Jonathan Davis crossed for Andrew Gray to convert. Featherstone were seething when Headingley pulled one back after a home player clearly helped the ball to his team-mate with his hand. It rattled the visitors, who conceded a second.
Gray's outstanding 40-yard strike restored the lead, only for Headingley to hit back on the counter to make it 3-3.
But Featherstone stuck to the game-plan and drew next blood in an entertaining game when Ward, spotting the keeper off his line, delivered an inch-perfect 35-yard chip to make it 4-3.
And ten minutes from time he completed a match-winning hat-trick - and the man of the match award - by nodding home Jon Davis's fine cross.
James Bradley, Gray and the Davis boys both impressed for Colliery, who visit Churwell on Saturday (players to meet in the Junction before 1pm).