Luke Benbow netted the only goal of the first half to put the visitors ahead going into half-time.
However, the second half saw Tom Hewlett grab an equaliser, before Dexter Walters, Darryl Knights, and Benbow all scored to put the game to bed.
The Blues’ management duo opted to make six changes from the squad that lost away to Alvechurch last weekend – Lucien Mahovo, Keiran Walker, Ed Cook, Micah Jebbison, Jack Rogers, and Hewlett all began for this cup tie.
The Glassboys began with serious intent and that almost came to fruition with 2 minutes on the clock, when Jack Fletcher managed to get a shot away from the edge of the Blues’ box and force Ben Whiting into a smart stop.
However, the next clearcut chance did not fall for either side until the half-hour mark when former Solihull Moors striker Benbow etched home a scrappy opener, converting a rebound from Whiting’s wrong-footed initial save.
Hewlett had his first chance of the match for the Blues on the stroke of half-time – the Burton Albion loanee opted to let fire from just outside the box which forced Charlie Price into a diving save to tip the ball around the post.
After the restart, the visitors’ dominance continued, and it was once again Benbow with an effort on goal. The Glassboys’ forward found space on the edge of the box with the ball at his feet and attempted to trivela a strike into the bottom left corner, although it flew wide by inches.
Zayn Hakeem then had an opportunity for the Blues at the opposite end of the pitch – his driven strike from the edge of the area forced Price low, but it was ultimately a comfortable stop for the Stourbridge keeper.
United did, however, find a goal of their own just prior to the hour mark – Hewlett connected with Joe Nyahwema’s deflected cross and levelled the scoreline with a venomous half-volley from just inside the box.
But it did not take long for Stourbridge to restore their lead and secure victory as they capitalised on three opportunities late on.
Substitute Dexter Walters tucked home the first of three with a rebound strike following Whiting’s palmed stop of Benbow’s thumping strike.
Another substitute Darryl Knights converted the second after connecting with Niall Flint’s brilliant by-line cross, and Benbow netted the third with a snapshot strike inside the box that bounced off the post, hit the back of Whiting, and bobbled over the line.
The Blues searched for a late consolation, but it simply was not meant to be as the Blues fell to defeat following a frustrating display at Grange Park.