Although attracting a strong player base through the 20's & 30's, Sutton were not successful at setting down roots, with a permanent clubhouse and pitches eluding them. Like most other clubs, Sutton suffered severely in the war and their restart was seriously curtailed by the fact that the excellent ground at Coppice Farm, Four Oaks, to which they had moved from Falcon Lodge before the war, was no longer available. The post war period saw Sutton successfully lease three successive temporary grounds from Sutton Borough Council, with changing facilities first in a local works canteen and then in a disused Air Raid Decontamination Centre. As the club made its way into the 1953/54 season, it saw a fortuitous move to Hollyfield Road, providing the club, at last, with its own clubhouse and changing facilities alongside first & second team pitches, with ready access to further pitches in Rectory Park for the socially ranked sides, which was required as the playing membership grew.

Through the 50's and 60's, although there was no RFU league structure, the only measure of a club's success was the strength of their fixture list and of course the number of games they won plus the number of County players they could claim. This final measure was often considered a lottery because the Warwickshire County side tended to come from clubs based around Coventry, like Coventry RFC, who were clearly ahead of clubs like Sutton in the pecking order.

Sutton called Hollyfield Road home for 23 successful years and enjoyed the clubhouse and facilities it offered but eventually the first team pitches, which all too often turned to mud after heavy rain and the clubhouse, baths and changing rooms were past their best. Despite the worry of yet another move, the club needed a facility that reflected the ambition of its members.