score:2
The Vulgate Psalm 83:5 has saecula saeculorum, so I suppose a useful starting point would be an Anglo-Saxon psalter, as these did exist whereas vernacular Bibles didn't; but I can't find one online.
Wycliffe (around 1390) translated Ps 84:5† into Late Middle English as "into the worlds of worlds", which is a fairly literal rendering of the Latin.
Tyndale (1494–1536) didn't complete the Old Testament, but he translated Rev 1:6 (where the Vulgate again has saecula saeculorum) into Early Modern English as "for evermore".
The earliest readily-available English psalter after Tyndale is Myles Coverdale's (1537) who translates Ps 84:5 as "alway".
The Gloria Patri itself comes from the Hours of the Divine Office and would not have appeared in any English book before an English prayer book was mandated by the 1549 Act of Uniformity. The probable culprit for "world without end" is Cranmer, who prepared the Prayer Book of 1549.
† The different numbering comes from the Septuagint. This may indicate that the translation is closer to the Hebrew than the Latin.