score:32
Going beyond E.B. or Wikipedia:
The official website of the Hagia Sophia Museum (at its former domain, link now dead) stated
The first church [at the H.S. site] was constructed by Emperor Konstantios [i.e. Constantine's son] (337-361) in 360. The first church was covered with a wooden roof and expanded vertically (basilica) yet was burned down after the public riot that took place in 404 as a result of the disagreements between Emperor Arkadios’ (395-408) wife empress Eudoksia and Istanbul’s patriarch Ioannes Chrysostomos, who was exiled. [...] No remains have been recovered from the first church; however, the bricks found in the museum storage branded ‘Megale Ekklesia’ are predicted to belong to the first construction.
The current official website of Hagia Sophia Museum and Foundation now states
Hagia Sophia is a work that was constructed three times in the same location. Today’s Hagia Sophia is known as the “Third Hagia Sophia”. The first construction of Hagia Sophia started during the reign of Constantine I, who accepted Christianity as the official religion of the Roman Empire. This building, which was constructed as a basilica with a wooden roof on the first of the seven hills of Istanbul and was called "The Great Church" at the time, was opened during the reign of Constantine II in 360. There is no remnant from this structure, which was largely devastated as a result of a fire that broke out in the revolt that started in 404.
The website Hagia Sophia says
Known as the “Great Church” or “Magna Ecclesia” in Latin, the first church was built at the same location where there had been a pagan temple before [emphasis mine]. It was Constantius II who inaugurated Hagia Sophia on 15 February 360. From the chronicles of Socrates of Constantinople, we know that the church was built by the orders of Constantine the Great.
Prokopius' book Buildings of Justinian, a translation of which was kindly linked to by @user2448131 gives a detailed description of the Hagia Sophia, its construction, and its beginnings post Nika revolt, but does not make any mention of pagan "foundations".
As for other historical source, there seems to be a distinct dearth when searching on that topic: there are many sites or excerpts with circular quoting referring to the pagan temple. This one stating
Some say that the site was first a pagan temple in honor of Apollo and Venus.
Which is one of the few that actually identifies the deities. As a number of other sources state Greek temple, we'll have to presume that would have been Aphrodite?
Here is a most intriguing abstract about the construction of the Hagia Sophia. It was actually designed by a pagan! Sadly the site requires registration and acedemic credentials.
A figure overlooked in scholarship on Hagia Sophia is Phokas, the praetorian prefect of 532 under whom construction of the church began. He was a pagan who eventually took his own life in one of Justinian’s purges. His initial supervision of the construction of Hagia Sophia is attested by Ioannes Lydos, himself a pagan intellectual, who praised Phokas in superlative terms, despite Phokas’ infamous death. Consideration of all the evidence for an architect of Hagia Sophia, Anthemios of Tralleis, beyond the literary sources usually cited, strongly suggests that he belonged to the pagan wing of the school of Ammonios of Alexandria, as did the architect Isidoros of Miletos. Material presented here explains how the last pagans of New Rome contributed to the making of Hagia Sophia and suggests how they may have interpreted the monument on their own terms.
On the spur of the moment, I contacted, going first via Prof. Mary Beard, her husband Prof. Robin Cormack, specialist in Byzantinistic or, as Wikipedia states, he is a British classicist and art historian, specialising in Byzantine art. He was Professor in the History of Art, Courtauld Institute of Art, University of London, 1991–2004. Despite traveling in Turkey as I write this, he was kind enough to respond he writes:
Just a short answer as we are in Turkey just now. Archaeologically there is no clear indication, as the Constantinian church underneath the present church has not been excavated. In the course of time all sorts of mythic stories about the city and its origins developed. There is a really good book about this - Gilbert Dagron, Constantinople imaginaire . He collects all the stories and assesses them
The title of the book sounds French, so I'd either have to brush up a lot on my rudimentary knowledge or some other kind soul, fluent in French, can provide information from that book.
LATE EDIT:
It's been two years and revisiting this, I had totally missed that the OP @Notaras had provided a very interesting link in chat (which I so rarely check) to an academic paper titled Pre-Constantinian Floor Mosaics in Istanbul (registration required).
This paper itself quotes research and speaks about a mosaic found, not at Hagia Sophia but at Hagia Eirene. It's dated, depending on researcher as late as the fifth and as early as the second century CE. The paper goes on to say
Medieval sources do not inform us about the location of the temples in the city, except that the temples of Apollo, Artemis, and Aphrodite were on the acropolis.6 We also know that Septimius Severus built a temple dedicated to Apollo-Helios on the acropolis, which was extant at least until the reign of Leo I.7 In the debris to the north of Hagia Eirene, at the western edge of the acropolis of ancient Byzantion, Ramazanoglu found an inscription reading, perhaps in reference to the same temple that Septimus Severus had built, “Gaios … Skumnos made one of the … propylons of the temple of Apollo.”8 Thus, Ramazanoglu identified a structure that he ex cavated right outside the southern wall of the church, with the temple of Apollo and the mosaic floor with the Temple Aphrodite next to it (fig. 3).9 However, his attribution and dating are problematic, since they contradict both the historical sources and our current knowledge of the chronological development of ancient mosaic making.
This would mean that the temple(s) of Apollo and Aphrodite referred to earlier were not at the site of H.Sophia but rather at H.Eirene. However a quick glance at a map of modern Istanbul shows those two to be virtually next to each other.