Misconception about remembering past lives?

Buddha has nothing to do with it, if he existed. I don't believe in any sort of god or anything supernatural, but I still have memories of earlier lives, usually traumatic death moments, and encounters on the other side. I don't regard them as reality. It's just normal fiction.

In the discourses, is always clear when the Buddha is using similes and when he is not. Thus, I don't see any reason to believe that he was refering to rebirth, other realms and the inhabitants these realms as similes.

I can remember a few suttas which elucidate rebirth as a literal death followed by a literal birth.

So Ven. Sāriputta—when there was still more to be done, having established Dhanañjānin the brahman in the inferior Brahmā world — got up from his seat and left. Then, not long after Ven. Sāriputta’s departure, Dhanañjānin the brahman died and reappeared in the Brahmā world. MN 97

.

Then Ven. Sāriputta and Ven. Ānanda, having given this instruction to Anāthapiṇḍika the householder, got up from their seats and left. Then, not long after they left, Anāthapiṇḍika the householder died and reappeared in the Tusita heaven. Then Anāthapiṇḍika the deva’s son, in the far extreme of the night, his extreme radiance lighting up the entirety of Jeta’s Grove, went to the Blessed One

[...]

Then when the night had past, The Blessed One addressed the monks: “Last night, monks, a certain deva’s son in the far extreme of the night, his extreme radiance lighting up the entirety of Jeta’s Grove, came to me

[...]

When this was said, Ven. Ānanda said to the Blessed One, “Lord, that must have been Anāthapiṇḍika the deva’s son [...]”. “Very good, Ānanda. Very good, to the extent that you have deduced what can be arrived at through logic. That was Anāthapiṇḍika the deva’s son, and no one else.” MN 143

It's not easy to find a being which has not been a relative of yours

Near Sāvatthī. There the Blessed One said: “From an inconceivable beginning comes the wandering-on. A beginning point is not discernible, though beings hindered by ignorance and fettered by craving are transmigrating & wandering on. A being who has not been your mother at one time in the past is not easy to find.… A being who has not been your father.… your brother.… your sister.… your son.… your daughter at one time in the past is not easy to find. SN 15:14–19

Buddha revelead one of his past lives as a chariot maker

“[...] Now, monks, the thought may occur to you that the chariot maker on that occasion was someone else, but it shouldn’t be seen in that way. I myself was the chariot maker on that occasion. AN 3:15

And what is wrong view?

And what is wrong view? ‘There is nothing given, nothing offered, nothing sacrificed. There is no fruit or result of good or bad actions. There is no this world, no next world, no mother, no father, no spontaneously reborn beings; no contemplatives or brahmans who, faring rightly & practicing rightly, proclaim this world & the next after having directly known & realized it for themselves.’ This is wrong view. MN 117

There's MN 36 for example which is translated like this:

When my mind had immersed in samādhi like this—purified, bright, flawless, rid of corruptions, pliable, workable, steady, and imperturbable—I extended it toward recollection of past lives.
So evaṃ samāhite citte parisuddhe pariyodāte anaṅgaṇe vigatūpakkilese mudubhūte kammaniye ṭhite āneñjappatte pubbenivāsānussatiñāṇāya cittaṃ abhininnāmesiṃ.

I recollected my many kinds of past lives, with features and details.
So anekavihitaṃ pubbenivāsaṃ anussarāmi, seyyathidaṃ—ekampi jātiṃ … pe … iti sākāraṃ sauddesaṃ anekavihitaṃ pubbenivāsaṃ anussarāmi.

There are people who dispute or debate the meaning of pubbenivāsānussati.

Some people say it might refer to times or states within this lifetime when we identified as a self -- and maybe say that a better translation might be past "abodes" not past "lives".

I posted this question here a while back -- Is rebirth a delusional belief?

There are people, including on this site (and even quoting some modern-day monks), who agree with and promote the idea that "past lives" doesn't mean that (and that people who say otherwise are wrong).

More generally that might be one of the tenets of secular buddhism.

I think that's unorthodox though and that a majority of monks would say that, absolutely, the suttas and other texts are full of references to past lives -- and that people who say otherwise are sort of not accepting what the texts say.

I hope that, perhaps, being "agnostic" about the subject (of how to translate or understand that topic) is a way to avoid misunderstanding and misleading people. The whole topic seems to me to be potentially a form of identity view, which we are warned against, part of the "thicket of views" -- also attachment to a specific view etc.

Here was an answer that was willing to "understand figuratively not physically" -- the question was, How do we know that the suttas talk about past lives?

And here another answer that you might find helpful -- the question was, What's the value or harm of a literal belief in rebirth?

However, my question is Buddha has never talked about past life as in life about past bodies before physical birth, if he has then please let me know. (Also, I have found that Jataka tales is fabricated because it is post Canon.)

The Buddha did talk quite explicitly about physical rebirths before and after the physical death of the body. And it's mentioned not only in the Jataka, but in all the Nikayas. So, it'd be a mistake to interpret rebirth as only exclusively the momentary rebirth of consciousness in the same life.