Indeed, the idea that something has always existed seems to me to be strengthened considerably by the fact that everyone who argues the contrary seems unable to do so without including a thing that existed when there was nothing (whether they choose a God of some kind, or some variation on mathematics, logic, time, or quantum uncertainty).
Everyone? Not me, gov'.
I'm on record for saying that it is perfectly logical to think of reality as having existed only for a finite amount of time without having been caused by anything at all. Spontaneous appearance if you like.
It's perfectly logical because nothing really means nothing. And in this case, nothing means there's no prior constraints on how things are allowed to come into existence. So, no constraints, therefore spontaneous appearance is perfectly logical.
Quite simple, really.