Willie I used to think the same way.
I thought anyone who didn't believe there was life elsewhere was ignorant because of space going on for as far as we cannot even imagine, so that there had to be life elsewhere.
But, a few years ago I changed my opinion.
It just seems like everything has to, and had to, come together in ways beyond comprehension to create life, that the odds of it happening again elsewhere are just too unrealistic in my opinion.
I think it's possible, of course.
Just not likely because of the perfect scenario against the greatest odds for anything ever happening to bring it about...
There are a ton of different species within our own realm, and we aren't even a spec of what is out there.
Be humbled that we, even in our most primitive state, have been around for possibly hundreds of thousands of years. Dinosaurs were around for 100's of millions of years, depending on what definition of a dinosaur one uses.
Man would not have thrived if they co-existed with dinosaurs.
By now, it will probably take either self extinction through nuclear war (or worse) or bacteria domination. This will open up for a whole new organism to thrive.
In my opinion, like your original thoughts, far too much out there to think we are the only speacies with developed intelligence.
We are are on the, somewhat, outskirts of our own galaxy. A suburb if you will. It is probable there is existence in our own galaxy, let alone the billions of galaxies out there.
We are so far from comprehending the universe that to say "It just seems like everything has to, and had to, come together in ways beyond comprehension to create life, that the odds of it happening again elsewhere are just too unrealistic" is a bit ignorant.
Imagine what will be proved, disproved, discovered over the next 1000 years.
Science may may one day prove there is a god.