Some people like to assume that the cosmos is ours for the taking, even though this could make us special to the order of 1 in 1080. The argument is that the cosmos could be transformed by technology - engineered on astronomical scales - but hasn't been thus transformed.
The most common alternative hypothesis is that "we are in a simulation". Perhaps we are. But there are other possibilities too.
One is that technological life usually destroys, not just its homeworld, but its whole bubble of space-time, by using high-energy physics to cause a "vacuum decay", in which physics changes in a way that makes space uninhabitable. For example, the mass of an elementary particle is essentially equal to the energy density of the Higgs field, times a quantity called a "yukawa coupling". If the Higgs field increased its energy density by orders of magnitude, but the yukawas stayed the same, matter as we know it would be destroyed, everywhere that the change spread.
Here I want to highlight a different possibility. The idea is that the universe contains very large lifeforms and very small lifeforms. We are among the small. The large ones are, let's say, mostly dark matter, galactic in scale, and stars and planets for them are like biomolecules for us; tiny functional elements which go together to make up the whole. And - the crucial part - they have immune systems which automatically crush anything which interferes with the natural celestial order.
This is why the skies are full of untamed stars rather than Dyson spheres - any small life which begins to act on that scale is destroyed by dark-matter antibodies. And it explains anthropically why you're human-size rather than galactic-size: small life is more numerous than large life, just not so numerous as cosmic colonization would imply.
Two questions arise - how did large life evolve, and, shouldn't anthropics favor universes which have no large life, just space-colonizing small life? I could spin a story about cosmological natural selection, and large life which uses small life to reproduce, but it doesn't really answer the second question, in particular. Still, I feel that this is a huge unexplored topic - the anthropic consequences of "biocosmic" ecology and evolution - and who knows what else is lurking here, waiting to be discovered?
Some sort of selection definitely happens. The first stars were huge and simple, with only hygrogen and helium. They seem to be evolving toward high metallicity and medium size. They also compete for the same food source, interstellar dust. I concede that this is reaching somewhat, but probably not nearly as much as liking rocks to cells.
But what sort of selection is this? Evolution requires, roughly, reproduction and inherited variation with selection. I could imagine that we might see something like this in a stellar life cycle where stars go supernova, scatter gas clouds, and new stars form to go supernova and form even more new stars, but as far as I know, this is not anything we see (and wouldn't work with dark matter, anti-life antibodies, or galaxy-scale organisms), inasmuch as stellar creation is shutting down (I've read this in various places, most recently http://lesswrong.com/lw/i2i/link_cosmological_infancy/ ) and I'm not clear what sort of variation could be inherited there either.