Over the span of seven years, astronomers pointed one of the world's largest telescopes at patches of night sky roughly equivalent to 2,000 full moons and created something extraordinary: a three-dimensional map of more than one million distant galaxies as they existed between 10 and 12 billion years ago, during an era known as Cosmic Noon when most of the universe's stars were forming. Now, the Hobby-Eberly Telescope Dark Energy Experiment (HETDEX) has opened its entire database—built from more than half a petabyte of raw and processed data—to scientists, students, artificial intelligence systems, and citizen researchers around the world.
The scale of what HETDEX has accomplished is staggering. The public release contains a catalog of more than one million distant galaxies, half a million nearby star-forming galaxies, 18,000 supermassive black holes, and over 150,000 stars. Underneath it all lies 600 million individual spectra, the "barcodes of physics" that reveal each object's chemistry, movement through space, and distance from Earth. These spectra were gathered using spectroscopy—a technique that breaks apart incoming light into its various wavelengths, allowing astronomers to read the universe's hidden stories one slice of light at a time.
"The real excitement is what happens when thousands of astronomers start exploring it," said Erin Mentuch Cooper, HETDEX's data manager and lead author on the paper announcing the release. The survey itself was deliberately untargeted—rather than picking and choosing specific objects to study, astronomers simply pointed their telescope at the sky and let it gather whatever was there, an approach that has already uncovered unexpected objects and phenomena that traditional surveys would have missed.
For the past seven years, the Hobby-Eberly Telescope at McDonald Observatory in Texas surveyed the region of the sky with the Big Dipper and Orion as anchors, creating 431,000 three-dimensional data cubes, each roughly one-thirtieth the size of the full moon. The sheer volume of information—more than half a petabyte—forced the team to process the data down to a more manageable 10 terabytes while preserving its scientific depth and usability.
HETDEX was designed to solve one of cosmology's greatest mysteries: dark energy, the unknown force causing the universe's expansion to accelerate. By mapping the distribution of early galaxies across cosmic distances, astronomers can measure how the universe has expanded over time and better understand this invisible phenomenon. But the dataset's value extends far beyond dark energy research. Scientists can now study how the first galaxies formed and evolved, investigate the distribution of gas and stars within distant galaxies, and map the large-scale structure of the cosmos itself.
What makes this release particularly significant is its accessibility. Users can download customized subsets of data based on sky location, or they can tap into high-performance, cloud-based supercomputing resources through a collaboration with UT Austin's Texas Advanced Computing Center, dramatically lowering the barrier to entry for researchers working with datasets of this magnitude. The team developed extensive tutorials and tools designed for both human and artificial intelligence users, recognizing that the future of astronomical discovery belongs to everyone willing to explore it.
"We've turned more than half a billion spectra into something you can actually explore," Mentuch Cooper said. "It's like compressing a universe of information into something you can hold in your hands." For the first time, astronomers and AI systems everywhere have access to one of the most detailed maps of the early universe ever created.