We built a semantic search engine for millions of galaxy images by having LLMs write the captions.
These images are completely unlabeled, but our method enables astronomers to search for rare phenomena via text. Try our app! 🔭👇
Submissions are still open for our Machine Learning for Physical Sciences workshop! Papers (4 pages) are due Sept 12, 11:59pm AoE.
The ML4PS workshop will be on Dec 11 at Georgia Tech in Atlanta, co-located with NeurIPS and independently organized. ml4physicalsciences.github.io
It won't be long before a similar spike in papers happens in physics.
So we ran a hackathon @LightconeR. We worked on solutions to ensure research remains observable and reproducible even with a dramatic increase in papers, mostly around our ASTRA spec. A lot of work lies ahead.
GPT-5.2 seems to have fantastic plot reading capabilities, even better than Gemini 3 Pro.
I introduced this challenge almost exactly one year ago and it looks like it's basically solved! 🪩
Of course, I will have slightly harder plot reading tasks to share :)
Today, our research on making 100M+ galaxy images searchable with AI was published in The Astrophysical Journal!
Since the initial release, AION-Search was featured by OpenAI and we were able to discover 36 new galaxies with streams, useful for studying dark matter. [1/2]
We built a semantic search engine for millions of galaxy images by having LLMs write the captions.
These images are completely unlabeled, but our method enables astronomers to search for rare phenomena via text. Try our app! 🔭👇