Immersive 3D exploration

of astronomical data, with a voice-driven AI Assistant

StarGateVR

Before analysis,

there is noticing.

An astronomer studying Gaia data may be looking for a candidate group of stars: stars that share position, motion, color, brightness, and distance in a way that suggests a common origin. But in a table, that evidence is scattered across many columns.

So the astronomer makes one 2D plot after another, trying to hold all those relationships in mind at once. Each view shows part of the story, but none quite answers the question: do these stars really belong together?

StarGateVR gives those scattered relationships a spatial form. The astronomer can see shape and motion together, select what appears coherent, and bring a sharper, testable hypothesis back to their analysis tools.

Because the best analysis does not begin with every possible calculation. It begins with a better question.

Whether the question is a moving group, a stellar stream, or an unexpected outlier, StarGateVR helps researchers notice structure before they commit to the next calculation.

Two researchers explore dust cloud induced stellar reddening around the M4 globular cluster

What StarGateVR actually does

Speak naturally to query your datasets, cross-match with multi-wavelength archives, and retrieve new data from the Gaia Archive — all without leaving the headset. Built by Immersive Science LLC.
  • Interactive Gating
  • Voice queries
  • Multi-wavelength enrichment
  • Live archive access
  • Live collaboration
  • All in immersive 3D
Multi-Wavelength Catalog Access

Cross-match and enrich your datasets with archives spanning the electromagnetic spectrum:

  • Gaia DR3 — Positions, photometry, kinematics (including live ADQL queries)
  • eROSITA — X-ray observations
  • GALEX — Ultraviolet photometry
  • 2MASS — Near-infrared (J, H, K)
  • WISE/AllWISE — Mid-infrared photometry
  • SIMBAD — Spectral types, classifications, named-object resolution
  • MOCA — Stellar association and cluster membership

Imported datasets can be cross-matched and enriched against any of these archives. Results are merged by source ID or positional cross-match (typically 3 arcsec) and loaded back into the 3D environment.

Configurable 3D Parameter Spaces

Map any combination of parameters to X, Y, and Z axes:

  • Physical positions (RA, Dec, distance)
  • HR diagram (temperature vs. luminosity)
  • Custom spaces — metallicity vs. radial velocity vs. galactic latitude

Visualize up to five dimensions simultaneously:

  • X, Y, Z → spatial axes
  • Color and brightness → two additional parameters
  • U, V, W → Motion animation as a sixth dimension

AI-assisted analysis: 

  • Ask the assistant to generate plots — displayed in VR and saved as PDF
  • Produce computed columns and HR diagrams with log-scaled axes
  • Real-time progress updates for long-running operations

Auto-computed quantities: If your CSV includes RA, Dec, and parallax, StarGateVR automatically derives XYZ coordinates, UVW velocities (with proper motion + radial velocity), absolute magnitudes, and color indices. See the CSV Input Data Format Reference for details.

Multi-Dimensional Gating

Select and filter star subsets across multiple parameter spaces:

  1. Identify an over-density in XYZ position — possible star cluster
  2. Gate those stars with a distinct color
  3. Switch to UVW velocity — check for common motion
  4. Add an HR diagram with metallicity — refine further

    Key capabilities: 

    • Multiple simultaneous gates, each with its own color
    • Gates preserved across space changes
    • AND operations to intersect multiple selections
    • Export gated subsets as CSV for follow-up analysis

    This is the intended workflow: explore in immersive 3D → identify candidates through iterative gating → export to TOPCAT, astropy, or your own pipelines.

    Collaborative Sessions

    Multiple researchers share a VR session with voice communication and synchronized data.

    • Co-navigate the same 3D environment in real time
    • StarGateVR taps the voice chat audio stream, so you switch between talking to colleagues and querying the AI without interruption
    • When one researcher enriches a dataset, results can be shared with all participants

    Supports group analysis, advisor-student walkthroughs, and distributed research collaboration.

    Custom Data & Workflow Integration

    Import your data: 

    • CSV, VOTable, or FITS-derived table formats
    • Load via Meta Link (drag and drop), headset browser download, or SideQuest
    • Cross-match and enrich imported data with all integrated archives

    Where StarGateVR fits:

    Tool Strength Limitation
    GaiaSky High-fidelity 3D rendering, up to a billion objects Primarily a viewer — no archive queries or voice interaction
    TOPCAT Powerful tabular analysis and cross-matching Desktop interface, no immersion
    StarGateVR 3D immersive visualization + live cross-matching + AI voice interface Exploration and hypothesis generation; not a replacement for quantitative analysis tools

    Use StarGateVR to explore, identify candidates, and enrich datasets — then export for deeper analysis in TOPCAT, astropy, or your own pipelines.

    AI Assistant — Early Adopter

    StarGateVR includes a voice-driven AI Assistant, currently available as an opt-in Early Adopter feature. In the app, tap “AI Assistant — Early Adopter” to reveal the interface.

    It works, and we’re actively developing it based on real researcher usage. You may encounter rough edges — that’s expected and intentional. Researchers who use it now are helping shape what it becomes.

    The assistant handles three types of requests:

    Ask about your data. Query statistics, distributions, or outliers in your currently loaded dataset. Select a star and ask “Tell me about this star” to retrieve catalog information from SIMBAD and other sources.

    Enrich with multi-wavelength data. Say “Add X-ray and infrared data for these stars” and the system:

    • Queries the relevant archives
    • Cross-matches by position or source ID
    • Merges the results into your dataset

    This is the voice-driven way to do the multi-wavelength cross-matching described above, one spoken request can pull from several archives at once.

    Retrieve new datasets by description. Say “Get me the stars in the Hyades cluster” and the system:

    • Recognizes this as a named stellar association/cluster membership request
    • Looks up the Hyades membership list through MocaDB
    • Retrieves the associated Gaia DR3 star data linked to those members
    • Loads the resulting star set into VR

    You describe what you want in plain language — you never see the underlying queries. The AI classifies your intent automatically. When a request is ambiguous, it asks for clarification.

    Real Data First

    The AI Assistant never generates scientific data. Every measurement — photometry, positions, spectral types, cross-match results — comes directly from established astronomical archives through deterministic queries.

    The LLM’s role:

    • Understand what you asked
    • Route it to the correct database
    • Return archive results — or an explicit null if there’s no match

    Where the assistant generates text (summarizing results, suggesting interpretations), the underlying data is always visible in the 3D environment for direct inspection. The system is designed around one distinction: “looked it up” vs. “made it up.”

    Research Applications

    These scenarios illustrate how StarGateVR’s AI Assistant, multi-wavelength cross-matching, and immersive gating work together in practice.

    Multi-wavelength candidate identification. Start with a catalog of hot white dwarfs. Ask the assistant to enrich with WISE mid-infrared photometry and look for infrared excess — a possible sign of a debris disk or low-mass companion. Add GALEX ultraviolet data to confirm the hot component, then pull eROSITA X-ray detections to check for coronal activity or accretion signatures. Gate on the IR-excess candidates in color–color space, switch to an HR diagram to verify their evolutionary status, and export the filtered subset for spectroscopic follow-up.

    • Combines four archives (Gaia + WISE + GALEX + eROSITA) in a single session
    • Iterative gating narrows candidates across parameter spaces
    • Exported CSV feeds directly into TOPCAT or astropy pipelines

    Stellar neighborhood exploration. Say “Get me stars within 5 parsecs of Vega” and the assistant resolves Vega’s coordinates via SIMBAD, constructs a 3D cone query against the Gaia Archive, and loads the results into VR. Fly through the local volume in physical XYZ space, switch to a velocity view (UVW) to identify co-moving groups, then enrich with SIMBAD spectral types to classify the neighbors. This is how you turn a single spoken sentence into an interactive 3D survey of a stellar neighborhood.

      • Natural-language query — no ADQL required
      • Automatic coordinate resolution, parallax constraints, and 3D positioning
      • Velocity animation reveals kinematic structure invisible in 2D charts

        Collaborative hypothesis testing. Two researchers share a VR session. One proposes that a spatial over-density is a dissolving open cluster; the other is skeptical. Together they gate the candidate members, switch to UVW velocity space to check for common motion, enrich with metallicity from Gaia DR3, and plot an HR diagram — all while discussing via the built-in voice channel. The AI Assistant hears both researchers and responds to whoever is asking. Within minutes they have a testable candidate list, exported and ready for publication-quality analysis.

          • Real-time shared exploration with synchronized data and voice
          • Hypothesis → evidence loop completed in a single session
          • Multi-dimensional gating builds the case (or breaks it) interactively

          Technical Documentation

          Looking for an educational experience?

          ConstellationsVR is our entry-level 3D astronomy app with a built-in AI Guide — designed for classrooms, STEM programs, and curious minds.

          Available on the Meta Quest Store.

          Do you need more performance overall?

          StarGateVR runs natively on Meta Quest, but for very large datasets, a Windows desktop version is available with higher memory and GPU-accelerated rendering.

          Contact support@immsci.com for details.

          Column naming conventions, auto-computed quantities, and supported file formats

          How intent classification, archive queries, and cross-matching work under the hood

          Supported query patterns, examples, and tips for effective voice interaction

          Quick guide to the VR user interface

          Publications

          Ryan W. Butler, Benjamin J. Ramsey , Thomas L. Skillman, Adin Pierce, Joel H. Kastner

          StarGateVR: A Tool for Immersive Virtual Reality Exploration of Astronomical Datasets

          Research Posters

          April 5th, 2023   |   Graduate Education Week Showcase

          Winner of the “People’s Choice Prize” at the Rochester Institute of Technology

          November 3rd, 2023   |  Ryan Butler, Joel Kastner, Tom Skillman

          An Analysis of the Pictoris Moving Group via Virtual Reality

          January 2024   |   Ben Ramsey, Joel Kastner, Alex Binks, and Tom Skillman

          Exploring NGC 2287:
          Insights from Gaia and TESS

          January 2024   |   Ryan Butler, Joel Kastner, Tom Skillman

          A Virtual Reality Based Analysis of the Beta Pictoris Moving Group

          If you have a question

          Please fill out this request

          Acknowledgements:  StarGateVRTM was developed by Immersive Science LLC, and refined through a collaboration with Rochester Institute of Technology, enabled by support to RIT from NASA’s Astrophysics Data Analysis Program.