Skip to content

Use Intake #87

Open
Open

Description

@martindurant

A light suggestion that people here may want to consider expressing this collection of data-sets using Intake, which is a cataloging standard allowing you to describe the metadata and way-to-load for data in a single browsable, searchable spec, e.g., a YAML file. This is, for instance, what the pangeo collaboration does. Most of their data is in zarr or other xarray-compatible formats, so you would also need intake-astro to enable loading FITS data from remote files, with local caching if desired, and lazy-loading with Dask.

Activity

  1. pllim commented on Dec 29, 2020

    @pllim
    Member

    Thank you for the suggestion! Unfortunately, the current maintainers are stretched pretty thin to investigate this option. If you are interested to implement a proof-of-concept for this new solution, we would be happy to review your PR and continue the discussion there.

  2. pllim commented on Feb 9, 2023

    @pllim
    Member

    Looks like scipy uses pooch now but even that seems a little heavyweight for our purpose here. 🤷

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions