Help Desk#

Where to look for help#

If you have questions or need help with OME-Zarr, you can get the most up-to-date information through the following channels:

Where

Description

When to use

Image.sc Forum

A community forum for image analysis and bioimaging.

To know when to use the tags ngff, ome-ngff, and ome-zarr in the forum please read Landing Page, Glossary and FAQs in this page.

ome/ngff GitHub Issues

The official repository for OME-NGFF specifications and related discussions.

For reporting bugs, suggesting features, or discussing technical aspects of the OME-NGFF specifications.

Office Hours

Regularly scheduled virtual meetings where you can ask questions and get help from the NGFF community

Office hours rotate between APAC/AU/EU- and AMER/AU/EU-friendly times. Join them when you want to chat about OME-Zarr. Read more in the Community page.

OME-Zarr libraries GitHub Issues

Various repositories for OME-Zarr libraries.

For issues specific to a particular OME-Zarr library, use the respective GitHub repository’s issue.

In person events

Conferences, workshops, and meetups where you can connect with the NGFF community.

To network, learn, and discuss OME-Zarr in person. Check the Community page for upcoming events.

FAQs#

First, we are sharing some high-value questions, that once lived in the NGFF landing page, to then proceed with a more comprehensive list of FAQs.

NGFF vs OME-Zarr, what is the difference?#

OME-Zarr is the file format that the NGFF community has settled on to address issues of scalability and interoperability described below.

NGFF is the community-driven process for designing the next generation of bioimaging formats. NGFF brings together the community to define shared specifications, metadata standards, and best practices. OME-Zarr implements those decisions, providing a practical, open, and scalable way to store and share modern microscopy data. As the NGFF specifications evolve, OME-Zarr evolves with them — ensuring the format reflects the needs and experience of the wider community.

What is an OME-Zarr?#

An OME-Zarr is a file format optimized for storing, viewing, & sharing large images. There are two parts to an OME-Zarr:

  • The “Zarr” part describes how the pixel data for the images are laid out. Zarr is a next-generation data format used for scientific datasets in multiple domains.

  • The “OME” part describes metadata about the pixel data. OME stands for Open Microscopy Environment. This includes metadata such as:

    • spatial relationships

    • high content screening data

    • well data

    • and more!

Why would I use OME-Zarr?#

In general, OME-Zarr is growing as a default FAIR choice for storing and sharing microscopy images.

OME-Zarr files have two major benefits:

  • Standardization: “OME-Zarr” is a “Zarr” with embedded standardized metadata in the Open Microscopy Environment (OME) format.

    • Sharing: It eases cross-organization file sharing, aiding organizational collaboration and data sharing. Repositories like the Image Data Resource and BioImage Archive are currently migrating to having OME-Zarr as a standard format for all their data.

    • Interoperability: Standardized metadata enables the ability to “mix and match” tools from different organizations, benefiting from the strengths of multiple tools as needed.

  • Parallel access: Chunking is inherent to “Zarr” files. This means “Zarr” files are stored in independently-accessible blocks.

    • Storage: Microscopy images can be quite large and can therefore reach Cloud system storage limits for individual files; the chunked nature of a Zarr can alleviate this issue. Some storage systems may also duplicate byte-equivalent files, so a chunked file like Zarr may save storage space.

    • Viewing: Viewers can target specific chunks to load based upon the current view, reducing lag, & enabling massive images to be viewed within browsers.

    • Cost: When viewing or reading data, the total cost of accessing a Zarr file on the cloud may be less than a more monolithic file format due to the more efficient data access patterns. Ex. A viewer can just access the chunks of the image it needs to display rather than the entire image.

Of note, both benefits contribute to AI-readiness: the standardized metadata & access patterns provide a common layer for machine-learning workflows, reducing the friction for developers to build and test models.

The tools, data, and ecosystem may provide a better sense of the range of scientific use cases that may benefit from OME-Zarr. The publications page provides a list of publications that have used OME-Zarr in their work.

When would I not use OME-Zarr?#

While the format matures, it may be frustrating to use OME-Zarr in some cases, for example:

  • If you are working with small images, not planning to share them and your current tools already work well, then using OME-Zarr may not be necessary. Planned expansions to the specification (such as single-file Zarrs) will make it more convenient in these scenarios.

  • If you need specific conditions for which OME-Zarr support is not mature, you may need to use a different file format.

    • Particularly, if your original file is lossy compressed, you will see a large increase in file size (about an order of magnitude) as the images are decompressed into OME-Zarr, since transferring lossy compressed tiles is not yet supported. This currently impacts most whole slide image (WSI) formats such as SVS, CZI, and NDPI, which are lossy JPEG compressed by default.

Who is using OME-Zarr?#

These are some of the organizations (and their dataset pages) that are using OME-Zarr for their data.

How do I use OME-Zarr?#

Other FAQs#

1. Why OME-Zarr as a format?

OME-Zarr brings many benefits over traditional file formats, such as proprietary ones or OME-TIFF: a few examples are excellent performance, suitability to current research data needs, cloud-friendliness, a dedicated community of developers, and AI-readiness.

2. What problems does it solve?

The two largest problems that led to the initial development of OME-Zarr are data streaming and metadata interoperability. Imaging data has been suffering with increasingly large files, and downloading all of a dataset to view a small part of it was a common issue aggravated by data sizes. Meanwhile, the microscopy community has long had to deal with inconsistent metadata between file formats. OME-Zarr also brings a standardized access protocol to imaging data, and offers a format that is ready to be adopted by repositories and archives.

3. What is the future of OME-Tiff?

OME-TIFF is not going anywhere anytime soon - a lot of legacy data exists in that format and there are no deprecation plans. However, community and developer support is increasingly limited, performance can be an issue, and the intrinsic data and metadata structures in those files are fairly limited. Further, Adobe owns the TIFF license.

4. Is a converter not enough?

Conversion tools are a first step in a long-term transition to OME-Zarr. Ideally, data producers and vendors would initially enable translation of their file formats to OME-Zarr, then transitioning to providing export and import options, before fully adopting the new format.

5. What are the benefits for adopting such a format compared to my own?

A standardized file format provides many advantages compared to a bespoke, “home-grown” one. A wider developer base means increased stability and interoperability, benefitting the final user experience. Community support decreases the burden on any one individual and reduce development costs. Finally, OME-Zarr is uniquely suited for the modern research environment and AI-ready.

6. What are the downsides of moving to OME-Zarr from my own format?

As with any initiative involving community consensus, feature adoption and scope definitions can be comparatively slower, and allow for less individual ownership of the format itself. A rich ecosystem of tools and implementations also mean these can be both deep and broad, sometimes increasing the difficulty for finding the “right ones” for a given problem.

7. Does this format work for non-microscopy data too?

OME-Zarrs are, by definition, Zarr files with added structures defined by the OME community. These structures have been defined and developed to attend to the needs of the microscopy community, but are by no means limited to those. If you work on other kinds of large multidimensional arrays and you find the OME-Zarr metadata structures useful for your work, great! You might also need different kinds of structures; if you believe these would also be useful for a broader community, engaging with the RFC process is always welcome; otherwise, you might want to consider “pure” Zarr.

8. Is OME-Zarr a stable format?

OME-Zarr is (still) an evolving specification. Large breaking changes (i.e. changes in the binary storage format) are not currently planned for the future, but the metadata standards can (and will) evolve in ways that might be backwards-incompatible until an 1.0 release. A conversion path between versions until 1.0 is possible.

9. What’s the difference between OME, OMERO, OME-Zarr, and just Zarr?

  • OME: community developing many open-source microscopy software projects

  • OMERO: one of such projects. a data management platform that uses the OME data model to unify data from many file formats

  • OME-Zarr: the file format that the community has settled on to address issues of scalability and interoperability

  • Zarr: the “base” file format upon which OME-Zarr builds. A general solution for storing large multidimensional arrays with the same advantages of OME-Zarr, but with fewer mechanisms to describe and annotate microscopy data.

10. Is OME-Zarr AI-ready?

Yes! The chunked nature of OME-Zarr and its focus on being cloud-native are particularly well-suited for tasks such as ML algorithms where individual inputs are of a small size, but large parallelism is necessary. OME-Zarr allows for excellent performance on both parallel reads and writes, while simplifying data management compared to individually managing thousands of small files.

11. I want to convert all my data to OME-Zarr right now. Can I safely delete my proprietary files and be sure I am not losing information?

Not yet. Pixel data is safe, but the metadata completeness is still a current issue. Vendors need to export their metadata fully, and we as a community need to push for this.

12. Are OME-Zarr files larger than proprietary ones?

That is often the case. OME-Zarr include multiresolution data (i.e. pyramids), which adds data. This is optional, but performance without pyramids suffer. There is a trade-off between file size and user experience in this case.

13. Does OME-Zarr support sparse arrays and layers?

Not yet fully. Some workarounds are possible (1D arrays, mesh formats), but this is an active area of development.

Glossary#

Jump to: A · B · C · D · E · F · G · H · I · J · K · L · M · N · O · P · Q · R · S · T · U · V · W · X · Y · Z


A#

Array - A collection (or list) or multiple items. For example, OME-Zarr files store image data as multi-dimensional arrays (meaning lists of lists of numbers).

Back to top

B#

Back to top

C#

Chunk - A chunk in OME-Zarr is an independent section of pixel data that has been separated so that it can be accessed separately from other pixel data.

Codecs - Codecs are the algorithms that compress and decompress chunks. They shrink the data to save space and speed up loading, and then restore it when you read it. Different codecs offer different trade-offs between size, speed, and image quality, but NGFF lets you choose the one that works best for your data.

Back to top

D#

Back to top

E#

Back to top

F#

Back to top

G#

Back to top

H#

HCS - Dedicated layout of OME-Zarr files representing the used wells and plates for High Content Screening (HCS). The layout allows a user to efficiently address and analyze specific data from specific wells.

HDF5 - Hierarchical Data Format version 5 (HDF5). It is a data model, file format, and library for organizing, storing, and managing large and complex data.

Back to top

I#

Back to top

J#

JSON file - A simple standardized human-readable data format for sharing data using nested key-value pairs.

Back to top

K#

Back to top

L#

Back to top

M#

Multiscale - Multiscale means storing the same image at multiple resolutions (full size, half size, quarter size, etc.). This makes it easy for tools to zoom and navigate very large images quickly—just like how map apps load lower-resolution versions first, then sharpen the view as you zoom in.

Back to top

N#

NGFF - Next Generation File Format (NGFF) is a community for solving problems related to producing open-source software for microscopy data.

Back to top

O#

OME - Open Microscopy Environment is a consortium of universities, research labs, industry and developers producing open-source software and format standards for microscopy data.

OMERO - OMERO is a data management platform for storing, organizing, and sharing microscopy images. To learn more about OMERO, visit the OMERO guides webpage.

OME-NGFF - OME-NGFF refers to the resulting efforts of the OME & NGFF communities.

OME-Zarr - An OME-Zarr is a standardized file format for microscopy images. More details on the main page.

Back to top

P#

Processing Unit - A Processing Unit is an independent section of data that a process (like image analysis) can be run on separately. For OME-Zarr images, a processing unit could be a sub-set of the image, the entire image, or multiple images.

Back to top

Q#

Back to top

R#

RFC - Request For Comments (RFC) is a process for proposing a change to the standardized specification for OME-Zarr files.

Back to top

S#

Shard/ing - Like Chunks, sharding is a way of breaking up pixel data for more efficient access. Shards are groups of chunks in a single object with headers describing the chunks inside.

Back to top

T#

Transformation - Transformations describe how to place one array in the same coordinate space as another—for example, how a label mask lines up with its image, or how a lower-resolution level relates to the full-resolution one. They provide the mathematical rules (like shifts, scaling, or rotations) that let software correctly align and overlay different pieces of data.

Back to top

U#

Back to top

V#

Back to top

W#

Workflow - A structured sequence of tasks designed to achieve a specific goal. In the case of OME-Zarr, a workflow is some sequence of tasks usually used for performing some type of analysis on the image data.

Back to top

X#

Back to top

Y#

Back to top

Z#

Zarr – A file format, see the main page for more information about what a Zarr is and the benefits of using Zarr.

Zarr Group - A Zarr group is like a folder inside a dataset. It can hold arrays, metadata, or other groups, helping organize complex data into a clear hierarchy. Think of it as a way to keep all related images and information neatly together.

Back to top

If you think any term is missing or needs to be updated, please open a PR to the ngff-website repository.