// Docs

Optional dependencies

Install Refiner extras for specific readers and workflows

Install extras based on the data and operations you use.

ExtraEnables
allIncludes every extra below; useful for testing and development.
datasetsHugging Face dataset reader support; includes hf.
hfHugging Face Hub APIs and HF filesystem helpers.
hand_trackingHand tracking with ego-vision.
hdf5HDF5 reader support.
lanceLance readers, writers, and distributed schema evolution.
zarrZarr reader and writer support.
mcapMCAP robotics log reader support, including ROS2, protobuf, and H.264 video decoding.
videoVideo decode/write support.
textCommon Crawl text readers.
s3S3 filesystem support.
gcsGoogle Cloud Storage filesystem support.
tensorflowTensorflow support.
tfdsTensorflow datasets support.

Examples:

pip install macrodata-refiner[hf,video]pip install macrodata-refiner[datasets]pip install macrodata-refiner[hdf5,zarr]pip install macrodata-refiner[mcap]pip install macrodata-refiner[lance]pip install macrodata-refiner[hand_tracking]