Skip to content
@webdataset

webdataset

High Performance I/O for Large Scale Deep Learning

Popular repositories

  1. webdataset webdataset Public

    A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.

    Python 2k 153

  2. tarp tarp Public

    Fast and simple stream processing of files in tar files, useful for deep learning, big data, and many other applications.

    Go 113 15

  3. WebDataset.jl WebDataset.jl Public

    A high performance I/O library for deep learning in Julia, based on the PyTorch WebDataset library

    Julia 9 1

  4. wdsconversions wdsconversions Public

    conversions of standard pytorch datasets to webdataset format

    Jupyter Notebook 1

Repositories

Showing 4 of 4 repositories
  • webdataset Public

    A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.

    Python 2,001 BSD-3-Clause 153 89 7 Updated May 19, 2024
  • WebDataset.jl Public

    A high performance I/O library for deep learning in Julia, based on the PyTorch WebDataset library

    Julia 9 MIT 1 0 46 Updated Apr 1, 2024
  • tarp Public

    Fast and simple stream processing of files in tar files, useful for deep learning, big data, and many other applications.

    Go 113 15 6 3 Updated Dec 10, 2023
  • wdsconversions Public

    conversions of standard pytorch datasets to webdataset format

    Jupyter Notebook 0 1 0 0 Updated Aug 20, 2022

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…