Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add with_transform and/or set_transform to IterableDataset #6890

Open
not-lain opened this issue May 10, 2024 · 0 comments
Open

add with_transform and/or set_transform to IterableDataset #6890

not-lain opened this issue May 10, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@not-lain
Copy link

Feature request

when working with a really large dataset it would save us a lot of time (and compute resources) to use either with_transform or the set_transform from the Dataset class instead of waiting for the entire dataset to map

Motivation

don't want to wait for a really long dataset to map, this would give IterableDataset an extra advantage over the Dataset class.
reducing time and resources

Your contribution

I am a little busy with my job search lately, but would post about this feature in my social media.
Apologies again (dad going to kick me out soon), if I ever have some free time I will contribute to making this a reality, but that's going to be hard
    / (┬┬﹏┬┬)\

@not-lain not-lain added the enhancement New feature or request label May 10, 2024
@not-lain not-lain changed the title add with_transform and/or set_transform to **IterableDataset** add with_transform and/or set_transform to IterableDataset May 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant