Skip to content

Issues: argonne-lcf/dlio_benchmark

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

30 Open 41 Closed
30 Open 41 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Looks like the benchmark is not calculating client memory sizes correctly in the datasize command for scale out client testing
#193 opened May 24, 2024 by danlchilton
Generating a Cosmoflow dataset is very slow
#187 opened May 5, 2024 by Linzsd
generating indexed_binary files causes kernel OOM to kill process
#181 opened Apr 8, 2024 by krehm
ValueError: batch_size=None option disables auto-batching and is mutually exclusive with drop_last
#180 opened Apr 5, 2024 by arcturus5340
dlio_benchmark_test.py segfaults on second benchmark test
#179 opened Apr 3, 2024 by krehm
4
IO does not appear to be asynchronous with the compute phase
#178 opened Apr 3, 2024 by crtierney
1
The samples of tfrecord in dali dataloader are not actually read from storage
#177 opened Mar 23, 2024 by yxkyong
10
Question about the difference between dali vs. native_dali for the data_loader
#176 opened Mar 22, 2024 by crtierney
2
Is it possible to select a specific disk on which to run the benchmark?
#175 opened Mar 20, 2024 by shp776
2
DataLoader num_workers > 0 causes CPU memory from parent process to be replicated in all worker processes
#165 opened Mar 11, 2024 by sethiay
Emulate GPU without sleep
#161 opened Mar 8, 2024 by spitzcor
Seems like different threads are reading some overlapping files in torch data loader
#149 opened Feb 15, 2024 by sethiay
@hariharan-devarajan
12
any way to profile memory usage in dlio?
#141 opened Jan 23, 2024 by krehm
18
Adding S3 support when PyTorch framework is selected.
#138 opened Jan 12, 2024 by zhenghh04
@zhenghh04 @hariharan-devarajan
7
Validating Magatron-DeepSpeed
#134 opened Jan 9, 2024 by zhenghh04
@zhenghh04 @hariharan-devarajan
Validating DLRM config
#133 opened Jan 9, 2024 by zhenghh04
@zhenghh04
container run issue with exec format error
#132 opened Jan 8, 2024 by pankajd-57
@hariharan-devarajan
3
logs not getting written when multiprocessing_context is spawn or forkserver
#131 opened Dec 26, 2023 by krehm
4
No support for different sample types in same data format
#122 opened Dec 6, 2023 by wvaske
@hariharan-devarajan
4
Spark support
#106 opened Oct 24, 2023 by zhenghh04
@zhenghh04 @hariharan-devarajan
1
Persistent Pytorch workers
#101 opened Oct 10, 2023 by hariharan-devarajan
Docker image error: " File system scheme 's3' not implemented. "
#87 opened Sep 20, 2023 by ekaynar
1
Support for DALI, pytorch, and tensorflow reader enhancement New feature or request
#80 opened Jul 29, 2023 by hariharan-devarajan
1
@hariharan-devarajan
Queries needed for building processing scripts using dlio-profiler log.
#75 opened Jun 22, 2023 by hariharan-devarajan
@zhenghh04
2
Fix IOStat to conform to our dlio_profiler code. enhancement New feature or request
#71 opened Jun 19, 2023 by hariharan-devarajan
@hariharan-devarajan
1
ProTip! What’s not been updated in a month: updated:<2024-04-27.