Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Run NVTabular Single GPU tests for CUDA 11 and 12 on RAPIDS Runner #1829

Draft
wants to merge 83 commits into
base: main
Choose a base branch
from
Draft

Run NVTabular Single GPU tests for CUDA 11 and 12 on RAPIDS Runner #1829

wants to merge 83 commits into from

Conversation

oliverholworthy
Copy link
Member

@oliverholworthy oliverholworthy commented Jun 2, 2023 •
edited

Run NVTabular Single GPU tests for CUDA 11 and 12 on RAPIDS Runner

Adds two new jobs to gpu-tests.yml

  • gpu-tests-cu11
    • pip version of cudf and dask-cudf 23.04 with Python 3.8 and CUDA Toolkit 11.8
  • gpu-tests-cu12
    • pip version of cudf/dask-cudf 23.06 with Python 3.9 and CUDA Toolkit 12.1

@oliverholworthy oliverholworthy added this to the Merlin 23.06 milestone Jun 2, 2023
@oliverholworthy oliverholworthy self-assigned this Jun 2, 2023
@github-actions
Copy link

github-actions bot commented Jun 2, 2023

Documentation preview

https://nvidia-merlin.github.io/NVTabular/review/pr-1829

@review-notebook-app
Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.

Powered by ReviewNB

@oliverholworthy
Add separate env for CUDA 11 and CUDA 12
c1de4d8
@oliverholworthy
Set protobuf implementation env var
40a6062
@oliverholworthy
remove cudnn and protobuf package from install
781b635
@oliverholworthy
Update tox env name in gpu-tests.yml
d7a304e
@oliverholworthy
Replace np.bool with bool
9100b5b
@oliverholworthy
Replace np.long with int in data_gen
08619d8
@oliverholworthy
Remove invalid comment from deps
5602f68
@oliverholworthy
Run GPU tests with CUDA 12
6ca1d5a
@oliverholworthy
Install libcudnn8 package for tensorflow GPU support
15d4ee2
@oliverholworthy
Remove unused numpy import from fill.py
98c3a3e
@oliverholworthy
Use Python 3.9 for cu12 gpu test environment
cede7d1
@oliverholworthy
Run compute before merge in test_embedding_cat_export_import
b92777e
@oliverholworthy
Add tensorflow pytest merk to example notebook 1 and 2
a2d285e
@oliverholworthy
Debug: run only workflow test
2f9db24
@oliverholworthy
Debug: print dataframes in test_workflow
91f4de5
@oliverholworthy
debug: print train_df
afc0ce9
@oliverholworthy
Remove use of merge (results in non-deterministic row ordering)
4f4e746 
DataFrames merges in cuDF result in non-deterministic row ordering
https://docs.rapids.ai/api/cudf/stable/api_docs/api/cudf.dataframe.merge/
@oliverholworthy
remove train_df
8220231
@oliverholworthy
Restore posargs default in gpu tox envs
4604f63
@oliverholworthy
Restore multi-gpu test job and tox envirionment
ccfeda6
@oliverholworthy oliverholworthy changed the title Test Running NVTabular GPU tests with RAPIDS Runner Run NVTabular Single GPU tests for CUDA 11 and 12 on RAPIDS Runner Jun 29, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@oliverholworthy oliverholworthy

Labels
ci
Projects
None yet
Milestone
Merlin 23.07
Development

Successfully merging this pull request may close these issues.

None yet
1 participant
@oliverholworthy