Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[tabular] Kaggle GPU leads to exception with best_quality #4164

Open
Innixma opened this issue May 3, 2024 · 1 comment
Open

[tabular] Kaggle GPU leads to exception with best_quality #4164

Innixma opened this issue May 3, 2024 · 1 comment
Labels
bug Something isn't working env: kaggle Questions related to Kaggle module: tabular priority: 0 Maximum priority resource: GPU Related to GPU
Milestone

Comments

@Innixma
Copy link
Contributor

Innixma commented May 3, 2024

An exception is raised if using a GPU Kaggle notebook and specifying best_quality preset.

User Report using a Kaggle P100 GPU Notebook.

This is probably due to dynamic stacking's sub-fit process in Ray. It might also be due to any usage of Ray. We should test both on Kaggle and locally.

Error log:

Starting holdout-based sub-fit for dynamic stacking. Context path is: AutogluonModels/ag-20240501_091619/ds_sub_fit/sub_fit_ho.
/opt/conda/lib/python3.10/site-packages/requests/__init__.py:109: RequestsDependencyWarning: urllib3 (2.1.0) or chardet (None)/charset_normalizer (3.3.2) doesn't match a supported version!
  warnings.warn(
2024-05-01 09:16:19,705    INFO util.py:124 -- Outdated packages:
  ipywidgets==7.7.1 found, needs ipywidgets>=8
Run `pip install -U ipywidgets`, then restart the notebook server for rich notebook output.
2024-05-01 09:16:21,761    ERROR services.py:1330 -- Failed to start the dashboard , return code -11
2024-05-01 09:16:21,763    ERROR services.py:1355 -- Error should be written to 'dashboard.log' or 'dashboard.err'. We are printing the last 20 lines for you. See 'https://docs.ray.io/en/master/ray-observability/ray-logging.html#logging-directory-structure' to find where the log file is.
2024-05-01 09:16:21,765    ERROR services.py:1399 -- 
The last 20 lines of /tmp/ray/session_2024-05-01_09-16-19_717749_24/logs/dashboard.log (it contains the error message from the dashboard): 
2024-05-01 09:16:21,701    INFO head.py:254 -- Starting dashboard metrics server on port 44227
@Innixma Innixma added module: tabular env: kaggle Questions related to Kaggle resource: GPU Related to GPU priority: 1 High priority labels May 3, 2024
@Innixma Innixma added this to the 1.2 Release milestone May 3, 2024
@Innixma Innixma added bug Something isn't working priority: 0 Maximum priority and removed priority: 1 High priority labels May 3, 2024
@mglowacki100
Copy link
Contributor

It looks similar to this issue: #3365

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working env: kaggle Questions related to Kaggle module: tabular priority: 0 Maximum priority resource: GPU Related to GPU
Projects
None yet
Development

No branches or pull requests

2 participants