Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[timeseries] Show model hyperparmeters in the leaderboard #4152

Open
shchur opened this issue Apr 30, 2024 · 3 comments
Open

[timeseries] Show model hyperparmeters in the leaderboard #4152

shchur opened this issue Apr 30, 2024 · 3 comments
Labels
enhancement New feature or request module: timeseries related to the timeseries module
Milestone

Comments

@shchur
Copy link
Collaborator

shchur commented Apr 30, 2024

Description

It should be possible to view the model hyperparameters after HPO is performed. For example, this can be done via the TimeSeriesPredictor.leaderboard method, similar to how TabularPredictor.leaderboard returns such information when extra_info=True.

@shchur shchur added enhancement New feature or request module: timeseries related to the timeseries module labels Apr 30, 2024
@shchur
Copy link
Collaborator Author

shchur commented Apr 30, 2024

Here is a workaround that can be used in v1.1 to get this information

def get_hyperparameters(model_name: str) -> dict:
    model = predictor._trainer.load_model(model_name)
    if hasattr(model, "most_recent_model"):
        model = model.most_recent_model
    return model._get_params()

leaderboard = predictor.leaderboard()
leaderboard["hyperparameters"] = [get_hyperparameters(m) for m in leaderboard["model"]]

@dany4142
Copy link

Can we please add it as a feature?

@shchur shchur added this to the 1.2 Release milestone May 2, 2024
@shchur
Copy link
Collaborator Author

shchur commented May 2, 2024

@dany4142 we will try to include it in the v1.2 release.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request module: timeseries related to the timeseries module
Projects
None yet
Development

No branches or pull requests

2 participants