Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conformal Prediction in NeuralForecast #995

Open
valeman opened this issue May 9, 2024 · 1 comment
Open

Conformal Prediction in NeuralForecast #995

valeman opened this issue May 9, 2024 · 1 comment

Comments

@valeman
Copy link

valeman commented May 9, 2024

Description

It would be great to have Conformal Prediction in NeuralForecast, similar to statsforecast and mlforecast.

Use case

No response

@JQGoh
Copy link
Contributor

JQGoh commented May 16, 2024

@AzulGarza
I am interested to contribute for the implementation of Conformal Prediciton in NeuralForecast

I checked the implementations in Statforecast/MLForecast, considering to to follow your implementation for _add_conformal_distribution_interval and _add_conformal_error_intervals

However, I also noticed that NeuralForecast has quantiled outputs when we specify loss such as MQLoss (as suggested by quantiles_to_outputs). If users specify conformal prediction interval and use MQLoss, think we shall need to handle this properly such that how should we present the quantiled outputs to the users.

My current thought is when users specify Conformal Prediction parameter, we can compute the prediction intervals using the -median result returned by MQLoss during the cross-validation, while raising a warning to remind the users that the outputs are computed following the Conformal Prediction scheme.

I am rather new to Conformal Prediction and would love to hear from Nixtla's team feedback on this.
cc: @elephaint noticed your recent work on Implicit Quantile Networks, which might be relevant.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants