Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Drastically increased memory load #1469

Open
leoniewgnr opened this issue Oct 26, 2023 · 0 comments
Open

Drastically increased memory load #1469

leoniewgnr opened this issue Oct 26, 2023 · 0 comments
Assignees

Comments

@leoniewgnr
Copy link
Collaborator

leoniewgnr commented Oct 26, 2023

Describe the bug
When running on Azure ML, the required RAM increases drastically when conditional seasonalities are added to the model. Not tested on local machine

To Reproduce
build basic model and then add something like this

# add conditional seasonality
m.add_seasonality(name='winter', period=1, fourier_order=6, condition_name='winter')
m.add_seasonality(name='summer', period=1, fourier_order=6, condition_name='summer')

Expected behavior
no drastically increase

Candidates for increased memory

df_copy = df.copy(deep=True)

OR
the for loop in time dataset takes very long and there could also be a lot of memory consumed:
self.combined_timedataset = [item for timedataset in timedatasets for item in timedataset]

Update: I am pretty sure that it is line 30 or line 31 because when profiling the memory consumption, memory increases by 20x in those two lines of code
Wihtin this function the main contributor is this:
def tabularize_univariate_datetime(

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment