New PySR Installation #593

Kacpiolo · 2024-04-02T21:39:51Z

Kacpiolo
Apr 2, 2024

Hello,

I have been trying to install PySR for over a day now and I have now troubleshooted this issue on 2 separate Windows machines (just in case). I am not sure what else to do.

Rundown:
I am using latest Spyder through Anaconda, Python 3.11.7 and IPython 8.20.0. I have trubleshooted using the pip and conda commands separately, both result in the same issues.

Issue 1). The first time importing pysr Julia is automatically installed if doesn't already exist:

[juliapkg] Locating Julia ~1.6.7, ~1.7, ~1.8, ~1.9, =1.10.0
[juliapkg] Querying Julia versions from https://julialang-s3.julialang.org/bin/versions.json
[juliapkg] WARNING: About to install Julia 1.10.0 to C:\Users\kok26\AppData\Local\anaconda3\julia_env\pyjuliapkg\install.
[juliapkg]   If you use juliapkg in more than one environment, you are likely to have Julia
[juliapkg]   installed in multiple locations. It is recommended to install JuliaUp
[juliapkg]   (https://github.com/JuliaLang/juliaup) or Julia (https://julialang.org/downloads)
[juliapkg]   yourself.
[juliapkg] Downloading Julia from https://julialang-s3.julialang.org/bin/winnt/x64/1.10/julia-1.10.0-win64.zip
             downloaded 0.2 MB of 164.5 MB
             downloaded 2.8 MB of 164.5 MB
             downloaded 16.3 MB of 164.5 MB
             downloaded 29.0 MB of 164.5 MB
             downloaded 41.6 MB of 164.5 MB
             downloaded 56.3 MB of 164.5 MB
             downloaded 79.3 MB of 164.5 MB
             downloaded 105.2 MB of 164.5 MB
             downloaded 128.0 MB of 164.5 MB
             downloaded 146.4 MB of 164.5 MB
             download complete
[juliapkg] Verifying download
Traceback (most recent call last):

  File ~\AppData\Local\anaconda3\Lib\site-packages\spyder_kernels\py3compat.py:356 in compat_exec
    exec(code, globals, locals)

  File c:\phd\year 3\turb mix\pysr\pysr_sct.py:4
    from pysr import PySRRegressor

  File ~\AppData\Local\anaconda3\Lib\site-packages\pysr\__init__.py:4
    from .julia_import import jl, SymbolicRegression  # isort:skip

  File ~\AppData\Local\anaconda3\Lib\site-packages\pysr\julia_import.py:38
    from juliacall import Main as jl  # type: ignore

  File ~\AppData\Local\anaconda3\Lib\site-packages\juliacall\__init__.py:251
    init()

  File ~\AppData\Local\anaconda3\Lib\site-packages\juliacall\__init__.py:158 in init
    CONFIG['exepath'] = exepath = juliapkg.executable()

  File ~\AppData\Local\anaconda3\Lib\site-packages\juliapkg\deps.py:303 in executable
    resolve()

  File ~\AppData\Local\anaconda3\Lib\site-packages\juliapkg\deps.py:241 in resolve
    exe, ver = find_julia(compat=compat, prefix=STATE['install'], install=True, upgrade=True)

  File ~\AppData\Local\anaconda3\Lib\site-packages\juliapkg\find_julia.py:87 in find_julia
    install_julia(info, prefix)

  File ~\AppData\Local\anaconda3\Lib\site-packages\juliapkg\install_julia.py:131 in install_julia
    buf = download_julia(f)

  File ~\AppData\Local\anaconda3\Lib\site-packages\juliapkg\install_julia.py:167 in download_julia
    raise Exception(f'SHA-256 hash does not match, got {sha256actual}, expecting {sha256}')

Exception: SHA-256 hash does not match, got ab596910ff0077c27e966bf1b4da0929d5b71ee569b7bde5b98de39751fbb685, expecting dc6e566772a0eed89df1bc63892802b1cb4ad92a2aacafa5e0e2be7a8cd93883

However, as seen above, it fails after Julia is downloaded. I checked the hashes on Julia website and the one that it 'got' doesn't seem to exist, whereas the one that it's 'excpeceting' is for the 1.10.0 version.

Issue 2). To solve the 1st issue, I installed Julia manually. Following that, few packages are installed and after that I get the following fatal errors:

I have tried this with Julia 1.10.2 (didn't work because it's not supported), 1.10.0 and 1.9.4. I get the same errors with both versions.

What should I do?

Thank you in advance.

MilesCranmer · 2024-04-03T01:48:12Z

MilesCranmer
Apr 3, 2024
Maintainer

Thanks for posting. It seems to be related to PythonCall.jl rather than PySR so could you make a bug report? Specifically to this repo: https://github.com/JuliaPy/PythonCall.jl/issues

Good idea installing it manually. Can you verify you can start up Julia and run some hello world program? If that works, it could simply be PythonCall can’t find it. You can set the Julia folder explicitly with some environment variables: https://juliapy.github.io/PythonCall.jl/stable/juliacall/#julia-config. Basically do os.environ["PYTHON_JULIACALL_BINDIR"] = "/your/path/to/julia/folder" before importing PySR.

4 replies

Kacpiolo Apr 3, 2024
Author

Thank you very much for the reply!

I can confirm that "hello world" does work in Julia and I have set the environment variable as suggested:

os.environ['PYTHON_JULIACALL_BINDIR'] = r'C:\Users\kok26\AppData\Local\Programs\Julia-1.10.0\bin'

from pysr import PySRRegressor
[juliapkg] Locating Julia ~1.6.7, ~1.7, ~1.8, ~1.9, =1.10.0
[juliapkg] Using Julia 1.10.0 at C:\Users\kok26\AppData\Local\Programs\Julia-1.10.0\bin\julia.EXE
[juliapkg] Using Julia project at C:\Users\kok26\AppData\Local\anaconda3\julia_env
[juliapkg] Installing packages:
           julia> import Pkg
           julia> Pkg.Registry.update()
           julia> Pkg.add([Pkg.PackageSpec(name="PythonCall", uuid="6099a3de-0909-46bc-b1f4-468b9a2dfc0d"), Pkg.PackageSpec(name="SymbolicRegression", uuid="8254be44-1295-4e6a-a16d-46603ac705cb"), Pkg.PackageSpec(name="Serialization", uuid="9e88b42a-f829-5b0c-bbe9-9e923198166b")])
           julia> Pkg.resolve()
           julia> Pkg.precompile()

fatal: error thrown and no exception handler available.
InitError(mod=:LibCURL_jll, error=ErrorException("could not load library "libcurl-4.dll"
The specified procedure could not be found. "))
ijl_errorf at C:/workdir/src\rtutils.c:77
ijl_load_dynamic_library at C:/workdir/src\dlload.c:388
#dlopen#3 at .\libdl.jl:117
dlopen at .\libdl.jl:116 [inlined]
dlopen at .\libdl.jl:116 [inlined]
__init__ at C:\workdir\usr\share\julia\stdlib\v1.10\LibCURL_jll\src\LibCURL_jll.jl:30
jfptr___init___96623.1 at C:\Users\kok26\AppData\Local\Programs\Julia-1.10.0\lib\julia\sys.dll (unknown line)
jl_apply at C:/workdir/src\julia.h:1982 [inlined]
jl_module_run_initializer at C:/workdir/src\toplevel.c:76
_finish_julia_init at C:/workdir/src\init.c:901
ijl_init_with_image at C:/workdir/src\jlapi.c:70 [inlined]
ijl_init_with_image at C:/workdir/src\jlapi.c:59 [inlined]
ijl_init_with_image__threading at C:/workdir/src\jlapi.c:100
ffi_call_win64 at C:\Users\kok26\AppData\Local\anaconda3\Library\bin\ffi.dll (unknown line)
ffi_call_go at C:\Users\kok26\AppData\Local\anaconda3\Library\bin\ffi.dll (unknown line)
ffi_call at C:\Users\kok26\AppData\Local\anaconda3\Library\bin\ffi.dll (unknown line)
DllCanUnloadNow at C:\Users\kok26\AppData\Local\anaconda3\DLLs\_ctypes.pyd (unknown line)
DllCanUnloadNow at C:\Users\kok26\AppData\Local\anaconda3\DLLs\_ctypes.pyd (unknown line)
unknown function (ip: 00007ffb45b76967)
PyObject_MakeTpCall at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyObject_Vectorcall at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalCode at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyWarnings_Init at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyWarnings_Init at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyCFunction_GetFlags at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyVectorcall_Function at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyObject_Call at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_GetFuncDesc at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyFunction_Vectorcall at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyBytes_Repeat at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyObject_CallMethodId_SizeT at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyObject_CallMethodObjArgs at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyImport_ImportModuleNoBlock at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyImport_ImportModuleLevelObject at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_SliceIndexNotNone at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalCode at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyWarnings_Init at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyWarnings_Init at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyCFunction_GetFlags at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyVectorcall_Function at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyObject_Call at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_GetFuncDesc at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyFunction_Vectorcall at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyBytes_Repeat at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyObject_CallMethodId_SizeT at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyObject_CallMethodObjArgs at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyImport_ImportModuleNoBlock at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyImport_ImportModuleLevelObject at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_SliceIndexNotNone at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalCode at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyWarnings_Init at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyWarnings_Init at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyCFunction_GetFlags at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyVectorcall_Function at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyObject_Call at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_GetFuncDesc at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyFunction_Vectorcall at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyBytes_Repeat at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyObject_CallMethodId_SizeT at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyObject_CallMethodObjArgs at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyImport_ImportModuleNoBlock at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyImport_ImportModuleLevelObject at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_SliceIndexNotNone at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalCode at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyWarnings_Init at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyWarnings_Init at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyGen_Finalize at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyGen_Finalize at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyGen_Finalize at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyGen_Finalize at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyGen_Finalize at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyGen_Finalize at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyFunction_Vectorcall at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyMethod_Self at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyVectorcall_Function at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyObject_Call at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_GetFuncDesc at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyGen_Finalize at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyGen_Finalize at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyGen_Finalize at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyGen_Finalize at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyGen_Finalize at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyGen_Finalize at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyGen_Finalize at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyGen_Finalize at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyGen_Finalize at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyGen_Finalize at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
unknown function (ip: 00007ffb2d6548ce)
unknown function (ip: 00007ffb2d654ffa)
unknown function (ip: 00007ffb2d65513c)
PyCFunction_GetFlags at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyContextVar_Reset at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyCFunction_GetFlags at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyVectorcall_Function at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyObject_Call at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_GetFuncDesc at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalCode at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyWarnings_Init at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyWarnings_Init at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyCFunction_GetFlags at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyBytes_Repeat at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyObject_Vectorcall at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyEval_EvalFrameDefault at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyFunction_Vectorcall at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyVectorcall_Function at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
PyObject_Call at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
Py_gitidentifier at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
Py_gitidentifier at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
Py_Main at C:\Users\kok26\AppData\Local\anaconda3\python311.dll (unknown line)
OPENSSL_Applink at C:\Users\kok26\AppData\Local\anaconda3\python.exe (unknown line)
BaseThreadInitThunk at C:\Windows\System32\KERNEL32.DLL (unknown line)
RtlUserThreadStart at C:\Windows\SYSTEM32\ntdll.dll (unknown line)

However, the first time it throws the errors shown above and all subsequent times I get the same errors before:

@MilesCranmer would you be able to suggest how I should proceed?

Thank you.

MilesCranmer Apr 3, 2024
Maintainer

Can you post a bug report in PythonCall.jl repo please?

The error looks to be about curl:

could not load library "libcurl-4.dll"
The specified procedure could not be found.

Maybe your windows is missing some library?

Kacpiolo Apr 3, 2024
Author

The problem seems to be related to Python 3.11.7. I have tried PySR with 3.9 (works but slow) and 3.11.5. PySR works with 3.11.5 as it should.

MilesCranmer Apr 3, 2024
Maintainer

Very odd. The error looks to come from Julia so I’m not sure why the Python version affects things.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

New PySR Installation #593

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 1 comment 4 replies

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

Select a reply

New PySR Installation #593

Kacpiolo Apr 2, 2024

Replies: 1 comment · 4 replies

MilesCranmer Apr 3, 2024 Maintainer

Kacpiolo Apr 3, 2024 Author

MilesCranmer Apr 3, 2024 Maintainer

Kacpiolo Apr 3, 2024 Author

MilesCranmer Apr 3, 2024 Maintainer

Kacpiolo
Apr 2, 2024

Replies: 1 comment 4 replies

MilesCranmer
Apr 3, 2024
Maintainer

Kacpiolo Apr 3, 2024
Author

MilesCranmer Apr 3, 2024
Maintainer

Kacpiolo Apr 3, 2024
Author

MilesCranmer Apr 3, 2024
Maintainer