Dose Genie support handling multiple requests

[anke1460]

i have the same question , but not one answered

[essenciary]

This is probably better moved into discussions as it's not an issue.

Genie supports handling multiple requests (in parallel). Always did. However, Julia supports multiple types of parallelism: https://docs.julialang.org/en/v1/manual/parallel-computing/

By default, Genie runs each request as an async task / coroutine - so each request will be handled non-blocking, but on the same CPU core.

We have the feature ready to also process the requests multi-threaded (on distinct workers/cpu cores) but it needs to be merged. It's actually been available for a while, but my tests haven't shown any performance benefit from running the requests multi-threaded vs async, so it kind of fell behind.