Models output is scrambled in Safari Technology Preview, which has WebGPU support

[felladrin]

Just wanted to inform that I installed Safari Technology Preview to check its support for WebGPU and I noticed that the output of any model in Web-LLM appears scrambled like this:

And sometimes it just repeats the same word:

Screen.Recording.2024-05-02.mov

Although not urgent, it may be worth looking into it before the next major release of Safari.

[tqchen]

This is a known issue that we are working with the safari team to address https://bugs.webkit.org/show_bug.cgi?id=266793