[SYCL] Intel SYCL runtime support for AutoGPTQ

[abhilash1910]

Hello @PanQiWei . @qwopqwop200 , @fxmarty .Greetings from Intel. Thanks for creating AutoGPTQ.

Considering adoption of more SYCL runtime across different vendors and specifically for Intel accelerators, this is an effort to upstream the cuda kernels for (gemm/non gemm quants) to SYCL runtime . This is an approach taken to further extend Intel accelerator support as well as provide an alternative compiler runtime for non cuda specific devices.

The proposal is to extend SYCL runtime through DPCT toolchain and to support a standard runtime for different vendors.
Since the idea is to provide better sycl compiler characterization, this PR would help enable the framework for a wide range of accelerators working on SYCL runtime.S
An initial kernel prototype is added, and further extension kernels will be ported to support SYCL backend in next couple of days. (Draft mode).
An extended idea: (if community is interested) SYCL maintenance will be extended by myself (team) and external contributors and depending upon support received we plan to integrate nv/amd and other vendor support for SYCL runtime for AutoGPTQ.

[Qubitium]

@abhilash1910 Is SYCL compatible with amd x86_64? also curious if this would be a good candidate replace all the current qigen code?

[abhilash1910]

Hi @Qubitium , yes there is experimental support for amdgcn architecture , and we have to specify the build target from fsycl to point to that. I will be picking things up from next week as was out of office this week.