Skip to content

LLM Perplexity Evaluation #198

LLM Perplexity Evaluation

LLM Perplexity Evaluation #198

Triggered via schedule May 9, 2024 12:06
Status Failure
Total duration 41m 4s
Artifacts 6

llm-ppl-evaluation.yml

on: schedule
llm-cpp-build  /  check-linux-amx-artifact
2s
llm-cpp-build / check-linux-amx-artifact
llm-cpp-build  /  check-linux-avx512-artifact
2s
llm-cpp-build / check-linux-avx512-artifact
llm-cpp-build  /  check-linux-avxvnni-artifact
4s
llm-cpp-build / check-linux-avxvnni-artifact
llm-cpp-build  /  check-windows-avx-artifact
0s
llm-cpp-build / check-windows-avx-artifact
llm-cpp-build  /  check-windows-avx-vnni-artifact
0s
llm-cpp-build / check-windows-avx-vnni-artifact
llm-cpp-build  /  check-windows-avx2-artifact
0s
llm-cpp-build / check-windows-avx2-artifact
set-matrix
0s
set-matrix
llm-cpp-build  /  linux-build-amx
1m 2s
llm-cpp-build / linux-build-amx
llm-cpp-build  /  linux-build-avx512
2m 21s
llm-cpp-build / linux-build-avx512
llm-cpp-build  /  linux-build-avxvnni
2m 13s
llm-cpp-build / linux-build-avxvnni
llm-cpp-build  /  windows-build-avx
0s
llm-cpp-build / windows-build-avx
llm-cpp-build  /  windows-build-avx-vnni
0s
llm-cpp-build / windows-build-avx-vnni
llm-cpp-build  /  windows-build-avx2
0s
llm-cpp-build / windows-build-avx2
Matrix: llm-ppl-evaluation
llm-ppl-summary
10s
llm-ppl-summary
llm-ppl-html
0s
llm-ppl-html
Fit to window
Zoom out
Zoom in

Annotations

11 errors and 19 warnings
llm-ppl-evaluation (3.11, Baichuan2-7B-Chat, sym_int4, 512, xpu)
Process completed with exit code 1.
llm-ppl-evaluation (3.11, Baichuan2-7B-Chat, fp8, 512, xpu)
Process completed with exit code 1.
llm-ppl-evaluation (3.11, chatglm2-6b, sym_int4, 512, xpu)
Process completed with exit code 1.
llm-ppl-evaluation (3.11, chatglm3-6b, fp8, 512, xpu)
Process completed with exit code 1.
llm-ppl-evaluation (3.11, falcon-7b-instruct-with-patch, fp8, 512, xpu)
Process completed with exit code 1.
llm-ppl-evaluation (3.11, falcon-7b-instruct-with-patch, sym_int4, 512, xpu)
Process completed with exit code 1.
llm-ppl-evaluation (3.11, Llama-2-7b-chat-hf, sym_int4, 512, xpu)
Process completed with exit code 1.
llm-ppl-evaluation (3.11, Mistral-7B-v0.1, fp8, 512, xpu)
Process completed with exit code 1.
llm-ppl-evaluation (3.11, Mistral-7B-v0.1, sym_int4, 512, xpu)
Process completed with exit code 1.
llm-ppl-evaluation (3.11, mpt-7b-chat, fp8, 512, xpu)
Process completed with exit code 1.
llm-ppl-evaluation (3.11, mpt-7b-chat, sym_int4, 512, xpu)
Process completed with exit code 1.
llm-cpp-build / linux-build-amx
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@f43a0e5ff2bd294095638e18286ca9a3d1956744, actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
llm-cpp-build / linux-build-avxvnni
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@f43a0e5ff2bd294095638e18286ca9a3d1956744, actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
llm-cpp-build / linux-build-avx512
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@f43a0e5ff2bd294095638e18286ca9a3d1956744, actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
llm-ppl-evaluation (3.11, Baichuan2-7B-Chat, sym_int4, 512, xpu)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@f43a0e5ff2bd294095638e18286ca9a3d1956744, actions/setup-python@v4, actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
llm-ppl-evaluation (3.11, Baichuan2-7B-Chat, fp8, 512, xpu)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@f43a0e5ff2bd294095638e18286ca9a3d1956744, actions/setup-python@v4, actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
llm-ppl-evaluation (3.11, chatglm2-6b, fp8, 512, xpu)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@f43a0e5ff2bd294095638e18286ca9a3d1956744, actions/setup-python@v4, actions/download-artifact@v3, actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
llm-ppl-evaluation (3.11, chatglm2-6b, sym_int4, 512, xpu)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@f43a0e5ff2bd294095638e18286ca9a3d1956744, actions/setup-python@v4, actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
llm-ppl-evaluation (3.11, chatglm3-6b, fp8, 512, xpu)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@f43a0e5ff2bd294095638e18286ca9a3d1956744, actions/setup-python@v4, actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
llm-ppl-evaluation (3.11, falcon-7b-instruct-with-patch, fp8, 512, xpu)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@f43a0e5ff2bd294095638e18286ca9a3d1956744, actions/setup-python@v4, actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
llm-ppl-evaluation (3.11, chatglm3-6b, sym_int4, 512, xpu)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@f43a0e5ff2bd294095638e18286ca9a3d1956744, actions/setup-python@v4, actions/download-artifact@v3, actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
llm-ppl-evaluation (3.11, falcon-7b-instruct-with-patch, sym_int4, 512, xpu)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@f43a0e5ff2bd294095638e18286ca9a3d1956744, actions/setup-python@v4, actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
llm-ppl-evaluation (3.11, Llama-2-7b-chat-hf, sym_int4, 512, xpu)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@f43a0e5ff2bd294095638e18286ca9a3d1956744, actions/setup-python@v4, actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
llm-ppl-evaluation (3.11, Mistral-7B-v0.1, fp8, 512, xpu)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@f43a0e5ff2bd294095638e18286ca9a3d1956744, actions/setup-python@v4, actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
llm-ppl-evaluation (3.11, Mistral-7B-v0.1, sym_int4, 512, xpu)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@f43a0e5ff2bd294095638e18286ca9a3d1956744, actions/setup-python@v4, actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
llm-ppl-evaluation (3.11, mpt-7b-chat, fp8, 512, xpu)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@f43a0e5ff2bd294095638e18286ca9a3d1956744, actions/setup-python@v4, actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
llm-ppl-evaluation (3.11, mpt-7b-chat, sym_int4, 512, xpu)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@f43a0e5ff2bd294095638e18286ca9a3d1956744, actions/setup-python@v4, actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
llm-ppl-evaluation (3.11, Llama-2-7b-chat-hf, fp8, 512, xpu)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@f43a0e5ff2bd294095638e18286ca9a3d1956744, actions/setup-python@v4, actions/download-artifact@v3, actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
llm-ppl-summary
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@f43a0e5ff2bd294095638e18286ca9a3d1956744, actions/setup-python@v4, actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Deprecation notice: v1, v2, and v3 of the artifact actions
The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "linux-amx", "linux-avx", "linux-avx2", "linux-avx512", "linux-avxvnni", "ppl_results". Please update your workflow to use v4 of the artifact actions. Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/

Artifacts

Produced during runtime
Name Size
linux-amx
7.14 MB
linux-avx
2.17 MB
linux-avx2
2.11 MB
linux-avx512
4.09 MB
linux-avxvnni
18.6 MB
ppl_results
514 Bytes