New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Regression]: Artifacts created during test execution get random string in the name #30688
Comments
In which directories are you comparing them? We did a change but this should only have affected the
Do you consume them via |
Yes, we use the files outputted in the Can you please confirm that this change is only affecting file names? |
It only affects the test-results directory which is not intended to be consumed directly. Its intended to be consumed via our APIs, either inside a test via |
As Max mentioned you can implement a custom reporter and access all the images including their paths via
The change affected file names of the diff and actual images. Actual snapshot name stays the same. It can |
Last Good Version
1.42.1
First Bad Version
1.43.0
Steps to reproduce
This problem only seems to happen when a test case is having a "long" title. Started to happen in Playwright
1.43.0
.This issue breaks an update-snapshot use case for us, where we compare actual files with the current existing ones.
Expected behavior
Expects to get the full test case name:
Actual behavior
Actual result, the folder and file created contains random strings.
Additional context
No response
Environment
System: OS: Linux 6.6 Ubuntu 22.04.4 LTS 22.04.4 LTS (Jammy Jellyfish) CPU: (16) x64 Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz Memory: 5.86 GB / 7.75 GB Container: Yes Binaries: Node: 20.12.2 - /usr/bin/node Yarn: 1.22.22 - /usr/bin/yarn npm: 10.5.0 - /usr/bin/npm pnpm: 8.6.10 - /usr/bin/pnpm IDEs: VSCode: 1.89.0 - /vscode/vscode-server/bin/linux-x64/b58957e67ee1e712cebf466b995adf4c5307b2bd/bin/remote-cli/code Languages: Bash: 5.1.16 - /usr/bin/bash npmPackages: @playwright/test: 1.44.0 => 1.44.0
The text was updated successfully, but these errors were encountered: