Skip to content

Command-line utility to generate LLM-based Playwright tests

License

Notifications You must be signed in to change notification settings

vladikoff/playwright-ai

Repository files navigation

playwright-ai

Command-line utility to generate LLM-based Playwright tests

⚠️ Warning this tool is experimental and is still under development.

playwright-ai logo

Usage

Supported models:

  • Anthropic's Claude - configure API key with ANTHROPIC_API_KEY.
  • OpenAI's GPT3 and GPT4 - configure API key with OPENAI_API_KEY.

Quick start

npm -g playwright-ai
  • Obtrain the API key for the LLM model of your choice: Anthropic or OpenAI.
  • Execute the CLI from project directory:
playwright-ai --endpoint=https://example.com --model=claude --tests=1
  • After the CLI is done, it will generate the tests into the Playwright test directory. As the tests generate, the CLI will have both passing and failing tests. The failing tests will have to be manually fixed by the user of the tool.

playwright-ai demo

Core Options

--endpoint (-e) :: String

This option is required.

The endpoint option specifies the API endpoint to call. playwright-ai will browse to this endpoint and process it for generating the tests.

--model (-m) :: String

Default: gpt-4.

The LLM model to use to generate the tests. Available options: gpt-3, gpt-4, claude.

--tests (-t) :: Number

Default: 1.

Number of LLM-based tests to generate.

CLI Options

--help

Displays CLI command help.

---version

Shows CLI version.

Release History

See the CHANGELOG.md.

TODO

  • Support for other models
  • More complex test cases

License

MIT

About

Command-line utility to generate LLM-based Playwright tests

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published