Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make it easier to write/update integration tests #1414

Closed
li-boxuan opened this issue Apr 27, 2024 · 2 comments
Closed

Make it easier to write/update integration tests #1414

li-boxuan opened this issue Apr 27, 2024 · 2 comments
Assignees
Labels
severity:medium Problems that affect many users

Comments

@li-boxuan
Copy link
Collaborator

          @li-boxuan it would be awesome if you could run something like
REGENERATE_TEST_FILES=true poetry run python ./opendevin/main.py -i 10 -t "Write a shell script 'hello.sh' that prints 'hello'." -c "MonologueAgent" -d "./workspace"

Originally posted by @rbren in #1347 (comment)

@li-boxuan
Copy link
Collaborator Author

Ideally, the program should extract the task from the test file, run opendevin, and then copy the logs and place them into correct test artifacts folders.

@li-boxuan li-boxuan self-assigned this Apr 30, 2024
@rbren rbren added the severity:medium Problems that affect many users label May 2, 2024
@li-boxuan
Copy link
Collaborator Author

Already addressed in PR #1608

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
severity:medium Problems that affect many users
Projects
None yet
Development

No branches or pull requests

2 participants