Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug][GitLab] raw table is missing when collecting api trigger jobs #6892

Closed
2 of 3 tasks
d4x1 opened this issue Jan 29, 2024 · 3 comments · May be fixed by #6943
Closed
2 of 3 tasks

[Bug][GitLab] raw table is missing when collecting api trigger jobs #6892

d4x1 opened this issue Jan 29, 2024 · 3 comments · May be fixed by #6943
Labels
Stale type/bug This issue is a bug

Comments

@d4x1
Copy link
Contributor

d4x1 commented Jan 29, 2024

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

In #6167, CollectApiTriggerJobs was added, but in function GetAllPipelinesIterator, _raw_gitlab_api_trigger_job is used before this table was created.
And when I running a project with a gitlab connection, some errors happened.

time="2024-01-29 19:39:08" level=info msg=" [pipeline service] [pipeline #8] [task #59] executing subtask collectApiTriggerJobs"
time="2024-01-29 19:39:08" level=info msg="\x1b[31;1m/Users/houlinwei/Code/go/src/github.com/merico-dev/lake-feat-6854/backend/impls/dalgorm/dalgorm.go:188 \x1b[35;1mError 1146 (42S02): Table 'lake._raw_gitlab_api_trigger_job' doesn't exist\n\x1b[0m\x1b[33m[2.624ms] \x1b[34;1m[rows:-]\x1b[0m SELECT gp.gitlab_id, gp.gitlab_id as iid FROM _tool_gitlab_pipelines gp WHERE gp.project_id = 50751699 and gp.connection_id = 1 and gp.gitlab_id not in (select json_extract(tj.input, '$.GitlabId') as gitlab_id from _raw_gitlab_api_trigger_job tj)"
time="2024-01-29 19:39:08" level=error msg=" [pipeline service] [pipeline #8] [task #59] subtask collectApiTriggerJobs ended unexpectedly\n\tWraps: (2) Error 1146 (42S02): Table 'lake._raw_gitlab_api_trigger_job' doesn't exist (500)\n\tWraps: (3) Error 1146 (42S02): Table 'lake._raw_gitlab_api_trigger_job' doesn't exist\n\tError types: (1) *hintdetail.withDetail (2) *hintdetail.withDetail (3) *mysql.MySQLError"

What do you expect to happen

Run project sucessfully.

How to reproduce

Create a project with a gitlab connection, collect data.

Anything else

No response

Version

main

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct
@d4x1 d4x1 added the type/bug This issue is a bug label Jan 29, 2024
This was referenced Jan 29, 2024
Merged
Merged
@Marco-De-Stefani Marco-De-Stefani mentioned this issue Feb 8, 2024
Open
@Marco-De-Stefani
Copy link
Contributor

This should solve it, but I didn't have time to properly test it using GitLab. If someone can do it, I would appreciate it. In case not, I'll do it over the weekend

@github-actions GitHub Actions
Copy link

github-actions bot commented Apr 9, 2024

This issue has been automatically marked as stale because it has been inactive for 60 days. It will be closed in next 7 days if no further activity occurs.

@github-actions github-actions bot added the Stale label Apr 9, 2024
@github-actions GitHub Actions
Copy link

This issue has been closed because it has been inactive for a long time. You can reopen it if you encounter the similar problem in the future.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Stale type/bug This issue is a bug
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

fix 6892 - avoid adding clause when table not present Marco-De-Stefani/incubator-devlake
2 participants
@d4x1 @Marco-De-Stefani