Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

build(deps): Included data job version in vdk-core/src/vdk/internal/builtin_plugins/run/job_input.py #3000

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

s0sharma
Copy link

@s0sharma s0sharma commented Jan 6, 2024

As part of job_input.get_execution_properties(), I added a way to get the data job version.

Now you can see the data job version too.

@vmwclabot
Copy link
Member

@s0sharma, you must sign our contributor license agreement before your changes are merged. Click here to sign the agreement. If you are a VMware employee, read this for further instruction.

@s0sharma s0sharma changed the title Included data job version in job_input.get_execution_properties() #1246 Included data job version in job_input.get_execution_properties() Jan 6, 2024
@s0sharma s0sharma changed the title Included data job version in job_input.get_execution_properties() <vdk-core>-vdk versatile-data-kit Included data job version in job_input.get_execution_properties() Jan 6, 2024
@s0sharma s0sharma changed the title <vdk-core>-vdk versatile-data-kit Included data job version in job_input.get_execution_properties() support Included data job version in job_input.get_execution_properties() Jan 6, 2024
@s0sharma s0sharma changed the title support Included data job version in job_input.get_execution_properties() build(deps): Included data job version in job_input.get_execution_properties() Jan 6, 2024
@s0sharma s0sharma changed the title build(deps): Included data job version in job_input.get_execution_properties() build(deps): Included data job version in vdk-core/src/vdk/internal/builtin_plugins/run/job_input.py Jan 6, 2024
@murphp15
Copy link
Collaborator

murphp15 commented Jan 8, 2024

@s0sharma thanks for this contribution!!!
Always great to have new ppl working on the project!
Would you be able to sign CLA above?
Were you able to test this change?

@@ -182,6 +183,9 @@ def get_execution_properties(self) -> dict:
"pa__job_start_unixtime": str(int(start_time.timestamp())),
"pa__job_start_ts_expr": f"cast ({start_time.timestamp()} as timestamp)",
"pa__op_id": self.__statestore.get(CommonStoreKeys.OP_ID),
"pa__job_version": self.__statestore.get(
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you be sure that it is always there?
Is it there even when ppl run a job locally?

@antoniivanov
Copy link
Collaborator

Hi @s0sharma , would you be able to complete this change? Do you have any questions?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants