Skip to content
This repository has been archived by the owner on Jun 6, 2024. It is now read-only.

Update hived request generation in rest-server #5419

Open
hzy46 opened this issue Apr 12, 2021 · 0 comments · May be fixed by #5428
Open

Update hived request generation in rest-server #5419

hzy46 opened this issue Apr 12, 2021 · 0 comments · May be fixed by #5428
Assignees
@hzy46

Comments

@hzy46
Copy link
Contributor

hzy46 commented Apr 12, 2021 •
edited

new schema in OpenPAI job protocol:

extras:
  gangAllocation: true/false
  hivedscheduler:
    jobPriorityClass: crit | prod | test (default) | oppo
    taskRoles:
     <taskrole_name>:
        pinnedCellId: string | null (default)
        # if resourcePerInstance doesn't exist, we should calculate it from 
        # config.taskroles.<taskrole_name>.resourcePerInstance, and use null as skuType
        resourcePerInstance:
          skuNum: number 
          skuType: string | null (default)
       withinOne: string | null (default)
    taskRoleGroups:
        # we don't allow single group: length of taskRoles must be > 1 
        # we don't allow overlap
      - taskRoles: [master, worker]
         withinOne: string | null

Remaining question:

  • will extras.gangAllocation have any effect? - use the same behavior as before
  • should we modify api/v2/cluster/sku-types - should provide a new api which returns all cell chain
  • IgnoreK8sSuggestedNodes?
@hzy46 hzy46 self-assigned this Apr 12, 2021
@hzy46 hzy46 linked a pull request Apr 16, 2021 that will close this issue
Open
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@hzy46 hzy46

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Update hived request generation in rest-server microsoft/pai
1 participant
@hzy46