Change default anti-affinity to required mode

[vatsalparekh]

Issue: #45422

Problem

As described in the issue, the preferredDuringSchedulingIgnoredDuringExecution makes scheduler schedule all the pods on the first available node, changing this to requiredDuringSchedulingIgnoredDuringExecution will make the schedule wait in pending till the 2nd node to comes up

Solution

change anti-affinity to requiredDuringSchedulingIgnoredDuringExecution

Testing

Engineering Testing

Manual Testing

Automated Testing

• Test types added/modified:
  • Unit
  • Integration (Go Framework)
  • Integration (v2prov Framework)
  • Validation (Go Framework)
  • Other - Explain: EXPLAIN
  • None
  • REMOVE NOT APPLICABLE BULLET POINTS ABOVE
• If "None" - Reason: EXPLAIN THE REASON
• If "None" - GH Issue/PR: LINK TO GH ISSUE/PR TO ADD TESTS

Summary: TODO

QA Testing Considerations

Regressions Considerations

TODO

Existing / newly added automated tests that provide evidence there are no regressions:

• TODO