Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add appProtocol to agent service to allow agent to work with istio #5240

Open
wants to merge 4 commits into
base: master
Choose a base branch
from

Conversation

noahjax
Copy link
Contributor

@noahjax noahjax commented Apr 17, 2024

Why are the changes needed?

If you try to use an agent on a cluster with istio, flytepropeller is unable to connect to the agent. You will either need to remove the agent from flytepropeller's configmap or flytepropeller will fail on startup.

Connecting to flyteconsole is also broken in istio because missing appProtocol prevents some http ports from working correctly.

What changes were proposed in this pull request?

Specify an appProtocol that istio can use to determine how to proxy requests (see here for more details on how this works).

Update: I also modified the flyteadmin and flyteconsole services so that they will work with istio as well. More extensive changes are necessary to get everything working, but I will split those into a separate PR as they are likely more controversial

How was this patch tested?

Tested on my flyte deployment with istio enabled for the whole cluster.

Setup process

Screenshots

Check all the applicable boxes

  • I updated the documentation accordingly.
  • All new and existing tests passed.
  • All commits are signed-off.

Related PRs

Docs link

Signed-off-by: noahjax <noah.jackson@dominodatalab.com>
@noahjax noahjax marked this pull request as ready for review April 17, 2024 00:07
@dosubot dosubot bot added size:XS This PR changes 0-9 lines, ignoring generated files. enhancement New feature or request labels Apr 17, 2024
@ddl-ebrown
Copy link
Contributor

I think you just need to run the local tools to update the generated files and such:

HELM_SKIP_INSTALL=true make helm

Signed-off-by: noahjax <noah.jackson@dominodatalab.com>
@dosubot dosubot bot added size:S This PR changes 10-29 lines, ignoring generated files. and removed size:XS This PR changes 0-9 lines, ignoring generated files. labels Apr 17, 2024
@@ -40,6 +40,7 @@ spec:
- name: agent-grpc
port: 8000
protocol: TCP
appProtocol: TCP
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🙌

@noahjax noahjax marked this pull request as draft April 17, 2024 18:00
Signed-off-by: noahjax <noah.jackson@dominodatalab.com>
@noahjax noahjax marked this pull request as ready for review April 19, 2024 21:43
@dosubot dosubot bot added size:M This PR changes 30-99 lines, ignoring generated files. and removed size:S This PR changes 10-29 lines, ignoring generated files. labels Apr 19, 2024
Signed-off-by: noahjax <noah.jackson@dominodatalab.com>
@noahjax noahjax force-pushed the noahjax.add-appProtocol-to-agent branch from 14660e5 to bbcefcd Compare April 26, 2024 17:20
Copy link

codecov bot commented Apr 29, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 58.15%. Comparing base (7287470) to head (bbcefcd).
Report is 33 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #5240      +/-   ##
==========================================
- Coverage   58.60%   58.15%   -0.46%     
==========================================
  Files         568      204     -364     
  Lines       51121    15429   -35692     
==========================================
- Hits        29958     8972   -20986     
+ Misses      18748     5627   -13121     
+ Partials     2415      830    -1585     
Flag Coverage Δ
unittests ?

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@pingsutw
Copy link
Member

pingsutw commented May 6, 2024

@noahjax could you run make helm locally, and push it again?

@Future-Outlier
Copy link
Member

@noahjax could you run make helm locally, and push it again?

@noahjax Maybe we need to try make helm;make helm_update;

@ddl-ebrown
Copy link
Contributor

I'll take this one over too and try to update tomorrow. Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request size:M This PR changes 30-99 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants