Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MetalFX upscaling on device to improve visual clarity/latency. #36

Open
panthurrr opened this issue Feb 11, 2024 · 2 comments
Open

MetalFX upscaling on device to improve visual clarity/latency. #36

panthurrr opened this issue Feb 11, 2024 · 2 comments
Labels
enhancement New feature or request

Comments

@panthurrr
Copy link
Contributor

MetalFX has two upscaling types for visionOS which may improve the overall clarity and latency compared to native. SpatialScaler requires less data to configure and should let us know if temporal scaling is worth adding.

https://developer.apple.com/documentation/metalfx/

@shinyquagsire23 shinyquagsire23 added the enhancement New feature or request label Feb 12, 2024
@xuhao1
Copy link

xuhao1 commented Mar 23, 2024

Yes I have tried this, see #97
However, due to the bandwidth limitation, visual effects does not change a lot.

@panthurrr
Copy link
Contributor Author

It might be necessary to apply MSAA prior to upscaling for more noticeable benefits

I started to add this based on apple's apple's sample code:
https://developer.apple.com/documentation/metal/metal_sample_code_library/improving_edge-rendering_quality_with_multisample_antialiasing_msaa

had some challenges with the resolve textures matching at the time though this was a long time ago now.

Will look into this more now that you've got upscaling added, thanks for the addition!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants