Skip to content

imclab/Apple-Vision-PRO-AR-VR-XR-AI

Repository files navigation

AR VR XR AI code, resources & research

Apple Vision Pro - VisionOS - Swift - Unity3D - Polyspatial - Unreal Engine - ARkit - A.I.

Code, education & research at the intersection of virtual & real, empowering:

  • Collaborative creativity, gaming & education
  • Radical new forms of XR storytelling
  • Powerful new forms of expression
  • Big data visualization
  • Problem solving
  • Magic & play

a438ce65-b962-4ac6-aaf7-2d66373e2039-1

HelloVisionOS

A variety of demos to test all the new features Unity visionOS Platform features including PolySpatial Mixed Reality experiences.

📌 Get Started With Unity visionOS PolySpatial Tools! (Apple Vision Pro Development) step-by-step video available here.

Demo Unity Scenes (Features) 🎮

Bounded Volume Camera MR Demo:
Demo of what's included with HelloVisionOS_Bounded.unity scene.

📙 Unity visionOS & PolySpatial Resources:

Overview

Spatial computing is THE next major paradigm shift

Moving from tiny screens to VR to AR to R(eality) Broadening horizons & augmenting life and Transforming us & the universe forever. 282232367-6ec3583f-4422-40a3-b105-a16013c8b985

Apple Vision Pro Headset

Apple Vision Pro is a groundbreaking AR headset.
Watch Overview Video

Pricing and Availability: Starting at $3,499, available early next year in the U.S.
More details

Get Vision Pro

Order Vision Pro from Apple or apply for developer kit

https://developer.apple.com/visionos/developer-kit/Apple Vision Pro developer kit Have an innovative idea for an app or game for visionOS that requires building and testing on Apple Vision Pro? Apply for an Apple Vision Pro developer kit. This kit will help you deliver amazing spatial experiences by letting you quickly build, iterate, and test on Vision Pro.

Get XCode & Unity Polyspatial

https://developer.apple.com/xcode/ https://create.unity.com/spatial Get started with spatial creation Be the first to create for Apple’s visionOS platform Unity is excited to collaborate with Apple to bring familiar and powerful authoring tools for creating immersive games and apps for this new spatial computing platform, Apple Vision Pro. Your apps will get access to benefits such as pass-through and Dynamic Foveated Rendering, in addition to popular Unity features like AR Foundation and XR Interaction Toolkit.

VisionOS

The operating system for Apple Vision Pro. Use visionOS with familiar tools to build immersive apps and games.

Features

  • Windows: Create with SwiftUI, add 3D content.
  • Volumes: Use RealityKit or Unity for 3D experiences.
  • Spaces: Shared Space for side-by-side apps, Full Space for immersive experiences.

1_iiLBjfJiyR2pTv8AWCUx9A

Developing for visionOS: Requires a Mac with Apple silicon.
Get started with visionOS

Overview Developing for visionOS requires a Mac with Apple silicon. Create new apps using SwiftUI to take full advantage of the spectrum of immersion available in visionOS. If you have an existing iPad or iPhone app, add the visionOS destination to your app’s target to gain access to the standard system appearance, and add platform-specific features to create a compelling experience. To provide continuous access to your content in the meantime, deliver a compatible version of your app that runs in visionOS.

Expand your app into immersive spaces Start with a familiar window-based experience to introduce people to your content. From there, add SwiftUI scene types specific to visionOS, such as volumes and spaces. These scene types let you incorporate depth, 3D objects, and immersive experiences.

Build your app’s 3D content with RealityKit and Reality Composer Pro, and display it with a RealityView. In an immersive experience, use ARKit to integrate your content with the person’s surroundings.

People can select an element by looking at it and tapping their fingers together. They can also pinch, drag, zoom, and rotate objects using specific hand gestures. SwiftUI provides built-in support for these standard gestures, so rely on them for most of your app’s input. When you want to go beyond the standard gestures, use ARKit to create custom gestures. Screenshot 2023-11-11 at 4 52 07 AM

Get Apple's Code

These run XCode & Simulator with no need for a device yet. Dive into featured sample apps Explore the core concepts for all visionOS apps with Hello World. Understand how to detect custom gestures using ARKit with Happy Beam. Discover streaming 2D and stereoscopic media with Destination Video. And learn how to build 3D scenes with RealityKit and Reality Composer Pro with Diorama and Swift Splash.

Hello World Use windows, volumes, and immersive spaces to teach people about the Earth. Hello-World-intro@2x

Destination Video Leverage 3D video and Spatial Audio to deliver an immersive experience. Destination-Video-intro@2x

Happy Beam Leverage a Full Space to create a fun game using ARKit. Happy-Beam-intro@2x

Diorama Design scenes for your visionOS app using Reality Composer Pro. Diorama-intro@2x

Swift Splash Use RealityKit to create an interactive ride in visionOS. Swift-Splash-intro@2x

Create immersive Unity apps

Explore how you can use Unity to create engaging and immersive experiences for visionOS. We'll share how Unity integrates seamlessly with Apple frameworks, take you through the tools you can use to build natively for the platform, and show you how volume cameras can bring your existing scenes into visionOS windows, volumes, and spaces. Discover how to incorporate visionOS features like passthrough and scene understanding, customize your visuals with Shader Graph, and adapt your interactions to work with spatial input. https://developer.apple.com/videos/play/wwdc2023/10088

Principles of spatial design

Discover the fundamentals of spatial design. Learn how to design with depth, scale, windows, and immersion, and apply best practices for creating comfortable, human-centered experiences that transform reality. Find out how you can use these spatial design principles to extend your existing app or bring a new idea to life.

skinned-mesh-sampling-example banner001

Demo 68747470733a2f2f692e696d6775722e636f6d2f546b31496c4f622e676966

https://github.com/imclab/Vision-PRO-AR-VR-XR-AI/assets/391299/cd42ae1d-d4c4-432f-ab17-a6405a279280 shared-spaces~dark@2x

ntugrid_neg

1_EFbxxoPRymjGCYUshrrvcQ

overview@2x

Join Our Discord Check Our Gram
https://discord.gg/6QkcjWkT3P https://www.instagram.com/theimclab
Untitled toppng com-instagram-logo-icon-social-media-icon-png-and-vector-make-money-on-instagram-quick-start-guide-small

Awesome visionOS

Awesome Apple visionOS related content

Contents

Prototypes

Github Repos

Twitter Posts

Other Sources

Learn

Online Courses

YouTube Tutorials

Github Repos

Twitter Posts

Podcasts

Online Communities

Newsletter

People To Follow

XR Concepts

Concept work not necessarily specific to Apple Vision Pro but interesting nonetheless

Device Hardware & Software

Critique

Speculation

### Video Tutorials

Left-aligned Right-aligned
git status git status
git diff git diff
hqdefault(38) hqdefault(37)
hqdefault(36) hqdefault(35)
hqdefault(33) hqdefault(32)
hqdefault(31) hqdefault(30)
hqdefault(29) hqdefault(28)
hqdefault(27) hqdefault(26)
hqdefault(25) hqdefault(24)
hqdefault(23)
hqdefault(22)
hqdefault(21)
hqdefault(20)
hqdefault(19)
hqdefault(18)
hqdefault(17)
hqdefault(16)
hqdefault(15)
hqdefault(14)