Get started with building apps for spatial computing
Get started with building apps for spatial computing
This video goes over the fundamentals of Spatial Computing, Where to Start, and How to Build
Fundamentals
- Shared Spaces (Where App stay side by side)
- Windows (A single Apps can have multiple windows)
- Volumes (A volume that displays 3D content more immersively)
- Full Space (Where only your App is Available)
- Passthrough (Where you allow the world to come into your full space)
- Full Immersion (Allow for hand gestures and Spatial Audio)
- Interact
- Eyes and Hands Input
- Taps, long presses, drags
- Skeletal hand tracking
- Wireless devices
- Eyes and Hands Input
- Shareplay
- Sync the same entity, reinforce being in the same place
- For More See Design spatial SharePlay experiences and Build spatial SharePlay experience
- Privacy
- Privacy-first design
- Provides curated data and interactions to the app
- Ask for clear permission
- All the tools you need
- Use XCode
- Preview (Help view your SwiftUI Code)
- Simulator (Test your app)
- Debugger (Visualizations to help identify Collsion shapes, surfaces, etc)
- Instruments (Actionable insight into your running application and optimize your application)
- Reality Composer Pro - preview and prepare 3D content for your application
- To update material for objects Explore materials in Reality Composer Pro
- To learn more see Meet Reality Composer Pro
- Alternatively Use Unity
- Use XCode
Where to Start
- Brand new app
- For more information see Develop your first immersive app
- See code samples
- Existing app
- iPhone and iPad apps are fully adaptable, select as destination device
- For more see Run your iPad and iPhone apps in the Shared Space
- iPhone and iPad apps are fully adaptable, select as destination device
How to build
- Goes over the project World
- Introductions to 3D Model, Volumes, Windows, immersion, shared space
- Windows
- Available with SwiftUI
- 2D and 3D Content
- Scale and Position
- Use with WindowGroup, Model3D
- Volume
- Extension of a window
- Ideal for 3D content
- Can host multiple views
- Built for the Shared Space
- Use with windowStyle(.volumetric) on your WindowGroup
- RealityView
- SwiftUI view with Entities
- RealityKit and SwiftUI deeply integrated
- Coordinate space conversion
- SwiftUI Attachments
- Attach pin onto a globe
- For more Info:
- Spaces
- Full Space
- Focus is on your app
- Place app content anywhere
- Interact iwth your surroundings
- Build custom hand interactions Meet ARKit for spatial computing
- Different level of immersion
- Passthrough <-> Fully Immersion
- .mixed <-> .progressive <-> .full
- Full Space
- Windows
- Introductions to 3D Model, Volumes, Windows, immersion, shared space