Skip to content

Latest commit

 

History

History
96 lines (65 loc) · 2.87 KB

README.md

File metadata and controls

96 lines (65 loc) · 2.87 KB
Raw

Check out the next project ARFoundationReplay, which supports URP, Record/Replay and Google Geospatial.

ARKit Streamer

OpenUPM

A remote debugging tool for AR Foundation with ARKit4 features. This is temporary solution until the Unity team has completed the AR remote functionality - See Unity forum for more information.

img1
Human segmentation

img2
Sample with VFX Graph

Environments

  • Tested on Unity 2020.3.36f1
  • ARFoundation 4.2.3
  • iPhone X or more

Supporting ARKit features

  • Basic camera position tracking
  • Send camera image via NDI
  • Human Segmentation / Depth
  • Face
  • Plane tracking
  • 3D body tracking

How to Install

Install NDI SDK

Depends on NDI (Network Device Interface), download the NDI SDK for iOS from https://ndi.tv/sdk/

Install dependencies

Open the file Packages/manifest.json and add following lines into scopedRegistries and dependencies section.

{
  "scopedRegistries": [
    {
      "name": "Unity NuGet",
      "url": "https://unitynuget-registry.azurewebsites.net",
      "scopes": [ "org.nuget" ]
    },
    {
      "name": "npm",
      "url": "https://registry.npmjs.com",
      "scopes": [
        "jp.keijiro",
        "com.koki-ibukuro"
      ]
    }
  ],
  "dependencies": {
    "com.koki-ibukuro.arkitstream": "0.5.2",
    ...// other dependencies
  }
}

How to Use

Set up Sender iPhone

Download this repository and build/install on iPhone. Then run the app on iPhone.

Or you can simply add ARKitSender to your custom ARKit scene.
Imgur

Open the project settings and enable "ARKit Stream" as an XR plug-in for Unity Editor. fig

Recommend using USB connected network instead of Wi-Fi to reduce network delay.
Imgur

Simulate on Editor

Add ARKitReceiver to the scene which you want to simulate on Editor. Make sure that there are ARKitSender and ARKitReceiver in the scene.

See the Assets/Sample for more information.

Setting for LWRP / URP

If you use LWRP / URP, you need also add the ARBackgroundRemoteRendererFeature to the list of render features. See AR Foundation Document for more information.

Imgur

Dependent Libraries