Issues in Querying LLM and Augmenting Holograms

[yichez16]

Hi,

I followed the instructions and successfully deployed the application on my HoloLens 2, connecting it to my servers on the PC.

Then, the Sigma voice assistant popped up. However, no matter what I asked, it only responded with, "Sorry, I don't understand that."

Here is my environment variable setup:

This is my sigma server setup:

This is my client app setup:

I also uploaded the key to the Hololens 2 Document folder:

I also want to explore how to augment holograms onto real-world objects, as shown in your paper. However, I couldn’t find any code or instructions implementing this.

I really appreciate any help or guidance from you.

Thanks,
Yicheng

[sandrist]

Hi Yicheng, can you try visualizing a collected store in PsiStudio? Visualizing the data streams will make it easier to debug where something is going wrong. You can check that the audio is coming through and sounds right, and check if there are any speech recognition results. If there are speech recognition results, you can check their contents to better understand what Sigma thinks it is hearing.