'3D Gaussian Splatting for Real-Time RF Rendering' rose to the 2nd challenge I presented. The magnifying glass isn't still crystal clear, but the result is compelling. Look at the small details/hairs on the succulent plant. Rendered in real-time. #gaussiansplatting #3D #AI

In this iteration, I’ve added @AIatMeta’s SAM 2 to our workflow to segment people. Lisa and I had fun testing it in our lab—striking poses in sequence, with our bodies precisely isolated for a refined Stable Diffusion effect. #MR #AI #Passthrough @MetaforDevs

Just updated my MR + Diffusion prototype to use @MetaQuestVR Meta’s Passthrough Camera API. It’s a raw port for now; next, I'll focus on UX exploration. It’s now much easier to do a screen recording. #MR #AI #Passthrough @MetaHorizonDevs

Time to update my Quest MR + Gen AI prototype now that @MetaQuestVR Camera API is out — This proto is using a workaround to capture passthrough snapshots, processes them with Stable Diffusion, and displays the results back in their exact physical location. #MR #AI

Daylight saving — Spring is coming — Mixed Reality + Stable Diffusion. #MR #AI #StableDiffusion

I tried the XGrids Lixel L2 Pro thanks to Skytech and @XGRIDS2023. This scanner is quite impressive. Here is a capture, rendered as 3D GS, of the staircase of our building I captured while going up the levels. #3dscanning #gaussiansplats #gaussiansplatting #digitaltwin

It won't take long before we'll be able to "reskin reality" in real-time. I had the chance to try this prototype that combines the #MixedReality view on a Quest device with Stable Diffusion AI and it feels like all the pieces are about to fit together... Special thanks to @smallfly , Chief of Innovation at Dpt. for sharing this early version.

Square version :)

Mixed Reality + Stable Diffusion — Trying to escape the winter.⁣ ⁣ #MR #AI #StableDiffusion⁣

Mixed Reality + Stable Diffusion — AI Urbex #MR #AI #StableDiffusion #urbex #Quest3 #madewithunity

Mixed Reality + Stable Diffusion — How my desk might look after years of being abandoned.  #MR #AI #StableDiffusion #Quest3 #madewithunity

MR + Stable Diffusion Patchwork #MR #AI #StableDiffusion #Quest3

I really like this use case: quickly capturing a series of spatial snapshots of my surroundings, resulting in an alternate reality patchwork once processed w/ a SD workflow.⁣ The snapshots, not being perfectly aligned, create a sense of depth. #MR #AI #StableDiffusion #Quest3

Mixed Reality Diffusion — Captured snapshots from the Quest 3 passthrough feed are processed in real-time with a Stable Diffusion workflow and displayed back on the Quest.⁣ ⁣ #MR #AI #StableDiffusion #ComfyUI #Quest3 #meta #madewithunity

[02/02] Took my MR Diffusion experiment outdoors in -23°C! Quick tests since I deployed the img2img Diffusion workflow on @runpod_io. Even though it’s running on an RTX4090, perf. isn’t as on my local rig—in part b/c I'm in MTL while the server is in OR. #MR #AI #StableDiffusion

[01/02] Took my MR Diffusion experiment outdoors in -23°C! Quick tests since I deployed the img2img Diffusion workflow on @runpod_io. Even though it’s running on an RTX4090, perf. isn’t as on my local rig—in part b/c I'm in MTL while the server is in OR. #MR #AI #StableDiffusion