@panopolycapture

Making Live hologram capture for #AR #VR #XR accessible to everyone! Using Apple Lidar, Microsoft Kinects, and other cameras & AI

 London, England
panopo.ly
Joined August 2014
  • Tweets90
  • Following3
  • Followers85
52Media
panopo.ly/?qmrp Some big web speed-ups; I think I can confidently say this playback is pretty smooth. iphone SE doesn't even heat up any more.
1
2
1
Re-post of last year's halloween pumpkin head capture View it in browser here panopo.ly/?qmrp&FlipCloud=fa…
1
GUI for jetson&kinect combo almost back, just have to deal with some GLES2 restrictions...
1
Kinda getting captures back to normal in web player. But new format means new frag cleanup shaders. (ipad pro rear camera capture)
1
Another benefit/reason to change output to mp4 is for previewing in the Files app
Now outputting side by side/rainbow depth mp4's straight out of our capture app. (This is mac+kinect1, but same on IOS, jetson+kinectazure, pi+kinect1 etc) Decoding here out of a <video> tag, pretty much just so I can get hardware accelleration on quest webxr & use webcodec
1
Working on making Panopoly's output much more developer friendly; MP4 output; instead of a more proprietry stream. Rainbow depth, (instead of my whacky YUV packing), and side-by-side instead of multi-stream. All for much easier integration, and allowing hardware decoding on web.
1
3
A new version of the ios app is out on the public testflight testflight.apple.com/join/vu… Mostly a lot of internal fixes & optimisations, only major thing left is that we're currently encoding a very compressed Z. (But colour video is back!)

Join the Panopoly beta

Available on iOS

testflight.apple.com
1
3
Kinect encoding & streaming to web. Nothing wild, just aligning all the renderers, encoders & decoders. CMS upload is working too, so new ipad & iphone (truedepth & lidar both work) testflight beta shortly.
3
1
13
Also need to remember to put chroma back into the colour stream!
1
I really need to remember to whack more #xr/#vr/#ar/#mr/#webxr/#volumetric #hologram #spatialcomputing hashtags on these things
1
1
1
...and ipad. Both currently missing the noise reduction/cleanup pass, but recording & streaming!
1
Fixing some speed issues (ie. someone forgot they capped framerate to 30fps months ago)... mac + kinect1.
Mac & Kinect1 (green = noisy edge)
1
2
Oh right, twitter compression.
Finally finished final minor issues, so now the web-renderer on panopo.ly is running on the device whilst recording. (without noise reduc) Not sure why colour is intermittent, but there's a lot of debug. Same SwiftUI code as mac, same app .js as web/mac/win/ios etc!
1
1
Our capture software has gone a bit more cross platform than planned... Mac version now working (with kinect1 & 2), running off the same SwiftUI as ios, and same app code as ios, windows, pi, nvidia jetson
1
1
1
It also technically works on web, but currently I don't have any devices to hand which stream depth data to Web's MediaSources
To live stream from your device, straight into the web locally, you can now just browse to local.panopo.ly
1
Ios capture app for uploading/streaming to CMS, and very-live local streaming via panopo.ly/?local (non-secure!) beta is back up testflight.apple.com/join/vu…
1
Load more