Panoramic iPhone 360 Videos: Behind the Scenes… Pixels Unveiled

by GoPano Team
4 Comments

Processing panoramic videos with GoPano micro can be a little confusing. You may find yourself browsing the iPhone 360 videos on http://www.gopano.com/ asking, “Why do videos that look sharp straight from the camera look fuzzy with the optic attached?” To answer that, let’s take a look at what’s going on behind the scenes.

Below is a frame of panoramic video taken with the GoPano micro attached to an iPhone 4. Aside from the annotations, it is completely unaltered.

Original "warped" image

There are more pixels looking below the horizon (outside of the doughnut) than above the horizon (inside of the doughnut). This results in the top of the image looking fuzzier than the bottom because there’s less data to work with. (Note: you can record things upside-down if you want more detail up above).

Panoramic Video: Where Have My Pixels Gone?

 

iPhone 4 captures a normal 720p movie, which is 1280 pixels wide by 720 pixels tall. The first thing viewers are likely to notice is that the mirror image covers a fairly small portion of the image sensor. While a 720p movie has 921,600 pixels per frame, the iPhone 360 video only uses about 350,000 of those pixels, which are then spread across the entire 360 degree view, floor to ceiling.

The GoPano App takes the raw camera frame and “unwarps” it, stretching out the image that started as a circle and forming it into a cylinder that wraps around. It’s comparable to the reverse process of making paper globes, like you may recall doing as a young student in grade school.

When the panoramic video image is unwarped, it looks like this:

unwarped

And that, friends, is the whole 360 degree view. The left side wraps around to the right creating an image that is smaller than the original, at about 390,000 pixels.

Alternatively, let’s look at a view in a single direction, like you’d see when playing back the panoramic video interactively:

playback

iPhone 360 Video: Camera Resolution Improvements

 

Now that you’ve been schooled in pixels… We can share the Good News:

…as camera resolution improves, so does the quality of the 360 degree video you can achieve.

Already, iPhone 360 video has gotten a little quality boost from the release of iPhone 4S. While we wait for these camera improvements to continue, our GoPano micro team is continuing to advance our 360 degree video technology. We are working on new software techniques to improve the results from optics and cameras already in the field, and our enthusiastic team of experts is inventing new ways to “bend” the laws of physics.

360 Degree Video: Another Perspective

 

Looking for another perspective on the panoramic video images discussed above? Check out the following video examples. The first is a standard GoPano 360 video:


Now, watch the same video laid flat:


Have some input on panoramic video, pixels, or unwarping?  Feel free to chime in on the ‘behind the scenes’ discussion by leaving us a comment here.

4 Comments

  1. Just wanted to comment on the quality of the images. I realized that the quality would be reduced because of the smaller number of pixels available, but I am still pretty bummed by just how fussy the images are with the iPhone.

    Physics sometimes can really bite you in the butt.

    Thanks for the effort.

    Dave

  2. Your product looks really cool. it seems like the next logical step would be to use a flattened-donut to fill up more of the screen re estate. that will make unwarping harder of course.

    My main hesitation for buying this is that I would rather have stills than video. Will that be a separate product someday? or a new product that can do both?

  3. And What about adding software function for taking pictures with the Gopano. With the 5Mpix of the 4 and the 8Mpix of the 4s, that would bring georgeous panoramic pictures that we could “visit” with the finger.

    Thx

  4. Ari,

    We have been talking to Apple about a change they could make which would allow us to take better quality videos. Apple in many respects is just as much of a black box to us as they are to everyone else though so we don’t know if they are going to implement any of our suggestions.

    Ari and Oliver,

    The field of view of the camera changes between photo and video mode. You can see this if you go into Apple’s camera application and switch between picture and video modes with our optic attached. So, unfortunately it does not yield pictures that are of significantly better quality than the video.

Leave your comment

*