These are exciting technological times we live in, where virtual production, simulcam, and augmented reality is a valuable part of filmmaking.
Video Transcript
Hello! I am the artist known as DEROSNEC, and welcome to my bi-weekly vlog where I talk about making music, art, movies, and more.
Along with the technological advancements in visual effects, motion capture, and animation, there have also been some really exciting sister technologies which are brand new and have been starting to change the way that movies are being made. It’s a whole new creative world out there thanks to Virtual Production.
What is Virtual Production?
There are a lot of things that encompass Virtual Production, but in a nutshell it’s the act of creating a movie using virtual tools. Thanks to being able to plan ahead and see things like animation and effects in real time, filmmakers are not only making their planning lives and budgets easier to realize, but they’re able to bring whole new worlds and stronger stories to the screen.
There are some fun pieces of hardware that have been created to be able to achieve this. For example, there’s a Virtual Camera, which is basically just a little screen which is outfitted with the same little silver reflectors that a motion capture performance suit has, and is used within the same kind of capture volume on a stage. The motion capture cameras in the volume pick up the position and rotation of the camera as it’s moved, and that movement is reflected on the screen.
This little camera screen is able to simulate different kinds of real world cameras and lens kits, and allows the user to point and shoot within a virtually created scene almost as if he or she was using a real camera in a real room. All of the movements can be recorded and played back almost immediately, which means that the filmmaker can basically shoot the movie before having to spend potentially millions of dollars a day on a full crew on location.
Simulcam
The first major production to use virtual production tools was James Cameron’s Avatar, where he used a virtual camera to see pre-created elements while he was shooting the actual film. So for example, he could look through the camera and see the green screen that was in front of him replaced with a CG environment that was similar to what his final vision would be. He was also able to see pre-animated elements and replace his actors, who were wearing mocap suits, with their blue-kitty-avatar selves.
This process is called simulcam, and helps the filmmaker compose shots accurately when there is a lot of VFX happening in the scene. In the case of Avatar, it really helped, because the blue creatures were quite a bit taller than the actual actors, so this allowed him to ensure that everything was accurately placed and composed during production. He then took that data with him into post, which helped the VFX artists replace everything with the final assets much more effectively.
This process is now used quite a bit - most notably in Disney’s recent live action version of the Jungle Book. That entire movie was shot on a blue screen mocap studio stage, using virtual cameras and simulcam technology. They previs’d the environments and had pre-animated animal models appear on his viewing screen next to the real life little boy actor while he was shooting, which allowed director Jon Favreau to see how big each animal was in relation to the child. Trying to compose a shot with a 8-10 foot computer generated bear and a little boy beautifully could only have been made possible with this technology!
Virtual and Augmented Reality
More recently, engineers have been able to take simulcam technology a step further, and make it possible to pre-plan virtually anything.
For example, a virtual location scout session is where a lidar scan of an actual place on earth can be made available in a virtual reality headset and manipulated to your heart’s content. Production designers can redecorate and DOPs can plan setups with a virtual camera and lights - or even move the sun to see what time of day will look the best! And the coolest part of this is that the environment can be run on a server which can be accessed and interacted with collaboratively from multiple places all over the world. So if your DOP is is London, and your Production Designer is in Los Angeles, you can collaborate with both of them from India and do all the pre-production planning work that’s needed before the shoot with an insane level of accuracy.
Another tool which I’ve seen in action recently is Augmented Reality apps which can be loaded onto tablets. These apps are preloaded with previs’d animation or assets, and allows the filmmaker to precompose shots on location, with whatever CG elements they plan on adding in later.
This is just the beginning of what’s possible. The future is awesome for filmmakers!
What kinds of tools would you like to see be developed to make films? Had you ever heard if virtual production before? Tell me what you learned from today’s episode in the comments!
Thanks for watching - hit that thumbs up button below - it helps me more than you know - and join the uncensored by subscribing to my Youtube channel, my newsletter, or by following me on facebook, twitter, and instagram! If you never want to miss a video, be sure to click the little notification bell icon, too.
Thumbnail image by Image by FunkyFocus from Pixabay
NOTE: These Thursday Vlog transcripts can also be found published on my website: http://derosnec.com as well as my Steemit and Whaleshares blogs.
This post was shared in the Curation Collective Discord community for curators, and upvoted and resteemed by the @c-squared community account after manual review.
@c-squared runs a community witness. Please consider using one of your witness votes on us here
Moviemaking is very complex for the noobs.
It is the addition of various tasks that provide the beautiful motion pictures that we like so much.
Thank you for sharing this informations
Peace
Thank you for checking it out!
Hi there @derosnec!
Not all can be great in film-making. I believe is take more than passion and dedication to come up with great movies. Its not an easy job composing every shoot. I salute the hardworks of all movie directors especially the ones who produce indi films. Most great actors are first discovered doing indi films.
Thank you for sharing bits of pieces how things really works behind cameras. Congrats on your curie love!
Cheers! ❤
Posted using Partiko Android
Thank you for stopping by and checking it out! Yes movies are the ultimate collaborative effort :P
No problems. I am more glad to have bumped into your post..
Posted using Partiko Android
It's the second time I've visited one of your posts. The previous one that I saw was the sound effects ... if you have knowledge about the movies. Today I learned a lot, things I did not know. It made me remember when the Spiderman movie was being created, I remember that the spider-cam was being talked about. It was designed for aerial shots.
Hey @wisejg! Thanks for stopping by again. Yeah the big budget movies have A LOT going on - there is a lot to learn!
Thanks for sharing your knowledge about virtual cameras! So cool!
Thanks for sharing your
Knowledge about virtual
Cameras! So cool!
- zcreativemedia
I'm a bot. I detect haiku.
Thanks for checking it out! :D
Nice work derosnec. You are very creative
Thanks so much :P
Congratulations! This post has been upvoted from the communal account, @minnowsupport, by derosnec from the Minnow Support Project. It's a witness project run by aggroed, ausbitbank, teamsteem, someguy123, neoxian, followbtcnews, and netuoso. The goal is to help Steemit grow by supporting Minnows. Please find us at the Peace, Abundance, and Liberty Network (PALnet) Discord Channel. It's a completely public and open space to all members of the Steemit community who voluntarily choose to be there.
If you would like to delegate to the Minnow Support Project you can do so by clicking on the following links: 50SP, 100SP, 250SP, 500SP, 1000SP, 5000SP.
Be sure to leave at least 50SP undelegated on your account.
WOW that was so interesting for me, I had little ideas about some of these things but so much was new to me :)
:D Thanks tattoodjay!
Most welcome :)
Hi derosnec,
Visit curiesteem.com or join the Curie Discord community to learn more.
Hello, as a member of @steemdunk you have received a free courtesy boost! Steemdunk is an automated curation platform that is easy to use and built for the community. Join us at https://steemdunk.xyz
Upvote this comment to support the bot and increase your future rewards!
Wooaw..... Such a great write up you have in there. You are really awesome in writing.
To have the time to give to the world all these knowledge means you have a great heart at hand. I really enjoyed every second spent on the video and blog. It was really worth it. Great work and keep the sharing spirit up always
Posted using Partiko Android
Thanks very much!
Congratulations! This post has been chosen as one of the daily Whistle Stops for The STEEM Engine!
You can see your post's place along the track here: The Daily Whistle Stops, Issue 460 (04/18/19)
Congratulations @derosnec! You have completed the following achievement on the Steem blockchain and have been rewarded with new badge(s) :
You can view your badges on your Steem Board and compare to others on the Steem Ranking
If you no longer want to receive notifications, reply to this comment with the word
STOPVote for @Steemitboard as a witness to get one more award and increased upvotes!