{"id":826,"date":"2014-02-19T18:00:40","date_gmt":"2014-02-19T18:00:40","guid":{"rendered":"http:\/\/blog.andy-coates.com\/?p=826"},"modified":"2014-02-19T18:00:40","modified_gmt":"2014-02-19T18:00:40","slug":"d146-experimenting-with-volumetric-video-mapping","status":"publish","type":"post","link":"https:\/\/blog.andy-coates.com\/?p=826","title":{"rendered":"d146 Experimenting with volumetric video mapping"},"content":{"rendered":"<p>Heres a post which is less about day to day happenings but more about one of the many little ongoing research experiments I&#8217;m constantly tinkering with. Ive thought about this one for a while but haven&#8217;t yet tried to implement this until now!<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-828\" title=\"volumetric1\" src=\"https:\/\/blog.andy-coates.com\/wp-content\/uploads\/2014\/02\/volumetric1.png\" alt=\"\" width=\"1094\" height=\"782\" srcset=\"https:\/\/blog.andy-coates.com\/wp-content\/uploads\/2014\/02\/volumetric1.png 1094w, https:\/\/blog.andy-coates.com\/wp-content\/uploads\/2014\/02\/volumetric1-300x214.png 300w, https:\/\/blog.andy-coates.com\/wp-content\/uploads\/2014\/02\/volumetric1-1024x731.png 1024w\" sizes=\"auto, (max-width: 1094px) 100vw, 1094px\" \/><\/p>\n<p>After chatting with the <a href=\"http:\/\/www.avolitesmedia.com\" target=\"_blank\">Ai<\/a>\u00a0guys at work over the past few days about different content\/ video mapping scenarios I&#8217;ve decided to try and patch sic a thing in vvvv specifically for playing content back on a &#8220;Volumetric type video display&#8221;. For a description on what the hell a volumetric display is, its basically a video display screen with depth or extra layers which the viewer can see. In most cases a video screen is a single skin surface from a TV screen, projector scene or a projection mapped building. A volumetric display can have depth as well as width and height, heres a brilliant example by AntiVJ.<\/p>\n<p><iframe loading=\"lazy\" title=\"3DESTRUCT v2\" src=\"https:\/\/player.vimeo.com\/video\/32935093?dnt=1&amp;app_id=122963\" width=\"640\" height=\"360\" frameborder=\"0\" allow=\"autoplay; fullscreen; picture-in-picture; clipboard-write\"><\/iframe><\/p>\n<p>Using everyones <a href=\"http:\/\/vvvv.org\" target=\"_blank\">favourite node based programming software<\/a> I positioned 4 quads in 3d space at varying depts in the z-plane show in the image above and below. This gave me my basic 3d scene and some reference markers for my camera to look at.<\/p>\n<p><a href=\"https:\/\/blog.andy-coates.com\/wp-content\/uploads\/2014\/02\/volumetric2.png\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-829 alignleft\" title=\"volumetric2\" src=\"https:\/\/blog.andy-coates.com\/wp-content\/uploads\/2014\/02\/volumetric2.png\" alt=\"\" width=\"388\" height=\"332\" srcset=\"https:\/\/blog.andy-coates.com\/wp-content\/uploads\/2014\/02\/volumetric2.png 388w, https:\/\/blog.andy-coates.com\/wp-content\/uploads\/2014\/02\/volumetric2-300x256.png 300w\" sizes=\"auto, (max-width: 388px) 100vw, 388px\" \/><\/a><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-830 alignleft\" title=\"volumetric3\" src=\"https:\/\/blog.andy-coates.com\/wp-content\/uploads\/2014\/02\/volumetric3.png\" alt=\"\" width=\"175\" height=\"223\" \/><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>Using the same render information from the initial 3d scene I then too 4 views on the same scene, flat onto the relevant coloured quad. From there i then clipped the far and near plane in the Z-depth so that the view was only seeing a shallow depth of that particular plane. This proves the theory of this to be working but I run in to the issue of the model primitive I&#8217;ve been using in my scene is hollow, as are most models. Opening up the clipping planes gives a little pseudo thickness but I need to find a way giving the walls of the model a thickness, or the model it&#8217;s self some volume.<\/p>\n<p><a href=\"https:\/\/blog.andy-coates.com\/wp-content\/uploads\/2014\/02\/volumetric4.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-831\" title=\"volumetric4\" src=\"https:\/\/blog.andy-coates.com\/wp-content\/uploads\/2014\/02\/volumetric4.png\" alt=\"\" width=\"1090\" height=\"783\" srcset=\"https:\/\/blog.andy-coates.com\/wp-content\/uploads\/2014\/02\/volumetric4.png 1090w, https:\/\/blog.andy-coates.com\/wp-content\/uploads\/2014\/02\/volumetric4-300x215.png 300w, https:\/\/blog.andy-coates.com\/wp-content\/uploads\/2014\/02\/volumetric4-1024x735.png 1024w\" sizes=\"auto, (max-width: 1090px) 100vw, 1090px\" \/><\/a><\/p>\n<p>Do more research on:<\/p>\n<ul>\n<li>Volumetric Models<\/li>\n<li>Voxels<\/li>\n<li>Shader\/.fx to pseudo thicken model walls on the output.<\/li>\n<\/ul>\n<p>vvvv project available here &gt; \u00a0<a href=\"https:\/\/blog.andy-coates.com\/?attachment_id=832\" target=\"_blank\">Volumetric<\/a> Using:45beta 31.2 64bit<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Heres a post which is less about day to day happenings but more about one of the many little ongoing research experiments I&#8217;m constantly tinkering with. Ive thought about this one for a while but haven&#8217;t yet tried to implement &hellip; <a href=\"https:\/\/blog.andy-coates.com\/?p=826\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[180,30,7],"tags":[213,210,212,211,153],"class_list":["post-826","post","type-post","status-publish","format-standard","hentry","category-creative","category-projection-mapping","category-work","tag-ai","tag-video-mapping","tag-volumetric","tag-vvvv","tag-work-2"],"_links":{"self":[{"href":"https:\/\/blog.andy-coates.com\/index.php?rest_route=\/wp\/v2\/posts\/826","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.andy-coates.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.andy-coates.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.andy-coates.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.andy-coates.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=826"}],"version-history":[{"count":3,"href":"https:\/\/blog.andy-coates.com\/index.php?rest_route=\/wp\/v2\/posts\/826\/revisions"}],"predecessor-version":[{"id":840,"href":"https:\/\/blog.andy-coates.com\/index.php?rest_route=\/wp\/v2\/posts\/826\/revisions\/840"}],"wp:attachment":[{"href":"https:\/\/blog.andy-coates.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=826"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.andy-coates.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=826"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.andy-coates.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=826"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}