Intermediated Reality

Intermediated Reality empowers users to interact with physical objects as if these objects were magically coming to life using Augmented Reality.





Intermediated Reality (IR) is a groundbreaking leap in communication and interaction, taking us beyond the conventional boundaries of reality. Imagine a world where the line between the physical and digital realms blurs, and your ordinary surroundings transform into a playground of possibilities. With IR, the fusion of technology and everyday objects enables a level of engagement that is nothing short of magical. In this Augmented Reality landscape, your mobile device becomes a window to a parallel universe where objects possess a newfound vitality. The coffee mug on your desk could become a virtual interface to a global community of coffee enthusiasts. Simply pointing your device at it unveils a world of interactive discussions, recipes, and brewing techniques, all seamlessly integrated with your physical surroundings.


Reality Mixing

Intermediated Reality takes Augmented Reality to a whole new level, allowing objects in your hands to come alive on your mobile screen. This is not your typical AR; it's an extraordinary fusion of the physical and digital. Hold a simple object, and watch it seamlessly transform into a vibrant, interactive entity, all thanks to IR. What sets our technology apart is its ability to preserve the natural look and feel of physical objects. Texture deformation ensures that the virtual representation perfectly mirrors the real thing. It is this attention to detail that makes IR truly magical.


Seamless Augmentation

Unlock a world of enchantment with our seamless mixing of reality and illusion. Watch in as everyday objects transform into dynamic, interactive marvels, all in real-time. Our innovative image retargeting techniques bring the magic to life, breathing movement into static objects, blurring the lines between what is real and what is imagined. Seamlessly integrated with your world, Intermediated Reality redefines remote interactions, collaborations, and learning experiences. Immerse yourself in a future where the extraordinary is now, and the ordinary is simply the beginning. Join us on this captivating journey into the future of Augmented Reality, where the impossible becomes possible at your fingertips.

Seamless Augmentation

Shadow Retargeting

With Shadow Retargeting, we redefine how shadows interact with virtual elements. Our state-of-the-art Shadow Retargeting technique meticulously maps real shadow appearances onto virtual shadows, ensuring a flawless blend of the physical and digital. By reconstructing virtual shadows based on clear real shadow samples captured in the camera feed, we efficiently capture the deformed shadow appearance. As a result, the essence of shadow dynamics remains intact, regardless of any scene deformations.

Shadow Retargeting

Conversational Characters

Step into a world where your everyday objects become captivating characters, powered by the magic of Intermediated Reality, Augmented Reality and Artificial Intelligence. Imagine your favorite book, now with characters stepping out of the pages to engage in lively conversations, responding to your questions and sharing their wisdom. Your paintings become storytellers, and even your coffee mug transforms into a sage companion, making your morning routine an enlightening experience. With this groundbreaking fusion of AR and AI, Intermediated Reality brings your objects to life, creating a world where learning, entertainment, and companionship blend seamlessly.

Conversational Characters

Experience our Real-Time Live! presentation at ACM SIGGRAPH 2023 in the video below, where we showcased the revolutionary fusion of Intermediated Reality and an AI-driven 3D printed character. Witness the magic as we introduced a captivating world where Intermediated Reality seamlessly interacts with a character brought to life through advanced AI and state-of-the-art 3D printing. Dive into this groundbreaking demonstration of innovation, showcasing the future of augmented experiences like never before!


Publications


Intermediated Reality with an AI 3D Printed Character

Intermediated Reality with an AI 3D Printed Character

L. Casas and K. Mitchell. "Intermediated Reality with an AI 3D Printed Character". SIGGRAPH '23: ACM SIGGRAPH 2023 Real-Time Live!. 2023. Association for Computing Machinery, New York, NY, USA, Article 5, 1–2.


Intermediated Reality: A Framework for Communication through Tele-Puppetry

Intermediated Reality: A Framework for Communication through Tele-Puppetry

L. Casas and K. Mitchell. "Intermediated Reality: A Framework for Communication through Tele-Puppetry". Frontiers in Robotics and Artificial Intelligence - Special issue "Collaboration in Mixed-Reality" 2019.


Enhanced Shadow Retargeting with Light-Source Estimation Using Flat Fresnel Lenses

Enhanced Shadow Retargeting with Light-Source Estimation Using Flat Fresnel Lenses

L. Casas, M. Fauconneau, M. Kosek, K. Mclister, and K. Mitchell, “Enhanced Shadow Retargeting with Light-Source Estimation Using Flat Fresnel Lenses”, Computers, vol. 8, no. 2, p. 29, Apr. 2019.


Multi-reality games: an experience across the entire reality-virtuality continuum

Multi-reality games: an experience across the entire reality-virtuality continuum

L. Casas*, L. Ciccone*, G. Çimen, P. Wiedemann, M. Fauconneau, R. W. Sumner and K. Mitchell. "Multi-reality games: an experience across the entire reality-virtuality continuum". In Proceedings of the 16th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry (VRCAI '18). Tokyo, Japan. 2018. Article 18, 1–4.


Image Based Proximate Shadow Retargeting

Image Based Proximate Shadow Retargeting

L. Casas, M. Fauconneau, M. Kosek, K. Mclister, and K. Mitchell, "Image Based Proximate Shadow Retargeting", In Proceedings of the Conference on Computer Graphics & Visual Computing (CGVC '18), Swansea, Wales, UK, 2018, Eurographics Association, pp. 43–50.


Props Alive: A Framework for Augmented Reality Stop Motion Animation

Props Alive: A Framework for Augmented Reality Stop Motion Animation

L. Casas, M. Kosek and K. Mitchell, "Props Alive: A Framework for Augmented Reality Stop Motion Animation", 2017 IEEE 10th Workshop on Software Engineering and Architectures for Realtime Interactive Systems (SEARIS), Los Angeles, CA, USA, 2017, pp. 1-4.


Patents


Intermediated Reality. Augmented Reality Systems and Methods

Intermediated Reality. Augmented Reality Systems and Methods

L. Casas and K. Mitchell. 2021. US11908068B2.

Get in touch!


3FINERY LTD was founded by Doctor Llogari Casas and Professor Kenny Mitchell along with a team of top notch advisors and partners. We bring over 8 years of intensive research on cutting-edge audio and visual immersive avatar communication technologies. If you would like to find out more about how we can assist your needs, do not hesitate to reach out and explore the possibilities with us.


Dr. Llogari Casas

Dr. Llogari Casas


Prof. Kenny Mitchell

Prof. Kenny Mitchell