Augmented Reality: Bridging the gap between the physical and the digital world

Video thumbnail (Frame 0) Video thumbnail (Frame 2519) Video thumbnail (Frame 3590) Video thumbnail (Frame 4722) Video thumbnail (Frame 6243) Video thumbnail (Frame 7202) Video thumbnail (Frame 9364) Video thumbnail (Frame 10701) Video thumbnail (Frame 12603) Video thumbnail (Frame 14193) Video thumbnail (Frame 15909) Video thumbnail (Frame 17403) Video thumbnail (Frame 18492) Video thumbnail (Frame 19625) Video thumbnail (Frame 20955) Video thumbnail (Frame 22120) Video thumbnail (Frame 23476) Video thumbnail (Frame 24971) Video thumbnail (Frame 25929) Video thumbnail (Frame 27226) Video thumbnail (Frame 28837) Video thumbnail (Frame 30137) Video thumbnail (Frame 31481) Video thumbnail (Frame 32472) Video thumbnail (Frame 34199) Video thumbnail (Frame 35984) Video thumbnail (Frame 37478) Video thumbnail (Frame 38424) Video thumbnail (Frame 39704) Video thumbnail (Frame 40753) Video thumbnail (Frame 41688) Video thumbnail (Frame 43196) Video thumbnail (Frame 44222) Video thumbnail (Frame 45649) Video thumbnail (Frame 46698) Video thumbnail (Frame 47639) Video thumbnail (Frame 48706) Video thumbnail (Frame 49974) Video thumbnail (Frame 53221) Video thumbnail (Frame 57792) Video thumbnail (Frame 59563) Video thumbnail (Frame 60638) Video thumbnail (Frame 62181) Video thumbnail (Frame 69647)
Video in TIB AV-Portal: Augmented Reality: Bridging the gap between the physical and the digital world

Formal Metadata

Augmented Reality: Bridging the gap between the physical and the digital world
Title of Series
CC Attribution 4.0 International:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor.
Release Date

Content Metadata

Subject Area
There has been a lot of talk about Virtual Reality (VR), but still there are very little applications to enhance our everyday lives outside of entertainment. Augmented Reality (AR), the less known sibling of VR, has the power to have a more profound impact on our lives than VR ever could. Instead of replacing the real world with a virtual one, AR enhances the reality with virtual content. Therefore, AR can be a gateway for people in accessing and understanding todays technology and could provide vast possibilities to support our everyday lives, e.g., for navigation, traveling, or education. This talk will give an overview on AR in general and explain its possible benefits and use cases, as well as the issues that may arise, e.g., regarding privacy, data security, as well as psychological and sociological challenges. The talk requires no special knowledge and is suited for people with little exposure to AR and mixed reality, but it will also give insights into current relevant research and development.
Keywords Science

Related Material

Video is cited by the following resource
Musical ensemble Semiconductor memory
Goodness of fit Theory of relativity Observational study Different (Kate Ryan album) Augmented reality Interactive television Materialization (paranormal) Bit Field (computer science)
Impulse response Augmented reality Term (mathematics) Video game Set (mathematics) Bit Augmented reality Virtual reality Cartesian coordinate system Neuroinformatik
Different (Kate Ryan album) Multiplication sign Content (media) Augmented reality Contrast (vision) Virtual reality Cartesian coordinate system 2 (number)
Content (media) output Cyberspace Augmented reality Object (grammar) Table (information) Cartesian coordinate system
Classical physics Category of being Virtual reality Mixed reality Augmented reality Mixed reality Continuum hypothesis Augmented reality Virtual reality Extension (kinesiology)
Medical imaging Group action Integrated development environment Inheritance (object-oriented programming) Augmented reality Multiplication sign Content (media) Right angle Smartphone Augmented reality Telepräsenz Form (programming)
Touchscreen Touchscreen Augmented reality Augmented reality Surface of revolution Perspective (visual) Surface of revolution Term (mathematics) Electronic visual display Game theory Electronic visual display Game theory Form (programming)
Focus (optics) Theory of relativity Augmented reality INTEGRAL Multiplication sign 1 (number) Physicalism Mereology Power (physics) Product (business) Uniform resource locator Mathematics Video game Electronic visual display Smartphone Object (grammar)
Trail Frequency Term (mathematics) Augmented reality Multiplication sign Optics Quicksort Virtual reality Social class
Mobile Web Proof theory Electric generator Augmented reality Personal digital assistant Cartesian coordinate system Turing-Maschine Virtual machine Wave packet Form (programming)
Area Point (geometry) Empennage Statistics Group action Augmented reality Logistic distribution Authoring system Bit Augmented reality Cartesian coordinate system Sign (mathematics) Data model Mixed reality Personal digital assistant Mixed reality Artistic rendering Artistic rendering Video game
Avatar (2009 film) Integrated development environment Personal digital assistant Telecommunication Electronic program guide Maxima and minima Speech synthesis Bit Telepräsenz
Medical imaging Scaling (geometry) Real number Right angle Data conversion Table (information) Virtual reality Perspective (visual)
Smartphone Line (geometry) Physical system
Point (geometry) Goodness of fit Matching (graph theory) Mapping Information Different (Kate Ryan album) Cuboid Smartphone Menu (computing) Abstraction
Context awareness Pointer (computer programming) Information Googol Direction (geometry) Content (media) Translation (relic) Object (grammar) Disk read-and-write head Distance Formal language
Trail Personal digital assistant Augmented reality Cyberspace Cartesian coordinate system Virtual reality Field (computer science)
Information State of matter Expert system Power (physics) Physical system
Information Peripheral Internetworking Augmented reality Router (computing) Dynamic Host Configuration Protocol
Band matrix Direct numerical simulation Server (computing) Graph (mathematics) Information Multiplication sign Website Arrow of time Wireless LAN Connected space
State of matter Position operator
Ocean current Trail Integrated development environment Different (Kate Ryan album) Multiplication sign Content (media) Electronic visual display Endliche Modelltheorie Distance Disk read-and-write head Pole (complex analysis)
Message passing Video projector State of matter Content (media) Electronic visual display Object (grammar) Electronic visual display Subset Row (database)
Degree (graph theory) View (database) Finite-state machine Object (grammar) Field (computer science) Condition number
Point (geometry) Logical constant Service (economics) Information Source code Similarity (geometry) Streaming media Connected space Data stream Web service Process (computing) Visualization (computer graphics) Internet service provider output Object (grammar) Head-mounted display Curve fitting Form (programming)
Logical constant Computer icon Server (computing) Confidence interval Electronic mailing list Rotation Medical imaging Personal digital assistant Information retrieval Video game Electronic visual display Object (grammar) Head-mounted display
Point (geometry) Ocean current Pairwise comparison State of matter Interface (computing) Content (media) Mereology Integrated development environment Normal (geometry) Right angle Object (grammar) Form factor (electronics) Ultrasound
Game controller Touchscreen Integrated development environment Augmented reality Real number Interactive television Speech synthesis Water vapor Smartphone Perturbation theory
Game controller Service (economics) Information Information overload Structural load Content (media) Inverse element Information privacy Automatic differentiation Cognition Arithmetic mean Information security Sinc function
Ocean current Service (economics) Different (Kate Ryan album) Streaming media Information privacy Position operator
Ocean current Sensitivity analysis Game controller Software Correspondence (mathematics) Operator (mathematics) Direction (geometry) Smartphone Computing platform
Area Mobile Web Augmented reality Electronic visual display Design by contract Smartphone Cartesian coordinate system Disk read-and-write head Physical system
Context awareness Augmented reality Multiplication sign Mass
Logical constant Mathematics Augmented reality Special unitary group
Uniform resource locator Mathematics Personal digital assistant Video game Line (geometry) Extension (kinesiology) Cognition
Word Internet forum Augmented reality Object (grammar)
Slide rule Goodness of fit Mathematics Augmented reality Visual system Keyboard shortcut Execution unit Order (biology) Video game Bit Musical ensemble Number
Trail Server (computing) Touchscreen Information Video projector Augmented reality Cyberspace Bit Streaming media Mereology Machine vision Field (computer science) Revision control Medical imaging Process (computing) Visualization (computer graphics) Internetworking Computer hardware Data center output Electronic visual display Right angle
Sign (mathematics) Functional (mathematics) Goodness of fit Internetworking Augmented reality Personal digital assistant Direction (geometry) Adaptive behavior Translation (relic) Smartphone Subset
Facebook Augmented reality Direction (geometry) Right angle Virtual reality Computing platform Number
Mathematics Electric generator Information Internetworking Video game Smartphone Information privacy Field (computer science) Machine vision Number
Point (geometry) Logical constant Complex (psychology) Building Server (computing) Open source Multiplication sign Open set Streaming media Information privacy Mereology Data transmission Machine vision Neuroinformatik Product (business) Power (physics) Moore's law Prototype Goodness of fit Computer hardware Endliche Modelltheorie Task (computing) Physical system Information Augmented reality Interface (computing) Projective plane Uniform resource locator Exterior algebra Process (computing) Integrated development environment Software Visualization (computer graphics) Personal digital assistant Point cloud Video game Normal (geometry) output Smartphone Virtual reality
Proof theory Medical imaging Service (economics) Personal digital assistant Internetworking Augmented reality Information retrieval Energy level Database Musical ensemble Object (grammar) Resultant
[Music] we're gonna look at how to bridge the gap between the physical and the digital world so we go into an immersive things and my guest here our guest here is Patrick and he goes as well with the
nickname pride he is currently doing a
PhD on human-computer relations interaction actually interaction yeah it's a important difference I say okay I'm not gonna discuss this enzyme as well a little bit on this field we made an agreement blood that but he's focusing on augmented reality today he's doing this study and Jason I understood he has a general interest of course in things to do with 3d that goes along with these kind of things yeah and his talk provides us an overview on AR in general and explain its possible uses for goods and for the bat okay so okay ladies and gentlemen here is Patrick please give him a warm welcome thank you light the fuse and put it in playing Patrick thanks yeah thanks hi everyone
no so this is a foundation talk so it's mostly aimed at people who know nothing or very little about materiality so
fully after the talk you will know a little bit more however if you have some experience I hope maybe you will get some new impulses I don't know but furthermore the stock is also focused more about how augmented reality can be used for everyday life and not so much on scientific community so and it's roughly like 30 minutes something like that so I made it a little shorter so that we have Karen have some questions in the end so if you have something that's of particular interest just ask after what so but
first let's talk a little bit about virtual reality because like I think most people maybe are more familiar with the term there's been a lot of talk about virtual reality like changing revolutionizing the way we use computers there are many commercial virtual reality has sets of SFO before and also quite a lot of applications but somehow we are doesn't really unfriend our
everyday lives that much and I think there's two reasons for that the first one is that virtual reality applications are mostly centered on entertainment right now and the second is that it disconnects us pretty much from the real world so why it might have the the ability to to actually yet transfer us
into another world which more or less looks like this at the same time we are caught up from reality and in contrast augmented reality expands through your world and in the mind of most people right now this looks something like that but the important thing is that we can still perceive our surroundings and we can also experience the virtual content as well and this particular difference makes they are a lot more useful for everyday used and virtual reality so let's go to to a little definition of what augmented reality actually means so
the important thing is that we combine real and virtual content blowing the borders between both so as you can see here's a virtual globe on a real table and the application also interacts in real-time so if I move for if I have some input the application reacts on the spot there's no delay and the objects are situated not relative to the user
but in space so if I move around the globe stays on the table so this is
basically what would I learn when I'm talking about a automated reality what I mean but what it's also important to note
that IR is only of the so-called mixed reality continuum which ranges from reality without any augmentations so the normal reality we experience every day to a completely virtual environment and those four categories are basically the classic mixed reality continuum there's also
some extensions to that which you can
see here I don't want to go into any detail of what those all mean but the important thing to remember is that there is no hard border where augmented
reality begins and where it ends that's also a lot of ways to provide augmented
reality mobile automated reality like pokemon gold where the a archons and is perceived to a mobile device like a smartphone is the most common form today there's also projected augmented reality where you have a projector super impose an image onto a real environment which is especially useful if you have like collaborative scenarios where the content should be perceived and manipulated by a group of people at the same time you can actually see this example right out of the door there's a similar installation there and then there's what this talk is or some moves mostly focus about head-mounted augmented reality where users where AR glasses which can be seen through and where the virtual content is projected onto and this is the most immersive form of augmented reality and when you have sophisticated technology it's more or less indistinguishable from the real world so that's that's basically to go with what we want to get so but now it's
the question okay why why augmented reality what's so important why we have to stalk at all and yeah for that I want
to quote Tim Sweeney of the CEO of Epic Games because it's always a good idea to quote someone who's more famous than oneself and he said that he believes
that augmented reality will be the biggest technical technological revolution in our lifetime because once you have any artist play you any other form of display just take your screen wherever you go so that's a very
powerful thing to say he also thinks that the revolution will happen in the next 10 years which is very optimistic from my perspective when you look at what the current technology can do but nonetheless I believe this revolution is going to happen sooner or later so it's useful to familiarize yourself with the term what is also important to note is
that the goal is not to just substitute a real displays with larger ones but augmented physical objects themselves that the augmentations really have a relation with location they are situated in so only then they are will have really the power to revolutionize our everyday life so I will I will elaborate on that a little later on but first a
question like how likely our fundamental changes in our society triggered by augmented reality so if we compared of smartphones and the way they are used I
think it's very lively because smart phones today our technology focus directly on supporting the way people live their lives every day so and it's also started as a research long time ago before commercial products were available and now they are ubiquitous and they are an integral part of people's life and for some people it might be difficult to actually live without them and I think when a RS is likely to do the same when it's focused on the things people actually need and once the technology comes along but before we go there short very short history of augmented reality so that you
can see where this is all coming from so actually augmented reality is rather old so the first augmented reality virtual reality device was built by Ivan Sutherland and 1968 was called sort of thermo class but it was already had already had tracking and see-through optics so that's quite advanced for the time I would say the actual term augmented reality only coined 25 years later bike out of Amritsar in 1992 so quite a long time in between but of course the we research stood not still during that period he was an interesting example that I wanted to show you from 1994 by stayed at all which shows an ultrasonic image of a human fetus directly superimposed over a woman's belly and yet it shows that even in a very early on that people were thinking about how we can use augmented
reality to really benefit humans in a lot of ways despite the technology at that time being very limited this is also
important step because it was the first mobile our headset for usage outside of the lab and with wonderful named Turing machine by fine art of in 1997 so even like early on the question was okay how can we use this technology not only indoors but well how can we use it outdoors as well which is very important and then finally the first AR application using mobile devices in this case PDAs for the people who still remember them with extended cameras and you can see those little markers in the background which are tracked by the cameras and then little virtual trains are overlaid over the wooden train tracks so it's not really that practical just to like a proof of concept more or less so but yeah like I said mobile AR today is the most common form of augmented reality but maybe maybe that might change soon because now we have
like the current leader the first generation of really commercially available augmented reality headsets and therefore also an increase in interest and from the scientific community but also from the industry for solving the various problems so this immediately
brings us to the areas of application and hopefully how augmented reality may influence our lives not positive way
first a little bit about a research actually only 12
nine point five percent of the researchers actually focus on application cases for augmented reality based the statistics are based on the international symposium on mix augmented reality and the rest is focused on things like tracking technology into action rendering and so on and of those application cases most of them are usually industry centered and not so much on everyday life so we have things like for example logistics you
have things in the medical sectors and of course they have a great indirect influence on our lives we will still benefit from those things but I want to focus it a little bit more on on everyday use so how can we immediately benefit from augmented reality and explore that a little further on that those are things like guides and cultural heritage for example and telecommunication and telepresence which
also brings us to the first use case which is a our telepresence which is more or less like video phoning only more with freely avatars of the person you're speaking with embedded directly into the environment so basically like a virtual avatar sitting on the chair next
to you which is I would say rather cool because it's something that that's out of science sci-fi novels of films and put notes here yeah now we can use it and despite being far from from perfect a still very incredible um at least from my perspective and you cannot only have a conversation in real size but you can also like scale it up and down as much as you want like in the lower right image you can see that the girl is standing on the pedestrian in front of
the guy very small in size you can actually like have people virtual people running around your table while you do other stuff we're talking to them so another very classic example I would say
is our navigation this is some system by Google which is a direct advancement
over their smartphone navigation and I
think despite being in a very obvious example um when you think what AR can do um it's also very powerful one so basically it means like when you want to go somewhere you project like for example a line in front of the people that you have to follow to reach the
destination it's very easy and very understandable currently there are mostly specialized systems that focus on something like airport navigation or car navigation for example very few for general pedestrian use but I think that's likely going to change in the future so the next one also maybe a little
obvious on finding places of interest based on selected preferences so the example would be like where's the next post box whereas a good restaurant or bar so this is of course possible today with smartphones as well but the big differences that you you don't have any abstractions so you don't have to match the map of what you're seeing so where it's just booming that that says on my
smart phone now you get the information placed exactly at the point of interest itself so that makes it a lot of easier and useful for example of course you can also show something like user reviews or for example the menu of the restaurant so that you can find a suitable match what's also very very useful was
something like a our translation where you like provide an instant translation of a foreign language in place so for example you look at a sign and Russian and you get the content in English this is actually Google Translate which maybe some people already have used yeah but like you would when you have use that
you would say oh well that's really practical for example and when you use it with a head mounted device it's even more practical because you don't actually have to like pointer device somebody you just see the text and the language you prefer so but besides translation you can also offer context information of as well of course because you can not only show in this example the direction but you can also show the distance to the object and it's also
suitable for places like museums where space for text is usually very limited but space and they are generally is not which brings us to to the next
application case which is cultural heritage and tourism enters in a nice paper that gives a good example of that because it it can make history somewhat
more experience of all so when you have ruins for example of a Greek temple like here you can get an impression of what the temple might have looked like directly situated on the actual ruins or when you have the fields of antique F'lar running tracks you can may have for virtual efforts on augmented reality that give you an impression how these facility were actually loose like the people running around doing sports and stuff like that and I think this is really powerful or thank you you just get to see what it what what it was looked like in the past but another
important aspect and I think a very powerful one is how AR may have may have text knowledge made me after power to make technology more accessible again so
today's technology grows more complex and it's more and more connected so that even for for experts sometimes hard to actually say okay what state is the system currently in for a layman person
it's even harder so AR can help make justice hidden information visible again in a way that's easy to understand so just to give you a little example which
is not perfect but hopefully sufficient to transport the idea imagine you have a simple Reuter at home for example we have some status LEDs but when for whatever reason your internet breaks down stops working day they don't have you that much for debugging the actual problem so to get more and from you have to most likely access what under face if you still can remember the
IP of your device of course you can do what we have done here and put a little piece of paper of your IP on the device itself but that's hardly a practical solution yeah so imagine with augmented reality you can just look at the router do a simple gesture and then get the information you were interested in directly superimposed on the physical device itself so which can help you immediately recognize what the problem might be so maybe you just forgot to turn on DHCP or something like that but
we can expand that concept to not only include a Rooter but also the vilest devices connected to it so one of the predominant features of wireless LAN is that there is no wire so it's hard to see which devices are connected where they are located and what RP is and so on so of a are we can simply draw virtual connections to make that information easily available to the user so I do something like this but we can also use it to make arrows more recognizable for example one of the devices maybe not be able to resolve websites because there is more DNS server registered and then we can of course also just buy additional information like the bandwidth for device users and when we have an actual physical medium we could actually use that for displaying information like a graph of the bandwidth over time and it's very easy to understand what is displayed because it's directly located at the medium itself yes so I hope this example gives you an impression of how
er can can really help with understanding technology again you might be we might talk a little bit about that later on but first let's come to some
technical challenges so how does that
actually work and what has to change so that we can really use it everyday now
the first one is tracking which is one of the main challenges because I have to locate the user somehow I have to know
where your she is and well what what she is looking at for example so for general positioning I could use something like GPS but precision is of course a problem and I can't really use it indoors so we need additional check not detracting technology and there are many different approaches but the current state of the art is more or less infrared tracking with time-of-flight so that means
infrared light is emitted which is reflected by the environment and the time between sending and receiving the light and poles determines the distance to an object and with that I can create a depth model of a room which more or less looks like this and then I can not
only tell why the user is right now but also when he or she is moving around and while this technology is far from perfect I think the current tracking technology is quite robust and useful in that regard what's also important this
display and rendering so there are many different technologies for head mounted devices one of them is video see-through where camera films the environment which is then together with the virtual content rendered on to a display in front of the users eye but latency is a
very big problem in that regard because you will very easily get sick another seat row objects-- using polarized glass where the our content is projected onto and there are even small laser projectors which project directly into the users eyes but for some reason user acceptance is not very high but yeah idiot the ideal display would not require any external display at all but you would directly manipulate the optic nerve which sends the messages to the brain well we don't have that right now so we have to make through but what we
have and this is basically the see through objects which is right now like the current state of the art so that's just look at what the problems are and
that regard one of the problems is opacity because when I have a solid object like a human for example no background bleeped freedom so currently for for the commercial headsets this is not so bad but yeah really depending on the lighting conditions when you have a lot of sunlight you can't really see anything anymore but yet it's still much room for improvement in that regard what might be even more important is the field of view of the our headset because like a human has roughly 210 degrees field of view and as you can see here like the microsoft hololens has like 30 degrees and the mid-to has like 90 degrees most of which for my experience at least a pretty blurry so yeah that's not this so this still has to get a lot of better wear until we can really use it also very important as you know when
a person wearing an H MD what what does she see like how can I recognize watch what a person is looking at and how can I get data on the recognizer objects so
due to performance requirements most of the processing will most likely not happen on the head-mounted device but it will very likely take the form of some
web service or similar services which not only process a constant visual input stream of the cameras of the hmd would also have to have to provide data sources for the various objects for example when I have touristic points of interest I need to get some information on them so this requires a constant data stream and a very good connectivity to make it very useful and it also requires a lot of services readily available to use by dar device so this is quite a big challenge maybe the biggest of them all so to give you a little impression how that are could work based on existing
research which is called a reality based information retrieval so imagine you have an AR hgmd that feeds the constant life image to a server to recognize objects the users currently looking at for example vegetables' at a market so the server is able to classify those images by comparing them with a couple of saved reference images and gives a sense list of recognized objects and the confidence value back to the hmd and then the agent you can query a different servers to get some recommendations for meals that I can cook with that vegetable so when I explore a market and you have your array our display with you you could not only like it could not only tell you what a particular vegetable is I am in case you might not know but it could also tell you what to do with it which more or less could be quite useful what's also
important like if they are glasses are to become everyday objects ergonomics and aesthetics are going to be important
so you probably don't want to wear or something like like this right now so
for the most part that means shrinking the glasses down to the size of current normal glasses which was a form factor that's small as already accepted in our society and as you can see the comparison we are not really close to being at that point and one of the most
important questions is not only how to display our Condit but also how to interact with the content because otherwise it's a very limited experience so our objects might appear to be part of our environment we can't really touch them so I can I can't actually press a virtual button and there is research concerned with providing haptics as well for example there's Ultra haptics which uses ultrasound to create resistance and mid-air so that I have an actual resistance when I when I touch somewhere but it's still in a very early state so currently mostly gesture interfaces are used where my fingers are tracked and the line of sight together with the and gestures are used to trigger
interaction speech speech import is also a common solution but using public environments is limited and another possibility is also to use additional devices like specialized controllers or for example the touch screen of a smartphone for interacting with the water contact gaze tracking that means tracking the users eyes will most likely also play an important role but right now there's pretty much no perfect solution and also still a lot of research happens in this regard so this is a very hot research topic right now so let's come to possible dangers and
other issues or all the things that might not be so great about ubiquitous augmented reality you're the first one
pretty obvious problem is information overload where too much information leads to excessive cognitive load by users so virtual content has to be used sparsely to best support users and the only way to make sure users are not overstrained just to leave them and control of what and how much is displayed but users might not always
have the means to control it so
especially when third-party services are involved we may see something like
inverse of advertiser an invasive
advertisement sorry and other unwanted content and since head-mounted AR is already a personal experience these ads are most likely to be personalized as well so this directly to the question of privacy and data security there will
most likely be a constant stream of the user's current position and a live video feed to various third-party services so
this raises the old question how can I control what happens with my data and who gets access to it and privacy of course is also a big issue because there's hardly anything more personal than a constant live feed of what I'm seeing so even if I myself decide to don't use an IR device as long as everyone else it partly makes a difference so at the center maybe is really the question of
who controls the actual heart of software platforms so similar to
smartphones is likely for a few global operating corporations to not only offer the AR devices but also provide the corresponding software ecosystems as well so we see that already with the direction the hololens by Microsoft is taking yeah but AR consists of even more sensitive data than current smartphones so yeah will we be in control of our own devices do the companies producing them of any interest to keep us in control because most likely their primary motivation is to make money and will people even care because they hardly
seem to care with smartphones right now so I think this is an important question and another possible application area
for augmented reality which I haven't talked about is military used so head of heads-up display some have been used in the military in aeroplanes for example for over a decade and there also have
been several scientific papers evaluating the use of augmented reality in military use so it's not difficult to imagine a our systems like telling soldiers were to go and maybe even whose friend or foe Microsoft has recently made a contract with the US military for over 480 million u.s. dollars to you evaluate the use of the hololens on the battlefield and the goal is to increase lethality mobility and
situational awareness of soldiers on the battlefield so i don't really want to provide any judgment on that but it's best to not have any illusions what does technology can and eventually will be used for and it's probably not all going to be unicorns and rainbows so let's keep that in mind
the another interesting aspect is how does massive use of augmented reality actually change how humans interact with each other so for example one we can project ourselves everywhere at any time how important will it be to need in person so to given to give you an impression there's the
novel naked Sun written by Isaac Asimov in 1957 where it's common for people to communicate with photorealistic holograms and even being naked in front of each other there's no problem but it's extremely unpleasant for people to be in the same room with a real person so I'm not going to say this is what is likely to happen but I think it's an interesting aspect to think about as there will be some social changes involved which we don't know yet this also leads to the question how our own
way of thinking is influenced by the constant use of augmented reality so for
example how does our perception of locations and how locations are connected change when we are guided by our navigation which and the worst case means following a line until we reach our destination there has been research showing that extensive usage of GPS might lead to an atrophy of the hippocampus increasing the risks of cognitive disease cognitive diseases like Alzheimer later on in life so it's important to be aware that there might be issues and it's important to do the actual research to figure out what this issues might be and of course maybe even the ultimate question what is reality
like how does our understanding and perception of reality itself change when we use AR this is more a metaphysical question but I think it's an interesting one nonetheless it's not so much a
problem for moderate use of augmented reality for example to to annotate objects but more question for photorealistic augmented reality which can order the way the word looks to each personality visually so if my world looks vastly different from your world and when AR is always active what does
reality really mean in this regard and what role if any does the unamended word play in the lives of people anymore so this might be something to think about and with that I conclude my talk so
hopefully I could show you that augmented reality could have a benefit in our life but that are also some risks
involved and I hope you found it somewhat interesting and now we can have some questions thank you [Applause] [Music] [Applause]
you're fantastic talk good overview for
whatever is possible in unit Thanks I see some people you're queuing to ask you some questions let's go to a number two here please sir thanks for the talk the previous slide on the red and blue pill and can you elaborate a little bit on how you as a researcher and user of augmented reality eventually better understand reality so you mean when we use a granted reality that might lead to a little to a better understanding of what what reality is or what did you mean yes that's the question do you feel like you're not just using but also researching because in order to for example when you have this light on how the 3d scan works you use it as let's say a metaphor or shortcut on how our own brain and visual system works oh yes well like I said it's a rather metaphysical question so it's hard to really answer the question right now it's more like you could guess what it might how it might change for people what the perception of reality how does that change but I don't I can't really answer that to be honest like it's it's more of an open question for myself as well because like when I think about augmented reality and and if it eventually will be used by by everybody everyday like I can think of some some like dystopian sci-fi scenarios where everyone lives in this happy world would just totally fake and the real world basically looks awful but nobody actually noticed that because everyone was like caged in his own own happy place for example so but I don't know if
that's going to happen it's just a possible danger that you could think of
but this is probably something that will not happen on the next twenty to thirty years because we simply don't have the technology to do that right now so maybe
that more or less answers your question I hope yeah next one okay sorry so to get widespread consumer adoption we really need the miniaturization of the hardware Google glass got kind of laughed out of the room a few years ago so we need to be better than that yeah but Google glass wasn't really augmented reality it was like more like a heads-up display because you had those tiny screen and the back of like at the right upper part of your visual field of vision and it was like you could just display a limited amount of information there like when you have we all automatic to reality is basically having the old space to put information so I mean more like it's a stupid-looking thing to walk around on your head so we've got to look better than that when we're yeah that's why I think that that we have to go to like where medical glasses are right now because they are already accepted on society so someone wearing glasses doesn't get looked at on a funny way because it's pretty normal so if augmented reality headsets look more or less the same I think we're fine so so the question is what are the technological problems that we have to solve to get there in a consumer device yeah we have to actually menorah militarize to stuff so I think the laser projectors actually are an interesting solution because they are rather small and you can project directly into the eyes of the users so if you get like this user bias figured out how we can like actually convince people that this is a good idea not dangerous at all and we can shrink it down even further and if we have the whole processing not on the device itself but on third party like data centers or something like that we can also shrink that down so we have to actually only stream the input to the server and we have to stream like the image back to the device now we can build pretty small devices I think so that's what we have to figure out but yeah it's it's I think this is something that's actually going to happen I don't know in the next five years or something like that because this is actually something that that's worked on right now Microsoft actually is building the next version of hololens which be smaller which should have more features like eye tracking and stuff like that but we have to wait and see basically like this this is also a thing an important thing the hardware involved is very complex so it's not something that that one person can do in his garage or something like that so you pretty much only have the chance to have those big corporations do the stuff and do the research because it's a complex yep with a little bit of imagination we see someone stepping in there from the internet who has a question holographically projected here next to
me on stage you are the Internet has a related question how long do you think
will it take until everyone uses augmented reality like mobile phones today how it's I think that really depends on on the use cases I think this is the most important thing for acceptance you have to provide functionality that actually benefits the the way people live their lives for example the DR translation I think is a good example because it's common for people to when they are traveling for example to run to signs or something like that which they can't understand because it's a foreign language and if you provide an augmented reality solution for this particular problem people are going to use it because it's practical because it's useful and the more functionality it's the same of smartphones worry the more functionality you provide and that goes in this direction the easier the adaption will be so yeah that's basically we have to find use cases which are important to people and then the adaption will basically happen so yeah a critical mass
and number three please sir thank you thank you for your talk and when you
introduce two platforms what is with Facebook with the oculus rift is it not ocular it's not virtual reality yet virtual reality it's not really augmented reality and yeah I was thinking about including it but I still don't have any idea where they are going with this so they have bought this company they have invested in this technology but yeah I don't see where they are going with this right
now what what their goal is actually so this is why I didn't include it mmm thank you yeah you come in your direction anyhow but number two please and first of all thank you for the
information to talk and what do you think will change from privacy policy with when you have an active life feat of what you're seeing with documented reality yeah I think like this maybe do the cynical way of looking at it but I think people will stop caring about that that is what simply is going to happen like we like the current generation is concerned with privacy and we feel like for others it's a very bad idea to actually have a constant live feed of what we are seeing transmitted to somewhere on the internet but if like I see that younger people whose smartphones they don't think about privacy pretty much they think about what this device can you do for them and I think this is like more or less the social change maybe that will happen people will stop caring about it it will just be a normal thing that that your your field of vision gets transmitted to somewhere on the internet and people would simply stop care I think that is what's called this is what's going to happen yeah thank you okay next
number two Thanks
I saw recently there was a company that announced some some shades and they had been conducting sound transmission so
they didn't really project something into the retina so they've went a way around all the projection and all the complexity of making this huge bulky hats do you think this is a viable way to go forward you've focused mostly on visual inputs but maybe other sensors are better suited to making an entry into a augmented reality what do you think about it an interesting point yeah I focused a lot of non the visual side of things but the important thing I guess with all this next to reality and virtual reality stuff is that it's not limited to the visual so basically it should be all sensory experience or so all your senses are involved so yeah maybe that's a good idea to not only focus on the individuals so much but also maybe on things like audio like you said I don't like it's really the same question with the use cases when you when you figure out a very good use case where like an audio augmentation helps people there are very alive I think people will start to use it but the way the reason why I focused mostly on the visual part is because I think that it's the most strongest sensory experience people that usually have one day have eyesight at least and I think this is most likely also to be like the selling point of augmented reality will most likely be the visual part yeah okay another one thanks for the talk you mentioned that one of the ways you see the miniaturization of these devices evolving is by streaming data into the cloud but we've seen I mean especially with with smartphones these days having you know the equivalent computational power of you know computers from a decade ago that it is actually possible to do a lot of these you know machine vision tasks on a smartphone and I think some manufacturers are you know like basically trying to get your smartphone to be your primary computer so do you see do you see that as a likely alternative because you know obviously this comes back to the privacy question because if you can keep things locally yeah but it also comes best to what what the the producers of the devices won't want yeah want you to actually do with the devices so yet of course if you have like when you have miniaturization is powerful enough to put it like a whole computer into something like normal glasses you could do that and you don't have to stream that much information but I guess what you you still have to actually do all the stuff because you are not alone and in the world basically were fragmented realities so if everyone else is using augmented reality you need to have the actual data from what the others are doing like you have to build for example and just in just building I have to build a constant room model of how this building looks like so everyone who's moving for this building will constantly scan the environment so to build a differed a model of the environment but you would you have to share that information so that when I move into this building for the first time I still have the whole environment mapped out because someone else already walked through it so you still have to stream all that and you still have yet you still have to share all those data so I think even if you increase the processing power of the devices itself this is not going to change much okay sir okay my question is very much related with all the big players designing the devices it's still a closed world and I would have to imagine I would have to stream a live feed to some Microsoft server or whatever are there any efforts to keep at least interfaces often open if not the whole software open source so for example the CCC could put up a server I trust and send my my life he two together as the system is open or not that you can actually change the location where your information is transmitted to yeah well at least I don't know of any open hardware open software project projects who try to do augmented reality right now of course there's research research it's more or less open most of the time but we search prototypes right now while they are good at what they do they are hardly like consumer products so you can't really must produce them and distribute them to the people so yeah you you probably could do it but I don't see currently I don't see any movement in just regard
yeah I shouldn't do that but just for the previous question I would suggest speak em please I shouldn't do that but to answer briefly the previous question where they are and some effort from Mozilla are trying to bring at least the highest level of the stack in a peaceful fashion for granted reality so okay something to check yeah I was wondering for the example you should on your research in your own lab about information retrieval those examples that are able to distinguish between one object and other let's say an apple and a pear or tomato works well but I'm wondering how scalable it is because when you get to yet a more precise example yeah that'sthat's that's a good point because like what we were using was on actual food database for that so it was very easy to classify like the vegetables because they are food but if you have a database with everything in it of course it's a problem because like classification will get you some weird weird results so it may be I the vegetable would be recognized I don't know as lamp or something like that yeah that's that's a problem but this is only a problem like in this particular research case it was more like a proof of concept to actually show okay how can we use augmented reality and some more practical everyday scenarios it wasn't really much focused on to find a perfect a technical solution providing like the classification of the images this is also why we use an existing service for that and we didn't build our own so we just used what what was available yeah okay unless someone is beaming himself up from the internet then we had all the questions here on cert thank you very very much yeah thank you hope to see you soon [Applause] [Music] [Music]