Okay, here's Mozilla Fish and let's get to it
that I would like to thank again, Annette, for this invitation.
My our shared in a and extended reality.
The topic of my presentation is transforming education
towards 2050.
So the UNESCO's shared a university.
The Lisboa includes at the moment that I am
talking up 35 institutions in four continents.
I'm just outlining a few, including Columbia
University, University of
Maryland, Baltimore County.
That's what we are.
Bizwest stands for the University of North
Carolina, Chapel Hill, Duke University,
the University College, London in the UK, Wellington
University in New Zealand, and three universities in Africa,
including University of Salt May principal and going to Australia.
We have University of Adelaide and also see WA
in the People's Republic of China, University of Toronto in Canada
and Carnegie Mellon University in the United States.
And I think I missed so a couple of
important ones since
we have the Catholic University of Rio de
Janeiro in Brazil and the University of Rio Grande do Sul.
So we spread five continents. It's
we have a collaboration with other UNESCO's chairs on going.
This started with my good friends, of course,
and this share on
UNESCO's Share on Anatomy and Mary
in the University of Paris in France.
We also recently started another collaboration with the
AI and Education units, co-chaired also in Paris and
currently the
I am sure, ensure a strong diversity of this work.
Portugal has said that.
Thank you for the introduction and my colleague Catarina Murata
from University of Technology, Sydney Industrial Australia.
Sorry,
she's more on the A.I.
part and the share was established
in September 20th 1322.
It was approved in September 2022 and
okay, so is myself.
I guess most has been said
my other colleagues here include Professor Anderson Marseille,
the Institute Superior Técnico,
the School of Engineering, or any form of civil war,
is Professor Katarina Murata,
Sydney.
She's working on explainable
AI data science and also in virtual and augmented reality.
And my colleague Joel
PEREIRA, also from is the principal technical,
and he focuses more on
the graphic side of virtual reality.
One of the things that we have done
as a collaboration of the with the Chair of Digital
Anatomy was the publication of a Springer book
where my colleagues, officer
and myself,
together with two other colleagues we've published,
edited and published the book a couple of years ago,
and our focus is mostly on
combining AI and VR and
education, and
especially on the application of
AI and VR to medical domain,
including diagnostics, surgery planning.
And so why are you using
VR in one context and the exciting other as well?
Let me explain this a little bit.
Extended reality or ex SA for
short.
It incorporates virtual reality, augmented reality, and mixed reality.
The difference between virtual reality and augmented reality
is that in virtual reality, people are immersed in a fully
computer generated
synthetic environment, whereas in augmented reality,
people are able to interact with the real world with computer
generated images in both mixed reality and some degree of realism
in the sense that it is possible to mix synthetic characters
in a believable way in the environment and
so we are presenting
Safari visual case studies in the,
uh, exploring in classrooms
that we are focusing on the benefits of extended reality
for engagement and learning and working on the confluence
of artificial intelligence and extended reality.
What have we done?
Well, together with my colleagues in Lisbon, we have focused in
gamification, in blended learning, e-learning
owing to 11 years of experience,
and we have more than a thousand students graduated
at the Masters level in this experiment.
So the virtual reality has
mostly been used for computer aided design visualization.
But we've more recently
it has been used in training because of the 3D
immersive nature
of the experience.
People can fully immerse themselves in synthetic environments
with benefits, and this has been used in
military contexts as you can see in the bottom,
right in flight simulators and even in the European Space
Agency for training people in
performing tasks in the
European Space Station, also in education,
virtual reality, in my opinion, is kind of a missed opportunity.
During the COVID, we focus more.
We have focused more on
meeting video
conference meetings like this, but I believe there are strong cases
to be made for virtual reality in education,
particularly medical training, in surgical training,
in non-surgical environments for diagnosis.
We have focused on
some published work with our New Zealand colleagues
on radiation therapy in the teaching technicians to
perform radiation therapy.
Enhanced reality is also being used for surgery guidance,
and this is one context of research for
for us, including
simulation using physical simulation
and to train young surgeons to use surgical robots,
um, using the added value of virtual reality
to provide immersion and contextual explanations.
Also another focus where we have collaboration with our Brazilian
colleagues is in the manufacturing and maintenance.
So one good advantage of augmented reality, by the way, let me
I don't know if you know, but the term augmented
reality was coined by Boeing, the
American Aircraft
Corporation,
because they have used it extensively since the 1970s
to help technicians in maintaining aircraft.
You you see
the use of augmented reality in maintenance, in
aircraft and automobile engine maintenance,
where you can superimpose two two dimensional
three dimensional instructions and the rotations
and the what comes next for us
is the idea that you can conjugate
augmented and virtual reality with artificial intelligence.
Indeed, with my colleague Catarina
Murata, we are doing a joint collaboration project,
Transatlantic one.
Even really connecting both sides of the world
or using explaining air and virtual reality 4D Nest radiology.
The idea here is that we can use
artificial intelligence combined with virtual reality.
I am committing several details here
explaining how you can use virtual reality to improve
radiology diagnostics
and our both it for this project
is that artificial intelligence
then the extended reality can indeed use to be improve
reading the reading room by controlling illumination
and visualization conditions and in the future
it will be possible to develop personalized medicine
thanks to what we would call the digital twin of patients
where you can use
a 3D visualization and artificial intelligence to better
assess the medical conditions of the patients.
Once you see that we are right now doing is
supervising two
doctoral students on using large language models
for chest X-ray diagnosis, using virtual reality viewing.
The current approaches to X-ray images rely
unique on image pixels to predict diseases.
The problem with this is that
the deep learning models that are being used now
can be reliably more or less predict
diseases based on the radiography.
But they do not provide explanations
that this is a problem because radiologists and patients
do not feel comfortable if they cannot be offered
an explanation of what features in an image or in their clinical data
motivated such a momentous
diagnosis takes it. So
the problem and the challenge is, is that current language models
such as such CBT, can
make for very interesting diagnostics.
And you are sure that
we are showing on the lower left a very verbose diagnostics
provided by said CBT
using the data from a classifier,
an artificial intelligence classifier.
But the problem is that
these diagnostics cannot be reliable, are often
not reliable and we checked this with radiologists.
So if large language models
provide seemingly believable but false
diagnostics, how can this be improved?
And our idea is to use a single technology
artifact called the knowledge graph.
And knowledge graphs are data structures,
computer science, data structures that can encode human knowledge
as the graph structure representing concepts
and associations such as, for instance, lung
cancer can be caused or can cause shortness of breath.
And that's one of the symptoms.
And we can harness the power of these knowledge graphs
from institutions like Radio PD about worth.
That is kind of a specialized Wikipedia
for radiologists, and we can extract these.
Not a lot of the knowledge graphs from the medical literature,
and then we can use these to correct or force subject
or other like large language models to provide
reliable, trustworthy
radio diagnostics.
So this is one example where we can foresee the contribution
of artificial intelligence and virtual reality
to improve and
to improve
diagnostics and to provide more explainable
diagnosis, which is important
when you want to communicate this with patients.
Another thing that we are starting
is integrated l
Large language models and extended reality in education, particularly
the application of anatomy, where we can use the
the the dialog capabilities of ship
bots to improve the interaction of students with subject matter.
Why digital anatomy?
Because digital anatomy combines the best of both worlds
where you can use
the 3D, no ligature of human
anatomy and capture the dialog capabilities and immersion
of virtual reality combined with artificial intelligence
in large language models to enrich
the student experience.
And so I'm sorry, I'm
taking much more than my 15 minutes, but I will finish shortly.
Our future research directions include combining
VR and launch language models for teaching about the MI, using
artificial intelligence and extended reality for remote collaboration.
That's an ongoing project with Duke University
and the University of North Carolina and Remote Education,
which is some of these two capabilities and with that said,
I would like to say a simple,
gracious and state that we are open to collaboration.
As you can see, we are already ongoing projects with other
unicycle chairs and we salute you, Ned, for taking this opportunity
for for increasing our networking
and the collaboration between
unicycle chefs.
And with that, I would like to thank very much everybody
for your attention.
Notice that whoever.
Thank you very much looking.
Thank you for your interest in took.