Text

Computer vision AI to interpret medical changes

Text

Computer vision use cases in health care

Watch this talk by Vibhor Dawar, director, Data Science, Optum Global Solutions (India) Private Limited, at the Machine Learning Developers Summit (MLDS) 2023.

Video Component

00:00:05:27 - 00:00:08:08

Good morning, everyone,

and thank you for the opportunity

 

00:00:08:08 - 00:00:10:13

to be here in front of you

to talk about this topic.

 

00:00:12:09 - 00:00:15:27

We'll cover broadly these five things

during the entire next 30 minutes,

 

00:00:15:27 - 00:00:19:19

and I'll try to go over

some of the things that the two sessions

 

00:00:19:19 - 00:00:21:02

in the beginning have set context

 

00:00:21:02 - 00:00:25:05

on much around deep learning

as well as a lot around error analyzes.

 

00:00:25:05 - 00:00:25:27

Honestly,

 

00:00:25:27 - 00:00:29:01

I have a sweet tooth and I saw the bear

on Toblerone for the first time

 

00:00:29:08 - 00:00:31:06

So that is interesting.

 

00:00:31:06 - 00:00:34:15

But we'll quickly talk about the image

landscape in health care, the acquisition

 

00:00:34:28 - 00:00:36:03

and some pre-processing.

 

00:00:36:03 - 00:00:36:22

What is the real

 

00:00:36:22 - 00:00:40:09

opportunity landscape of how these things

are being pursued in the industry?

 

00:00:40:21 - 00:00:44:04

Some basics of computer vision,

which I'll probably skip through

 

00:00:44:19 - 00:00:48:15

if time permits i still cover

but I want to spend more time on two

 

00:00:48:15 - 00:00:53:25

use-cases of how this is being used

in the medical for the

 

00:00:55:05 - 00:00:57:02

assessment of the images

 

00:00:57:02 - 00:00:59:05

to take decisions

on the clinical criteria.

 

00:01:01:03 - 00:01:04:21

But before I start a quick overview,

so I'm part of Optum

 

00:01:04:29 - 00:01:07:26

and Optum a part of the UHG,

which is the health services,

 

00:01:08:00 - 00:01:12:02

a health organization

that's a Fortune five company

 

00:01:12:02 - 00:01:15:02

with more than $300 billion revenue

 

00:01:15:02 - 00:01:18:08

in FY 2022

 

00:01:18:08 - 00:01:20:27

and Optum is a leading health services

 

00:01:20:27 - 00:01:23:22

and information and technology enabled

health services player in the market

 

00:01:24:01 - 00:01:26:29

with businesses across Optum

Insight, Optum Health and Optum Rx

 

00:01:27:12 - 00:01:30:22

that leads in transforming

the health care space.

 

00:01:31:13 - 00:01:32:04

Let's talk

 

00:01:32:04 - 00:01:33:23

about clinical images first.

 

00:01:33:23 - 00:01:38:24

So medical imaging normally creates

images of various parts of the body

 

00:01:39:03 - 00:01:42:28

to be able to help with detection

of certain kind of image conditions.

 

00:01:43:09 - 00:01:45:28

There are a variety

of these clinical images that come in

 

00:01:46:03 - 00:01:48:21

and just to relate to a few examples,

ultrasounds

 

00:01:48:28 - 00:01:52:14

really are used, for like one example,

for detecting kidney stones.

 

00:01:54:12 - 00:01:57:05

Radiology X-rays,

I think just to relate to something

 

00:01:57:05 - 00:02:01:04

very recent is all about

detecting pneumonia and COVID

 

00:02:01:15 - 00:02:02:18

and with

 

00:02:03:03 - 00:02:05:16

MRI is helping us more understanding

 

00:02:05:18 - 00:02:08:25

the symmetry of the bone

and also other bone related conditions.

 

00:02:10:13 - 00:02:12:27

But beyond images

that come from radiology,

 

00:02:12:27 - 00:02:16:26

there are also other kinds of images,

like photographic images, where certain

 

00:02:16:26 - 00:02:21:15

clinical conditions can be identified

through visual assessment, for example,

 

00:02:21:15 - 00:02:22:24

eyelid drooping or certain

 

00:02:22:24 - 00:02:26:25

cosmetic procedures that require a certain

kind of medical necessity checks.

 

00:02:27:04 - 00:02:31:24

but irrespective of the kind of image,

it still requires deep clinical expertise

 

00:02:32:01 - 00:02:36:03

to be able to correctly interpret

the image, detect the disease,

 

00:02:36:20 - 00:02:39:08

understand the progression of disease

in applicable cases,

 

00:02:39:18 - 00:02:42:24

but also compute certain

objective criteria to understand

 

00:02:42:24 - 00:02:45:02

maybe the severity

or the extent of the disease.

 

00:02:45:16 - 00:02:46:19

And that requires us.

 

00:02:46:19 - 00:02:49:13

And that requires

great technical expertise. Now.

 

00:02:50:16 - 00:02:52:10

Unfortunately,

 

00:02:52:11 - 00:02:55:10

one thing that happens

is that this is subjective decision

 

00:02:55:10 - 00:02:58:12

making that vary

significantly from one clinician to another,

 

00:02:58:26 - 00:03:01:09

based on their experience,

based on their field of practice.

 

00:03:02:19 - 00:03:06:00

And what this leads to

is a variation in the delivery of

 

00:03:06:00 - 00:03:10:12

health care to intended users

or intended members, and their

 

00:03:10:12 - 00:03:14:10

impacting health outcomes.

The use of AI can significantly augment

 

00:03:14:10 - 00:03:18:23

human decision making over here, driving

high consistency in the decision making,

 

00:03:18:23 - 00:03:22:20

making it more accurate,

reducing that variation,

 

00:03:22:26 - 00:03:26:26

and also ensuring this gets done

more optimally at a lower cost.

 

00:03:27:13 - 00:03:31:27

To give an example of a recent study,

the Babylon AI solution

 

00:03:32:21 - 00:03:37:01

had an 80% overall accuracy on processing

these on generating intelligence

 

00:03:37:01 - 00:03:41:00

from these images with up to 98% accuracy

on certain diagnoses

 

00:03:41:06 - 00:03:44:26

which are very common in primary care

conditions, primary care setting, sorry.

 

00:03:45:09 - 00:03:47:29

And when that same study

or same set of images were analyzed

 

00:03:47:29 - 00:03:51:19

by a set of doctors who participated

in that study, their accuracy

 

00:03:51:19 - 00:03:56:24

varied from 64% to 94%,

which is again just an example of really

 

00:03:57:01 - 00:03:59:08

talking about the kind of variation

that exists

 

00:03:59:08 - 00:04:03:01

and leads to inconsistent delivery

and then impacting the health outcomes.

 

00:04:05:17 - 00:04:06:26

But one of the most important part

 

00:04:06:26 - 00:04:10:02

on all of this is image acquisition

Now for a health care company,

 

00:04:10:02 - 00:04:12:01

there's an abundance

of these images available

 

00:04:12:01 - 00:04:14:02

that come through into the enterprise,

 

00:04:14:02 - 00:04:18:03

through a lot of processes across

the entire health care lifecycle - right,

 

00:04:18:03 - 00:04:21:27

from seeking authorization,

whether a service can be rendered

 

00:04:22:05 - 00:04:23:12

to being able to reimburse

 

00:04:23:12 - 00:04:27:02

a provider for renting that service site,

all of these images come through.

 

00:04:27:13 - 00:04:30:10

But in other scenarios, they can also

be sourced from external images.

 

00:04:30:29 - 00:04:35:14

However, what's still more important is

not just good volume but also good quality,

 

00:04:35:23 - 00:04:39:11

which is most of the time or in many times

not enough.

 

00:04:39:11 - 00:04:42:03

That requires

pre-processing. Pre-processing

 

00:04:42:03 - 00:04:44:26

in augmentation really helps us

improve the quality of images,

 

00:04:45:06 - 00:04:48:27

but then also create variance or,

let's say, synthetic images

 

00:04:49:06 - 00:04:50:08

that allow us to create more

 

00:04:50:08 - 00:04:53:10

generalized models that can perform

better or larger sets in future.

 

00:04:54:05 - 00:04:56:16

Now, while good volume of images

 

00:04:56:16 - 00:05:01:06

is there while quality can be improved,

what is still is a dearth of

 

00:05:01:06 - 00:05:05:05

is labeled annotated data

because this requires clinical expertise,

 

00:05:05:05 - 00:05:06:22

as I talked about in the previous slide,

 

00:05:06:22 - 00:05:09:24

not just interpretation,

but even to train these algorithms

 

00:05:10:00 - 00:05:12:21

that clinical expertise is extremely important.

 

00:05:12:21 - 00:05:13:20

And that is where

 

00:05:14:28 - 00:05:15:15

if not done

 

00:05:15:15 - 00:05:18:17

properly, it impacts the outcomes of what

your model performance is going to be.

 

00:05:18:29 - 00:05:22:06

Just explain this on a very simple view

What you see on

 

00:05:22:06 - 00:05:25:05

the slide is a sample

of an annotated image of maxillary sinus.

 

00:05:25:09 - 00:05:28:06

The frontal area,

uh, these light blue color

 

00:05:28:06 - 00:05:31:03

is the bone area, and the black part

you see is the air cavity.

 

00:05:31:14 - 00:05:35:15

When we want to detect sinusitis,

essentially what we're trying to detect is

 

00:05:35:15 - 00:05:38:16

what is the percentage of air cavity

that is blocked by mucus.

 

00:05:38:26 - 00:05:43:17

Now, imagine if I'm unable to correctly annotate

 

00:05:43:20 - 00:05:44:28

the area of interest,

 

00:05:44:28 - 00:05:48:11

then what can it do to my predictions

later during my assessment

 

00:05:48:29 - 00:05:51:14

There are some techniques mentioned

previously in agumentation

 

00:05:51:22 - 00:05:53:11

I do not want to do

as they have been covered

 

00:05:53:11 - 00:05:56:11

to some extent in the previous

two slides, previous two sessions actually

 

00:05:57:18 - 00:05:59:10

. Now going beyond

 

00:06:00:06 - 00:06:02:27

annotation, let's look at some broad

use cases in the industry,

 

00:06:03:08 - 00:06:05:14

at least in the health care industry,

where these are being used today.

 

00:06:05:25 - 00:06:07:04

One prior authorization.

 

00:06:07:04 - 00:06:09:16

So in the US health care system, essentially it's

 

00:06:09:16 - 00:06:12:05

such a tightly controlled,

regulated system by the government

 

00:06:12:05 - 00:06:14:20

having a set of standards

about how the entire process works

 

00:06:15:11 - 00:06:17:24

Now prior authorization is where

 

00:06:18:13 - 00:06:21:26

for certain specific procedures

or high costing procedures

 

00:06:23:02 - 00:06:26:11

in short it requires providers

 

00:06:26:11 - 00:06:29:27

to seek a prior auth or a pre-approval

before their service can be rendered.

 

00:06:30:07 - 00:06:33:23

Now, what this requires is assessment

at the insurers,

 

00:06:33:23 - 00:06:37:11

end to be able to ensure medical necessity

is there to render the service.

 

00:06:37:11 - 00:06:40:09

And this can lead to material improvement

in the health outcome

 

00:06:40:22 - 00:06:41:28

and that is the prior process.

 

00:06:41:28 - 00:06:44:01

So advanced computer vision systems

 

00:06:44:28 - 00:06:48:13

based clinical decision support system

to extract objective criteria

 

00:06:48:13 - 00:06:52:15

from the radiographic or photographic

images has been meaningfully helpful

 

00:06:52:15 - 00:06:54:27

to assist the reviewers

in the decision making.

 

00:06:54:27 - 00:06:58:05

But sometimes in these medical records

where these images are sourced from,

 

00:06:58:08 - 00:07:01:03

they are also additional context

that is situated in the text

 

00:07:01:12 - 00:07:04:17

so extraction of both the image

objective criteria and text provides

 

00:07:04:17 - 00:07:08:08

with them a more comprehensive

understanding or assistance of what

 

00:07:10:03 - 00:07:12:26

can help them to make right their decision.

 

00:07:12:26 - 00:07:17:03

Another example I take is on claim

processing. In the dental claim process,

 

00:07:17:03 - 00:07:21:27

again, when the claim comes

in, it is supported with dental X-rays

 

00:07:22:03 - 00:07:24:05

and there are classes of dental X-rays

right from

 

00:07:24:05 - 00:07:27:00

like whether it's from the left side,

right side and all that stuff.

 

00:07:27:27 - 00:07:30:26

But when a claim has to be processed,

two assessments have to be made?

 

00:07:31:14 - 00:07:35:11

First one is what is the guideline

of the image that is required

 

00:07:35:19 - 00:07:36:25

for that specific case?

 

00:07:36:25 - 00:07:40:10

And is the dental X-ray that has been provided

compliant with that guideline

 

00:07:40:19 - 00:07:43:05

and necessary to process that claim?

 

00:07:43:05 - 00:07:45:00

So that has been a very,

 

00:07:45:17 - 00:07:45:27

I would say,

 

00:07:45:27 - 00:07:49:24

prominent use case in the industry,

not just dental, but even in other areas.

 

00:07:49:24 - 00:07:53:21

Third is form processing computer

vision is being used today along with NLP

 

00:07:53:21 - 00:07:57:20

to extract entities from claim form images.

You know claims are lengthy forms

 

00:07:58:04 - 00:08:00:17

where a lot of information

has to be extracted .

 

00:08:00:17 - 00:08:01:20

Whether these are extracted

 

00:08:01:20 - 00:08:06:01

for just data entry purposes to digitize

and make it a workable object

 

00:08:06:01 - 00:08:10:15

all to extract certain things to fit into

an automation is use case specific.

 

00:08:10:21 - 00:08:14:10

But one example over here is identifying

which checkboxes

 

00:08:14:10 - 00:08:17:29

have been selected so that you know

what have the provider has

 

00:08:19:00 - 00:08:21:01

basically filled in and you can extract

 

00:08:21:01 - 00:08:24:00

those specific features or inputs

and figure the further processes.

 

00:08:25:04 - 00:08:28:12

Context extraction - even beyond images,

 

00:08:29:11 - 00:08:32:20

medical records

that come as an image, right

 

00:08:32:20 - 00:08:36:26

intelligence medical document processing is decomposing

that unstructured document to extract

 

00:08:36:26 - 00:08:40:19

context of what that description

 

00:08:40:19 - 00:08:42:24

or the medical statement

is trying to convey.

 

00:08:42:24 - 00:08:45:20

And that is further

helping the reviewers in their decision

 

00:08:45:20 - 00:08:47:26

making, along with the visual

input that they are getting.

 

00:08:51:07 - 00:08:53:27

Now I will not covered too much over here

but again

 

00:08:54:07 - 00:08:58:02

image at a very simple

level is a set of matrices and numbers.

 

00:08:58:11 - 00:09:01:01

But those numbers really have to mean

something before

 

00:09:01:01 - 00:09:05:17

they can be put to good use

and for your AI purposes.

 

00:09:06:00 - 00:09:08:29

They are various techniques out there

which help you create those features.

 

00:09:09:09 - 00:09:10:19

Histogram of oriented

 

00:09:10:19 - 00:09:14:10

gradients is one of the most frequently

used features that perform really well

 

00:09:14:22 - 00:09:17:11

because it not only helps

you understand the difference

 

00:09:17:11 - 00:09:20:25

between pixels, but also the orientation

of those, the gradients of those.

 

00:09:20:25 - 00:09:25:20

And that has meaningful implications,

I would say, for X criteria as well.

 

00:09:26:18 - 00:09:29:27

Various types of networks

like convolutional neural networks and

 

00:09:30:24 - 00:09:31:21

vision transformers

 

00:09:31:21 - 00:09:35:16

today, they do a pretty good job

in terms of assessing all those features

 

00:09:35:16 - 00:09:37:10

and really predicting the outcome class

 

00:09:37:10 - 00:09:41:09

quite effectively. Both have a difference

in their underlying base architectures,

 

00:09:41:09 - 00:09:46:16

where CNN's commonly used filters

to be able to convolve

 

00:09:46:24 - 00:09:51:00

the entire image in patches

and create features through those filters.

 

00:09:51:00 - 00:09:53:23

Whereas vision transformers

normally split an image into a patch

 

00:09:54:06 - 00:09:57:25

into multiple patches and basically

flatten them and feed them into the

 

00:09:58:11 - 00:10:01:11

desired input dimension to enable

 

00:10:01:11 - 00:10:02:21

the prediction of right kind of classes.

 

00:10:02:21 - 00:10:03:13

But both are good

 

00:10:03:13 - 00:10:07:05

examples of transfer learning

where pre-built learning is being used.

 

00:10:07:16 - 00:10:10:09

Pre-built learning on a certain

kind of outcome is

 

00:10:10:09 - 00:10:13:20

being used to really learn

or train a model for a similar class.

 

00:10:15:28 - 00:10:16:22

And why I wanted to

 

00:10:16:22 - 00:10:19:14

really skim through those two slides

because I think those are basics.

 

00:10:19:14 - 00:10:21:09

But I also got covered

in the first two sessions.

 

00:10:21:09 - 00:10:22:16

But what really is important

 

00:10:22:16 - 00:10:26:21

to understand, two use cases of how

this has been used in the industry today.

 

00:10:26:24 - 00:10:30:12

Let's look at the first one,

which is the spondylitis problem.

 

00:10:30:12 - 00:10:32:24

Now, what is the problem

in the first place?

 

00:10:33:15 - 00:10:37:25

This is a situation where a certain part

of a bone in your spine

 

00:10:37:28 - 00:10:41:06

called a vertebra, moves forward

in simple terms,

 

00:10:41:08 - 00:10:44:17

a sort of slip disk.

 

00:10:44:17 - 00:10:49:00

The requirement over here for us

was how to identify

 

00:10:49:00 - 00:10:53:01

which vertebra slip has happened

and what is a displacement of that

 

00:10:53:13 - 00:10:57:13

and can we create an objective measure

to really express that displacement?

 

00:10:58:01 - 00:11:02:28

Now, such images come in

abundance in a single document

 

00:11:03:24 - 00:11:08:07

because the MRI will decompose the

I would say the spine structure

 

00:11:08:07 - 00:11:10:12

from multiple angles

and present a lot of images.

 

00:11:10:12 - 00:11:13:12

But what is the most relevant

image over here is the

 

00:11:14:13 - 00:11:17:01

midsagittal view of the lumbar region.

 

00:11:17:01 - 00:11:20:23

Essentially, think of it this way,

if I take a plane and just slice myself half

 

00:11:20:23 - 00:11:23:28

the spine view that gets created

is the view I'm talking about,

 

00:11:24:08 - 00:11:27:09

that is the most relevant,

most appropriate view of being able

 

00:11:27:09 - 00:11:29:06

to make this assessment

in the first place.

 

00:11:29:06 - 00:11:32:26

Now, when you get a lot of these

images of the spine, the first idea,

 

00:11:32:29 - 00:11:38:10

the first step for us really is to use

object detection models to identify

 

00:11:38:10 - 00:11:41:21

which is the right image

that can be used for further steps.

 

00:11:42:05 - 00:11:44:25

But once you've identified that,

I think we've used YOLO framework

 

00:11:45:00 - 00:11:48:28

to be able to create object

detection models for the first part.

 

00:11:49:15 - 00:11:53:00

Now, in this segment,

the second step is for us that we have

 

00:11:53:08 - 00:11:58:09

prepared a segmentation model to identify

where these individual vertebra are.

 

00:11:58:09 - 00:12:02:01

So first to annotate the images

which we have created

 

00:12:02:01 - 00:12:05:15

mask for each of the vertebra,

and then fed into this segmentation model

 

00:12:06:01 - 00:12:09:19

based on the unit architecture

with mainstreamed on imagenet

 

00:12:10:12 - 00:12:12:15

pre trained weights , imagenet weights to get to this.

 

00:12:12:15 - 00:12:16:23

Now over here, I think what to call out

is that I've highlighted two specific

 

00:12:16:23 - 00:12:20:16

vertebra in green and red,

but the model will basically try

 

00:12:20:16 - 00:12:22:12

to predict all of the vertebras

 

00:12:22:12 - 00:12:25:15

why just two over here, one to make it

less confusing for the conversation.

 

00:12:25:15 - 00:12:26:08

But secondly.

 

00:12:27:16 - 00:12:28:09

This green

 

00:12:28:09 - 00:12:30:21

vertebra, which is the fifth

one in the lumbar region, is called L5

 

00:12:31:16 - 00:12:33:25

and the first one is called the sacrum.

 

00:12:35:00 - 00:12:37:26

Most of the listhesis that happens,

happens at this point.

 

00:12:38:12 - 00:12:40:12

So I'm trying to explain this concept from here.

 

00:12:40:28 - 00:12:45:22

Once we have identified

what is the vertebra of interest.

 

00:12:46:06 - 00:12:49:05

The next step is to understand

how much is the displacement.

 

00:12:49:29 - 00:12:52:09

So far, my predictions

have happened to an extent over here.

 

00:12:52:19 - 00:12:55:28

Now I'm getting into the second part

of my use case, which is

 

00:12:56:11 - 00:12:59:11

what is the displacement

or what is the objective criteria?

 

00:12:59:14 - 00:13:05:08

So just to explain this, think of it,

I'll draw one tangent across my lumbar L5.

 

00:13:05:08 - 00:13:10:01

A second, tangent to the sacrum S1

that we have looked into.

 

00:13:10:01 - 00:13:12:16

And then a horizontal plane

across the lower vertebra

 

00:13:13:14 - 00:13:16:25

the intersection of these tangents

from both the tangents

 

00:13:16:25 - 00:13:19:18

on the horizontal plane

creates a certain distance

 

00:13:20:07 - 00:13:22:26

that the ratio of that distance

 

00:13:22:26 - 00:13:25:07

to the overall width of the lower vertebra

 

00:13:25:17 - 00:13:29:06

is what a clinician defines for us

that is the objective measure

 

00:13:29:15 - 00:13:33:20

that could be of material

use for them and this displacement is then

 

00:13:36:27 - 00:13:38:02

reviewed by those

 

00:13:38:02 - 00:13:41:08

clinicians during a prior-auth process to be able to say,

 

00:13:42:06 - 00:13:44:08

'Is this medically necessary?'

 

00:13:44:08 - 00:13:47:20

Is this displaced enough to be able

to approve a certain kind of treatment?

 

00:13:48:01 - 00:13:50:21

And that is how utilization management

normally happens in the industry

 

00:13:50:28 - 00:13:52:19

in this specific case.

 

00:13:52:19 - 00:13:55:23

So now, again,

certain basic metrics over here.

 

00:13:56:02 - 00:13:59:03

One thing which is most important

for us was really being the accuracy

 

00:13:59:03 - 00:14:02:01

by which we are able

to locate the vertebra.

 

00:14:02:12 - 00:14:04:08

So you define dice coefficient.

 

00:14:04:08 - 00:14:08:10

Essentially, it's an reference

score in a sense where of all the pixels

 

00:14:08:10 - 00:14:11:24

that are of interest

that were in the ground root for us, that

 

00:14:12:02 - 00:14:14:14

we took image for L5 and S1,

 

00:14:15:05 - 00:14:17:19

we have looked at what are the

 

00:14:17:19 - 00:14:20:24

What is the area of overlap

on the predicted pixels?

 

00:14:20:24 - 00:14:22:17

And we are trying to basically

just compute

 

00:14:22:17 - 00:14:26:28

that as a base and efforts two times

the area of overlap versus

 

00:14:26:28 - 00:14:29:15

the total number of pixels in the ground

truth and duplicate elements.

 

00:14:29:15 - 00:14:31:03

Essentially in this one score,

 

00:14:31:03 - 00:14:34:00

pixel accuracy is not really

a good measure in such scenario.

 

00:14:34:00 - 00:14:36:22

Again, class imbalance

and that is nothing different

 

00:14:36:22 - 00:14:39:02

than what we do

in, I would say, structured data.

 

00:14:39:14 - 00:14:43:01

But you just go to

those numbers at 0.82

 

00:14:43:20 - 00:14:44:28

does that for reference purposes.

 

00:14:44:28 - 00:14:47:14

But the Dice coefficient here

was a more suitable measure for us

 

00:14:47:14 - 00:14:51:29

to really get a sense of accuracy

that these solutions are basically creating.

 

00:14:51:29 - 00:14:54:13

And in general other use cases in the industry.

 

00:14:58:25 - 00:15:01:03

The other example I want to talk about.

 

00:15:01:03 - 00:15:04:00

So the previous one was more

of a segmentation solution based solution,

 

00:15:04:01 - 00:15:07:11

and this one is more regression

based solution, orthognathic surgeries.

 

00:15:07:24 - 00:15:09:27

So what this is really.

 

00:15:09:27 - 00:15:12:00

Orthognathic surgery,

essentially is jaws surgery

 

00:15:12:11 - 00:15:16:10

that looks at the deformities in the jaw

and their teeth between jaw

 

00:15:16:10 - 00:15:20:04

and their teeth and helps align them

so that they function the way they should.

 

00:15:20:18 - 00:15:23:12

And these surgeries

sometimes also lead to changes

 

00:15:23:12 - 00:15:26:08

in the facial structure of your appearances.

 

00:15:27:11 - 00:15:29:20

There is a specific type of,

 

00:15:29:20 - 00:15:32:06

I would say, X-ray images or radiology images

 

00:15:32:06 - 00:15:36:02

that are materially useful for this kind

 

00:15:36:02 - 00:15:39:04

of assessment called cephalometric X-rays

 

00:15:39:16 - 00:15:42:00

and they are basically

 

00:15:43:04 - 00:15:43:24

very proficient

 

00:15:43:24 - 00:15:48:12

in being able to do a good assessment

of x-ray of craniofacial region.

 

00:15:49:15 - 00:15:50:07

Similar to the

 

00:15:50:07 - 00:15:53:12

previous situation

where when we have this kind of condition

 

00:15:53:12 - 00:15:56:15

documents coming in

or we see a lot of these images.

 

00:15:58:25 - 00:16:00:16

The first objective is to identify

 

00:16:00:16 - 00:16:04:09

the right lateral supplementric x-ray,

which can be used for these purposes.

 

00:16:04:22 - 00:16:05:27

So again, object detection

 

00:16:05:27 - 00:16:09:12

models help you identify those images

with certain position.

 

00:16:09:27 - 00:16:13:13

Once you have identified the images,

what is really is

 

00:16:13:13 - 00:16:16:28

a supplementric assessment over here

is that there are certain points,

 

00:16:17:19 - 00:16:22:01

I would say, on the skull area

and the soft tissue area.

 

00:16:22:15 - 00:16:24:22

And those points are.

 

00:16:24:23 - 00:16:26:18

That is how a doctor really would

 

00:16:26:18 - 00:16:28:28

look at these points set up manually

 

00:16:29:20 - 00:16:32:08

and you see the small green

dots on the screen.

 

00:16:32:08 - 00:16:34:24

Yeah, these are certain points

 

00:16:34:24 - 00:16:37:08

which are on the area

where what you look at is

 

00:16:37:08 - 00:16:40:13

a doctor would create these points

and then try to create a few angles,

 

00:16:41:05 - 00:16:45:17

sagittal analysis and vertical analysis

that really are defined clinical standards

 

00:16:45:26 - 00:16:51:15

to understand whether this situation has

developed and requires the surgery.

 

00:16:52:13 - 00:16:52:23

Couple of things

 

00:16:52:23 - 00:16:56:16

to note over here

is that this is a very time taking

 

00:16:56:16 - 00:16:59:27

task on a doctor from their perspective

 

00:16:59:27 - 00:17:02:13

and still manually cumbersome. So.

 

00:17:03:22 - 00:17:06:19

Solutions over here

are able to help you plot these

 

00:17:07:25 - 00:17:10:07

predict this basically

 

00:17:10:07 - 00:17:12:23

points on the on the image

 

00:17:13:02 - 00:17:17:08

and then we draw these angles as per

the guidance which again are not

 

00:17:17:08 - 00:17:21:06

being used to really take a decision

or establish a condition.

 

00:17:21:06 - 00:17:24:25

Because one thing to note

is that when you talk of faces over here

 

00:17:25:12 - 00:17:28:00

and these kind of angles,

they may have different kind of,

 

00:17:28:19 - 00:17:29:29

I would say.

 

00:17:31:12 - 00:17:34:12

A different outcome

by age, by gender, by ethnicity.

 

00:17:34:22 - 00:17:38:19

So you cannot generalize angles over here

to really explain a certain condition

 

00:17:38:19 - 00:17:39:19

has happened or not.

 

00:17:39:19 - 00:17:42:02

So we then create this kind of an assistance

 

00:17:42:15 - 00:17:45:02

offer this to a clinician

who would normally look at these

 

00:17:45:10 - 00:17:50:05

and then take their own decision

of whether this, uh, surgery

 

00:17:50:05 - 00:17:54:11

should be approved, should

we act on this in the first place does it materially solve

 

00:17:54:11 - 00:17:57:28

or improve the health outcome

that is being desired for this patient.

 

00:17:58:23 - 00:18:03:08

Now two or three important things

I would talk about in addition over here.

 

00:18:05:13 - 00:18:07:25

The way I look at it is that.

 

00:18:08:26 - 00:18:11:00

First of all, these are all augmentations.

 

00:18:11:14 - 00:18:14:13

AI has gotten really good at doing

 

00:18:14:21 - 00:18:17:25

routine task that human

can't do, there's no doubt about that.

 

00:18:18:12 - 00:18:22:13

But I think tasks that impact human life

can't be left completely to machines,

 

00:18:22:22 - 00:18:26:29

and that is where being able to augment

human decisioning with the help of

 

00:18:26:29 - 00:18:30:24

AI can be a significant boost,

both in terms of reducing variability.

 

00:18:31:15 - 00:18:34:12

I highlighted a study or experiment

in the beginning,

 

00:18:35:20 - 00:18:39:12

both in terms of being more accurate

in improving health outcomes,

 

00:18:39:22 - 00:18:41:27

but also doing it

more optimally at a lower cost.

 

00:18:41:28 - 00:18:45:02

Think of this with the US health care

system

 

00:18:45:12 - 00:18:47:21

produces billions of claims every year.

 

00:18:48:22 - 00:18:50:24

And that's only medical claims.

 

00:18:50:24 - 00:18:53:02

There could be other kinds of pharmacy

claims and stuff like that.

 

00:18:53:02 - 00:18:55:15

And this number is in billions

for the US health care system

 

00:18:55:27 - 00:19:01:00

and there is significant radiologist

burnout, significant pressures on doctors,

 

00:19:01:00 - 00:19:05:12

providers, clinicians to be able to manage

this administrative workload.

 

00:19:05:25 - 00:19:10:10

Industry has been focusing a lot

on being able to use technology

 

00:19:10:22 - 00:19:13:14

to enable these clinicians enable

the providers

 

00:19:14:00 - 00:19:17:00

to get rid of administrative burden,

but focus their time

 

00:19:17:00 - 00:19:18:21

more on treating the patients.

 

00:19:18:21 - 00:19:21:10

And that is where these assistants

are being widely adopted

 

00:19:22:09 - 00:19:23:13

to, widely

 

00:19:23:13 - 00:19:26:05

adopted as human augmentation

or decision support tools

 

00:19:26:15 - 00:19:30:04

to really help

the US health care practitioners.

 

00:19:30:21 - 00:19:33:07

The other part also is that.

 

00:19:33:16 - 00:19:36:24

We always are very because this impacts

human life.

 

00:19:36:24 - 00:19:40:25

And I would say from

even a general perspective,

 

00:19:41:15 - 00:19:43:23

we are big advocates of responsible

use of AI

 

00:19:43:26 - 00:19:46:03

So even while selecting

all of these samples.

 

00:19:47:06 - 00:19:49:23

I think it's important

for any practitioner

 

00:19:50:06 - 00:19:53:15

to ensure that there is a good representation across

 

00:19:53:15 - 00:19:57:26

the various kind of age

demographic ethnicities

 

00:19:58:07 - 00:20:01:29

so that the models are not biased towards

one kind of population.

 

00:20:02:09 - 00:20:05:24

They work equally well for a Hispanic

or an Asian or an American and so on.

 

00:20:06:07 - 00:20:10:11

Otherwise, what will happen is there

will be disparity in delivery of care,

 

00:20:10:23 - 00:20:14:10

which again, was another basic

principles of ensuring good health

 

00:20:14:10 - 00:20:15:00

care for everyone.

 

00:20:15:00 - 00:20:16:15

And that is what the government

really wants to do.

 

00:20:16:15 - 00:20:18:25

And I think every health care

provider wants to do

 

00:20:18:25 - 00:20:20:18

take good care of their members.

 

00:20:20:18 - 00:20:23:04

So I think those are the two or

three most important things

 

00:20:24:06 - 00:20:26:14

which are necessary over here.

 

00:20:28:13 - 00:20:30:18

Other than that

 

00:20:30:27 - 00:20:33:12

Yeah, I think this is pretty much

what I wanted to cover,

 

00:20:33:13 - 00:20:35:21

but it's more about the right

kind of use cases

 

00:20:35:21 - 00:20:37:16

which can drive these outcomes again.

 

00:20:37:16 - 00:20:42:05

One last point,

these technologies are not there

 

00:20:42:05 - 00:20:45:09

to replace doctors per say

because I'll just quote

 

00:20:45:09 - 00:20:47:27

my previous statement 'decisions

that impact human life

 

00:20:48:10 - 00:20:52:19

can't be left to machines,

but they can significantly accelerate

 

00:20:53:06 - 00:20:57:07

how AI can be adopted across

much broader industries and also manage

 

00:20:57:07 - 00:21:00:04

the administrative workload

in the health care industry.'

 

00:21:02:01 - 00:21:02:18

Yeah.

 

00:21:02:19 - 00:21:03:02

I think I'll.

 

00:21:03:02 - 00:21:05:28

I'll take a pass, but anything I can.

 

00:21:07:12 - 00:21:09:13

Address. Yep.

 

Text

In this session, Vibhor shares insights on leveraging medical imaging AI tools to identify, classify and locate specific health conditions, like severity of knee-joint-space, location of vertebrae slip and more.