Humans and AI - Justifying trust
CIOReview
CIOREVIEW >> Artificial Intelligence >>

Humans and AI - Justifying trust

Mark Parkinson, Next Generation Technology Director at Mars
Mark Parkinson, Next Generation Technology Director at Mars

Mark Parkinson, Next Generation Technology Director at Mars

I’ve been very fortunate to have worked at Mars for more than 22 years, across several countries and a variety of technologies, including large SAP implementations and the deployment of global collaboration capabilities to more than 45,000 Associates.

In the last 3.5 years, I was put in a unique position where I’ve been able to build up an internal team of data scientists (who I chose from broad backgrounds, including but not limited to, a Mathematician, a data scientist, a bioinformatician and my own Physics (PhD) background).

The scope ofwork that we undertake is broad and goes across several Mars business units and functions, but one common factor is trust. How do we get people to trust the results from machine learning?

Without trust, people won’t leverage the benefits of machine learning at all or as fully as they otherwise could. Here at Mars, we envisage humans and artificial intelligence (AI) working together, giving us the ability to leverage the best of both worlds.

So to help us gain that trust, we approach the problem from a number of different directions.

There is no one size fits all since each problem we are solving for has unique aspects to it. Being able to see where an algorithm is looking can be useful where the outputs of a model are visual, whereas seeing how the different input values were weighted in terms of importance for a specific numerical output can be important in other situations.

First and most importantly, we must identify and ask the right question, and that requires leveraging a process that is called design thinking with key user groups

  ​For humans and AI to work together most effectively, its crucial to build trust at every stage of development  

Here at Mars,we apply design thinking to find the right problem, which then forms the basis of our digital flywheel, e.g. finding the right problems to solve, use data, analytics and AI to solve them and then automate and scale them to help free Associates time to find more problems to solve.

To support this, we have trained more than 25,000 Associates across Mars in design thinking and have a thriving online community of practice. The first part of trust is trusting that the problem being solved needs solving. The next component of trust is co-creation, working with domain experts, whatever the problem is and collaborating on quick sprints to test validity of solutions, leveraging that expertise to understand the data and ensure the outputs are comprehensible and actionable.

When we implemented an AI-based system to do this identification for Mars Antech pathologists, we implemented it such that pathologists could see what we had identified as mitotic features and do a quick manual validation of the count presented.

The images below show the view a patholigist receives for a fully counted slide sample and the next image shows a zoomed in view of how we identify each of the features for the pathologists validation.

Fig. 1: Whole slide image with AI overlay      Fig 2: Zoomed in view showing an identified feature

For other work we have done, we use very different techniques.In X-rays diagnosis (veterinary), we use heat maps to show what the model saw when it identified a finding as being present, and for non-visual data we use a variety of techniques – a key one is called Shapley values.

We use Shapely valuesto decompose a result into its contributing factors, so the person using the output can see why a value is what it is, and how much contribution each of the factors determining the value makes to it. E.g. if a model was built to for example predict house prices, understanding which features contribute most to the price could be very important.

In summary, for humans and AI to work together most effectively, its crucial to build trust at every stage of development: even an easy-to-use system may not be trusted. We build this into all our AI projects as part of our digital flywheel to ensure we deliver what’s needed in a way that can be used and most importantly trusted so it can be actioned to deliver real business benefit.

Read Also

Insurance Market is in Full Swing in Tune with the Digital Transformation

Insurance Market is in Full Swing in Tune with the Digital...

Adilson Lavrador, Executive Director of Operations, Technology and Claims, Tokio Marine Seguradora
A Pro-Active Risk Management Approach Guides Pg&E's Supplier Quality Assurance Team

A Pro-Active Risk Management Approach Guides Pg&E's Supplier Quality...

Jamie Martin, Vice President of Supply Chain and Chief Procurement Officer, Pacific Gas and Electric Company
The Future Of Oil And Gas Industry With Digital Solution

The Future Of Oil And Gas Industry With Digital Solution

Azfar Mahmood, Product Manager, Jeremy Angelle Vice President Digital Solutions at Frank’s International
Epc Oil And Gas Companies’ Role In Scaling Up In Energy Transition

Epc Oil And Gas Companies’ Role In Scaling Up In Energy Transition

Matthew Harwood, GVP Strategy and Sustainability, McDermott International
Using Technology To Improveremote Worker Safety

Using Technology To Improveremote Worker Safety

Grantt Bedford, Director - Safety, Environment & Quality For The United States At Eni
Unified Command And Operation Cyber Centers (Ucoc): Beyond Remote Operation Centers

Unified Command And Operation Cyber Centers (Ucoc): Beyond Remote...

RobelloSamuel, Chief Technical Advisor and Halliburton Fellow (WellEngg.), Halliburton