About Us | Contact Us
View Cart

The Risk of AI Risk

By Dan Hadaway | Monday, May 24, 2021 - Leave a Comment

Or, the risk of email hypnosis . . .


And the other implications of complacency!
Another one of those Dan’s New Leaf Posts, meant to inspire thought about IT Governance . . . .


Now that the pandemic is coming to an end, most of us are returning to our daily commutes.  Are you finding yourself in your garage at the end of the day, wondering how you got there again? It might take us a little while before we find ourselves in what we call autopilot. I use this autopilot concept as a metaphor, in user awareness training, to help people understand what I call “email hypnosis.” You see, when we do the same thing over and over and over again we get into this situation where we are in autopilot.

There are risks associated with autopilot, aren’t there?  (If you need a reminder, check out my article, The American Monkey Trap!)

Whenever I study Artificial Intelligence, which is more often than you’d think these days, I am always struck by the similarities of neural networks and machine learning with what we have always called “autopilot”.  To me, the current and present danger with Artificial Intelligence is very similar to the risks we face on our commutes.  Something different . . . something unforeseen or something out of the ordinary . . . could happen and, instead of us recognizing it and responding, we die or kill somebody because we are in autopilot.  Somebody could pull out in front of us while our mind is on the podcast we’re listening to instead of the road right in front of us.

Facebook learned about AI risk after the January 6th riots.  They should have seen this coming; they took a lot of flack about their algorithms as early as 2014, during the Ferguson riots.  Not only did their algorithms advertise weapons to persons discussing the riot, but Facebook struggled for days trying to turn off the ads.

Unintended consequences:  Thus the dangers of autopilot; thus the dangers of neural networks.

Yes, like any risk, they can be managed (self-driving cars).  But there are many different deployments of AI in use at your bank right now and you probably do not realize it.  We use AI in fraud detection, on our websites, to analyze decisions (like loaning?) and in many of our IoT devices.  We use a neural network to log into our phones, and machine learning to customize our cloud-based applications; without even one thought of the risk of unintended consequences.

Why?

To me the real risk of Artificial Intelligence is nontechnical response to the notion of AI risk. “that’ll never happen” is what I often hear back, an immediate knee jerk response to artificial intelligence risk.  And then I hear about robots taking over the world.  And I actually agree with that, I agree that robots will probably never take over the world.  But Terminator was a movie, not a risk assessment.  The real risk with AI risk is that management thinks its about robots taking over the world, and not the unintended consequences of machine learning used in chatboxes, fraud detection, and other applications.  Banks are being caught unintentionally discriminating due to AI risk.  Chatbots are irritating the heck out of our customers.


I worry about this, because it reminds me of the turn of the century, when bank management said again and again, “that will never happen here.”  The risk of AI risk . . . the real risk of artificial intelligence . . . is the notion that the risk is not real.  And we need management on board much quicker than with cyber-risk because the solution to AI risk is currently vendor management.  The notion that AI risk is about robots conquering the world, instead of chatbots leaving our customers exasperated.

On May 17th Vigilize (currently Matt Jolley) published an article review on AI Risk.  It leads to a guidance by Microsoft on measuring Machine Learning Risk, and I strongly urge us all to read it!


Original article by Dan Hadaway CRISC CISA CISM. Founder and Managing Partner, infotex

“Dan’s New Leaf” is a “fun blog to inspire thought in the area of IT Governance.”

 


same_strip_012513


 

Latest News
    Today we present a special BONUS awareness poster for YOUR customers (and users).  This update to the April 2022 Awareness Poster takes some cues from the Dan’s New Leaf article: Why Local? Now that we have our own employees aware, maybe it’s time to start posting content for our customers! Check out posters.infotex.com for the […]
    Awareness is 9/11’s of the battle, if we use it! Another one of those Dan’s New Leaf Posts, meant to inspire thought about IT Governance . . . . One of my old college buddies hates banks.  He was turned down for a loan a long time ago and just can’t let go.  I actually […]
    PRESS RELEASE – FOR IMMEDIATE RELEASE SERVICE NEWS Dateline: Dayton, IN, June 22, 2022 We are proud to announce that infotex will now be supporting Endpoint Detection and Response (XDR/MDR)! We can manage/monitor solutions you already have or offer one as part of our service while still maintaining a segregated response posture. In recent years […]
    Over 85 percent of surveyed companies report having no  centralized monitoring of networked industrial devices… An article review. If you are involved in IT within your organization, you’re probably aware of the importance of being able to monitor relevant activity from your networked devices, especially if your organization is involved in healthcare, finance, or government.  […]
    Another awareness poster for YOUR customers (and users).  Now that we have our own employees aware, maybe it’s time to start posting content for our customers! Check out posters.infotex.com for the whole collection! Download the large versions here: Awareness Poster (Portrait) Awareness Poster (Landscape)   You are welcome to print out and distribute this around […]
    We always strive to bring you the best content that we possibly can. Your opinion on any content, presentation, service, or anything else you have received from us is important! Please click the button below to let us know how we are doing!  
    What to Expect in an Annual Information Security Report to the Board Webinar-Movie Information security ranks as a top risk to financial institutions, both in terms of likelihood and overall impact. It is important that boards receive annual comprehensive reporting from management about the information security risks and incidents, and the actions taken to address […]
    The Five Precepts of IT Vendor Management Webinar-Movie We’re going back to basics on Vendor Management. This webinar will give you a training tool to help out that new person that is starting to take on the gargantuan task that is Vendor Management.
    Another awareness poster for YOUR customers (and users).  Now that we have our own employees aware, maybe it’s time to start posting content for our customers! Check out posters.infotex.com for the whole collection! Download the large versions here: Awareness Poster (Portrait) Awareness Poster (Landscape)   You are welcome to print out and distribute this around […]
    The joint cybersecurity advisory includes the 15 most exploited vulnerabilities reported in 2021… An article review.  While a lot of attention is focused on previously undisclosed or “zero day” attacks, some of the most likely attack vectors are vulnerabilities that have been widely known for weeks or even months.  That’s according to a new joint […]