About Us | Contact Us
View Cart

The Risk of AI Risk

By Dan Hadaway | Monday, May 24, 2021 - Leave a Comment

Or, the risk of email hypnosis . . .


And the other implications of complacency!
Another one of those Dan’s New Leaf Posts, meant to inspire thought about IT Governance . . . .


Now that the pandemic is coming to an end, most of us are returning to our daily commutes.  Are you finding yourself in your garage at the end of the day, wondering how you got there again? It might take us a little while before we find ourselves in what we call autopilot. I use this autopilot concept as a metaphor, in user awareness training, to help people understand what I call “email hypnosis.” You see, when we do the same thing over and over and over again we get into this situation where we are in autopilot.

There are risks associated with autopilot, aren’t there?  (If you need a reminder, check out my article, The American Monkey Trap!)

Whenever I study Artificial Intelligence, which is more often than you’d think these days, I am always struck by the similarities of neural networks and machine learning with what we have always called “autopilot”.  To me, the current and present danger with Artificial Intelligence is very similar to the risks we face on our commutes.  Something different . . . something unforeseen or something out of the ordinary . . . could happen and, instead of us recognizing it and responding, we die or kill somebody because we are in autopilot.  Somebody could pull out in front of us while our mind is on the podcast we’re listening to instead of the road right in front of us.

Facebook learned about AI risk after the January 6th riots.  They should have seen this coming; they took a lot of flack about their algorithms as early as 2014, during the Ferguson riots.  Not only did their algorithms advertise weapons to persons discussing the riot, but Facebook struggled for days trying to turn off the ads.

Unintended consequences:  Thus the dangers of autopilot; thus the dangers of neural networks.

Yes, like any risk, they can be managed (self-driving cars).  But there are many different deployments of AI in use at your bank right now and you probably do not realize it.  We use AI in fraud detection, on our websites, to analyze decisions (like loaning?) and in many of our IoT devices.  We use a neural network to log into our phones, and machine learning to customize our cloud-based applications; without even one thought of the risk of unintended consequences.

Why?

To me the real risk of Artificial Intelligence is nontechnical response to the notion of AI risk. “that’ll never happen” is what I often hear back, an immediate knee jerk response to artificial intelligence risk.  And then I hear about robots taking over the world.  And I actually agree with that, I agree that robots will probably never take over the world.  But Terminator was a movie, not a risk assessment.  The real risk with AI risk is that management thinks its about robots taking over the world, and not the unintended consequences of machine learning used in chatboxes, fraud detection, and other applications.  Banks are being caught unintentionally discriminating due to AI risk.  Chatbots are irritating the heck out of our customers.


I worry about this, because it reminds me of the turn of the century, when bank management said again and again, “that will never happen here.”  The risk of AI risk . . . the real risk of artificial intelligence . . . is the notion that the risk is not real.  And we need management on board much quicker than with cyber-risk because the solution to AI risk is currently vendor management.  The notion that AI risk is about robots conquering the world, instead of chatbots leaving our customers exasperated.

On May 17th Vigilize (currently Matt Jolley) published an article review on AI Risk.  It leads to a guidance by Microsoft on measuring Machine Learning Risk, and I strongly urge us all to read it!


Original article by Dan Hadaway CRISC CISA CISM. Founder and Managing Partner, infotex

“Dan’s New Leaf” is a “fun blog to inspire thought in the area of IT Governance.”

 


same_strip_012513


 

Latest News
    A new study highlights the benefits of looking at your network from the other side… An article review. If you were trying to attack your organization’s network, how would you start?  That’s a question you may not have asked yourself, but experts say it’s something that can help you strengthen your security.  That’s according to […]
    Google Ads, Gitlab and OneDrive have been used to distribute the BATLOADER malware… An article review. We’ve always believed that “watch where you click” has always been good advice when it comes to security online, however Microsoft is tracking the spread of malware that has been using legitimate websites to help facilitate its spread, counting […]
    Another awareness poster for YOUR customers (and users).  Now that we have our own employees aware, maybe it’s time to start posting content for our customers! Check out posters.infotex.com for the whole collection! Download the large versions here: Awareness Poster (Portrait) Awareness Poster (Landscape) You are welcome to print out and distribute this around your […]
    A new way of helping people “read” new guidance… Look for more in the future! To save you time, we are proud to present “Adam Reads” . . . recorded versions of our Guidance Summaries! Below you can find an embedded player for the audio file. If you are having issues with that working, you […]
    Thanks for being interested in our Technology Planning Webinars! The 2022 annual webinar update on technology planning includes a review of the previous years’ movies that are available, as well as alternative tactics that have arisen from recent conferences, forums, and industry experience. Feel free to invite your entire technology committee! Click the Button to […]
    Another awareness poster for YOUR customers (and users).  Now that we have our own employees aware, maybe it’s time to start posting content for our customers! In the spirit of October and Halloween we have put together a gallery of our “spooky” Awareness Posters at halloween.infotex.com. Use them to help decorate for the holiday! Check […]
    Microsoft, Cisco and Uber are among the companies hit by this new threat… An article review.  As more organizations adopt multi-factor authentication to help safeguard their systems hackers have adapted, and several major corporations have been among those hit by this new style of attack.  This new technique, called MFA Fatigue or Push Spamming, involves […]
    A Webinar Movie This presentation is intended for those who are planning to participate in an infotex incident response test. Please let us know what questions you have, when we have our Plan Walkthrough and Test Plan Approval meeting!
    What you need to know for compliance coast-to-coast. Back in 2020 we posted an article containing links to data breach laws from each state, and it has proven to be one of our more popular posts.  Because laws surrounding the use (and abuse) of technology are always evolving, we thought it was worth taking another […]
    Another awareness poster for YOUR customers (and users).  Now that we have our own employees aware, maybe it’s time to start posting content for our customers! In the spirit of October and Halloween we have put together a gallery of our “spooky” Awareness Posters at halloween.infotex.com. Use them to help decorate for the holiday! Check […]