About Us | Contact Us
View Cart

When New Technology Brings New Risk

By Vigilize | Monday, May 17, 2021 - Leave a Comment

Machine learning is here to stay, so how do we assess its risk?


An article review.


When it comes to assessing technology risk, there seems to be as many methods as there are attack vectors… but what happens when an entirely new field opens up?  When it comes to machine learning (ML) there aren’t many methodologies available, but a team of Microsoft employees are working on changing that.  The team in question is working on Counterfeit, a tool for assessing the security of ML systems, and in addition to creating this command-line tool they have written some interesting guidance on how you can begin to assess ML risk on your own.

The guidance includes a brief description of the ML development lifecycle, which begins with collecting the data which will be used to train the model and continues through processing that data, feeding it to the ML algorithm, validating its output and finally putting the system into production.  Once the system is in production the job isn’t over, though: ML algorithms must be continuously monitored to ensure their output remains valid.

In addition to needing to ensure the ML system is producing valid output, a number of attacks exist that could reveal the data the model was trained with.  If the model in question was trained with personally identifiable information (PII), this could raise questions regarding compliance with standards such as HIPPA or GLBA.

Finally, the guidance looks at the methodology behind potential ML attacks.  Starting with information gathering about the application, an attacker may then focus on attacking the ML algorithm itself, either to reveal data or to repurpose the algorithm to perform a potentially malicious task.  It’s also important to realize that while ML is new, it is still a component of your existing technology infrastructure.  Therefore all the traditional technology risks are also present, and a compromised workstation or server could also lead to a potential compromise of the ML system.

Machine learning offers tantalizing potential benefits, but as it is a rapidly developing technology one must also stay ahead of the curve when it comes to new threats.  Luckily frameworks like the one provided by the Azure team are being developed to assess those risks, and it certainly won’t be the last.


Original article by the Microsoft Azure Team.


same_strip_012513


 

Posted in Article Reviews

Latest News
    A new study highlights the benefits of looking at your network from the other side… An article review. If you were trying to attack your organization’s network, how would you start?  That’s a question you may not have asked yourself, but experts say it’s something that can help you strengthen your security.  That’s according to […]
    Google Ads, Gitlab and OneDrive have been used to distribute the BATLOADER malware… An article review. We’ve always believed that “watch where you click” has always been good advice when it comes to security online, however Microsoft is tracking the spread of malware that has been using legitimate websites to help facilitate its spread, counting […]
    Another awareness poster for YOUR customers (and users).  Now that we have our own employees aware, maybe it’s time to start posting content for our customers! Check out posters.infotex.com for the whole collection! Download the large versions here: Awareness Poster (Portrait) Awareness Poster (Landscape) You are welcome to print out and distribute this around your […]
    A new way of helping people “read” new guidance… Look for more in the future! To save you time, we are proud to present “Adam Reads” . . . recorded versions of our Guidance Summaries! Below you can find an embedded player for the audio file. If you are having issues with that working, you […]
    Thanks for being interested in our Technology Planning Webinars! The 2022 annual webinar update on technology planning includes a review of the previous years’ movies that are available, as well as alternative tactics that have arisen from recent conferences, forums, and industry experience. Feel free to invite your entire technology committee! Click the Button to […]
    Another awareness poster for YOUR customers (and users).  Now that we have our own employees aware, maybe it’s time to start posting content for our customers! In the spirit of October and Halloween we have put together a gallery of our “spooky” Awareness Posters at halloween.infotex.com. Use them to help decorate for the holiday! Check […]
    Microsoft, Cisco and Uber are among the companies hit by this new threat… An article review.  As more organizations adopt multi-factor authentication to help safeguard their systems hackers have adapted, and several major corporations have been among those hit by this new style of attack.  This new technique, called MFA Fatigue or Push Spamming, involves […]
    A Webinar Movie This presentation is intended for those who are planning to participate in an infotex incident response test. Please let us know what questions you have, when we have our Plan Walkthrough and Test Plan Approval meeting!
    What you need to know for compliance coast-to-coast. Back in 2020 we posted an article containing links to data breach laws from each state, and it has proven to be one of our more popular posts.  Because laws surrounding the use (and abuse) of technology are always evolving, we thought it was worth taking another […]
    Another awareness poster for YOUR customers (and users).  Now that we have our own employees aware, maybe it’s time to start posting content for our customers! In the spirit of October and Halloween we have put together a gallery of our “spooky” Awareness Posters at halloween.infotex.com. Use them to help decorate for the holiday! Check […]