Sign Up for Our Newsletter
Donate

Archive

malicious use

Managing Misuse Risk for Dual-Use Foundation Models: IST Submits Comments to a NIST Request for Information 

Blog

Managing Misuse Risk for Dual-Use Foundation Models: IST Submits Comments to a NIST Request for Information 

Last week, Institute for Security and Technology (IST) submitted a response to NIST's Request for Comments on the U.S. Artificial Intelligence Safety Institute's draft guidelines for identifying and mitigating the risks to public safety and national security present across the AI lifecycle.
AI, artificial intelligence, deployment, development, malicious use, misuse, national security, NIST, risk reduction
March 18, 2025
Patrick J. McGovern Foundation Renews Commitment to Supporting IST’s AI Risk Reduction Efforts

Blog

Patrick J. McGovern Foundation Renews Commitment to Supporting IST’s AI Risk Reduction Efforts

Over the last two years, with the support of the Patrick J. McGovern Foundation, the Institute for Security and Technology (IST) has been on a mission to assess the risks and opportunities associated with the development and deployment of cutting-edge AI foundation models. IST is again excited to announce renewed support from the Patrick J. McGovern Foundation to further advance this vital work.
AI foundation models, artificial intelligence, compliance failure, malicious use, risk reduction
March 18, 2025
AI Risk Busters: A lifecycle approach to AI risk reduction

Event

June 17, 2024 2:20 pm

AI Risk Busters: A lifecycle approach to AI risk reduction

What constitutes the ‘malicious use’ of AI? IST hosted a virtual webinar to celebrate the launch of a new report, "A Lifecycle Approach to AI Risk Reduction: Tackling the Risk of Malicious Use Amid Implications of Openness."
AI lifecycle, artificial intelligence, malicious use
October 31, 2024
A Lifecycle Approach to AI Risk Reduction: Tackling the Risk of Malicious Use Amid Implications of Openness

Report

A Lifecycle Approach to AI Risk Reduction: Tackling the Risk of Malicious Use Amid Implications of Openness

A Lifecycle Approach to AI Risk Reduction introduces a novel framework for addressing the complex risks associated with AI, and applies this framework to the risk of malicious use.
AI lifecycle, artificial intelligence, LLMs, malicious use, risk-mitigation
June 17, 2024
IST, industry and civil society contributors release report assessing risks of increased access to AI foundation models 

Blog

IST, industry and civil society contributors release report assessing risks of increased access to AI foundation models 

In recent months, a number of leading AI labs have released advanced artificial intelligence systems. While some models remain highly restricted, limiting who can access the model and its components, others provide fully open access to their model weights and architecture. The potential benefits of these more open postures are generally well understood. As a result, this effort turned our attention to the risks, seeking to answer the question: how does access to foundation models and their components impact the risk they pose to individuals, groups, and society? 
AI foundation models, compliance, human in the loop, malicious use, race to the bottom, reinforcing bias
December 13, 2023
How Does Access Impact Risk? Assessing AI Foundation Model Risk Along a Gradient of Access

Report

How Does Access Impact Risk? Assessing AI Foundation Model Risk Along a Gradient of Access

Uninhibited access to powerful AI models and their components significantly increases the risk these models pose across a range of categories, as well as the ability for malicious actors to abuse AI capabilities and cause harm.
artificial inteligence, bias, capability overhang, compliance failure, foundation model, human out of the loop, LLMs, malicious use, risk-mitigation
December 13, 2023

CATALINK