SANS Certified Instructor Candidate. All views are my own, likes and retweets are not always endorsements.
Joined July 2015
- Tweets588
- Following806
- Followers308
- Likes1K
Jim Simpson retweeted
🔍 Can a single image hijack your AI’s behavior?
Yes & without changing the application.
Meet VISOR: a new method that steers GenAI models using images alone.
It’s a new class of AI vulnerability and a new opportunity for AI alignment.
🔗hiddenlayer.com/innovation-h…
So this one has been a while coming. If you've seen any of the talks or workshops I've done recently you'll have heard me talking about the way we are thinking about attacks on generative AI. Well, it's finally here.
hiddenlayerai.github.io/ape-…
Jim Simpson retweeted
🔐 Not all prompt injections are the same.
We just released a taxonomy of adversarial prompt engineering, mapping the why, how, and what behind LLM prompt attacks.
Built for red teamers, defenders & researchers. Open to the community.
🔗 hiddenlayer.com/innovation-h…
Jim Simpson retweeted
HiddenLayer researchers have found a way to bypass text classification models by targeting tokenizers. TokenBreak gets past protection models, leaving end targets exposed.
🔗 hiddenlayer.com/innovation-h…
#AISecurity #AI #LLMSecurity
Jim Simpson retweeted
Still need to work on this loads more but in real world testing this is being useful!
#CyberCrime #Mapping #Graphs #IOCs #Enrichment #OSINT #ThreatIntel #Intel #Crime #Cyber #hacking
mr-r3b00t.github.io/crime-ma…
Jim Simpson retweeted
New on the AI Engineering Podcast: HiddenLayer’s Kasimir Schulz breaks down how to secure ML models from shadow logic & model ancestry to scanning for threats.
-Scan models
-Trace neural subgraphs
-Know your attack surface
Listen here: podcasts.apple.com/us/podcas…
#AIsec #MLSec #AI
Jim Simpson retweeted
Critical AI Security Guidelines by SANS Institute
🔐 Access: Use least privilege + zero trust. Lock down models, vector DBs, and APIs.
📦 Data: Protect training + augmentation data. No sensitive info in prompts. Sanitize everything.
🚀 Deployment: Avoid hardcoding rules into LLMs. Use RAG + ACLs. Vet public models for backdoors.
🧠 Inference: Validate inputs and outputs. Guardrails help, but can't be your only defense.
📊 Monitoring: Log prompts, watch for drift, detect abuse. Monitor API usage closely.
⚖️ GRC: Track AI usage, align with evolving regs (EU AI Act, EO 14110, etc). Build AIBOMs + model registries.
Authors: Ahmed AbuGharbia (Fortinet), Sarthak Agrawal (U.S. Congress), Brett D. Arion, CISSP, (Binary Defense), Matt Bromiley (Prophet Security), Ron F. Del Rosario (SAP), Mick Douglas (InfoSec Innovations), David Hoelzer (Occulumen), Ken Huang, CISSP (DistributedApps.ai), Bhavin P. Kapadia (Stablecoins), Rob T. Lee (SANS), Seth Misenar (Context Security Consulting), Helen Oakley (SAP), Jorge Orchilles (Verizon), Jason Ross (OWASP AI), Rakshith Shetty (Palo Alto Networks), Jim Simpson (HiddenLayer), Jochen Staengler (BSI), Rob van der Veer (Software Improvement Group), Jason Vest (Binary Defense), Eoin Wickens (HiddenLayer), Sounil Yu (Knostic).
@aagsec, @sarthak777, @barion, @_bromiley, @SAP, @bettersafetynet, @it_audit, @kenhuangus, @robtlee, @sethmisenar, @e2hln, @jorgeorchilles, @OWASP, @PaloAltoNtwks, @4a696d, @BSI_Bund, @robvanderveer, @Binary_Defense , @enwckns, @sounilyu, @SANSInstitute
More info: sans.org/mlp/critical-ai-sec…
#AIsecurity #Cybersecurity #LLMs #GenAI #AIgovernance #AIethics #Infosec #SecureAI #AISafety #SANSInstitute
Jim Simpson retweeted
New Research: New Gemini for Workspace Vulnerability Enabling Phishing and Content Manipulation. Our latest blog examines vulnerabilities in Google’s Gemini for Workspace, a versatile AI assistant.
🔗 Read more: hiddenlayer.com/research/new…
Jim Simpson retweeted
Microsoft identified a North Korean threat actor exploiting a zero-day vulnerability in Chromium (CVE-2024-7971) to gain remote code execution. Our assessment of ongoing analysis and observed infrastructure attributes this activity to Citrine Sleet. msft.it/6010l7S6w
Jim Simpson retweeted
I’m looking for success or horror stories from people or orgs that have tried to disable IPv6 in Windows across the enterprise. Aaaaand…GO!
Jim Simpson retweeted
Apeman is a tool designed to simplify the understanding of permissions and potential attack paths within an AWS environment for both attackers and defenders. Join @hotnops' Arsenal session at #BHUSA to see this tool in action.
Learn more 👉 ghst.ly/bhusa-apeman
Jim Simpson retweeted
BlueSpy - PoC to record audio from a Bluetooth device : github.com/TarlogicSecurity/… credits @Tarlogic
Jim Simpson retweeted
Kick off the week with a new @MISPProject playbook! Query Elasticsearch @elastic for threat intelligence from custom MISP searches, plot the results in a graph, report sightings in MISP, and send a summary to Mattermost. #cti #automation #playbooks github.com/MISP/misp-playboo…
Jim Simpson retweeted
Most (if not all) #Linux Distros have moved to the Journal with their latest versions. This is a LinkedIn article on key points for DFIR.
If you'd like to know more, check out FOR577 from SANS (sans.org/for577) - attend in-person or live online!
linkedin.com/pulse/linux-inc…
Jim Simpson retweeted
If you enjoyed my first #GettingStartedInDFIR workshop last week, make sure you’re also signed up for the second workshop on July 2 where we’ll explore file extensions, signatures & different types of file metadata
#DFIR @sansforensics
Your files have secrets—are you equipped to uncover them?
Learn to identify file types and extract hidden metadata like a pro with @4enzikat0r! in our Beyond File Names workshop.
Register here ➡️ sans.org/u/1wp4
#DFIR #DigitalForensics
Jim Simpson retweeted
If you haven’t yet signed up to the first of my #GettingStartedinDFIR workshops, do it now!
Friday 21 June 13:00 EDT / 17:00 UTC
Join live or get the recording to watch & play along later
🚨 Don't miss our hands-on workshop, "Demystifying Data," with @4enzikat0r! Learn to convert binary, hexadecimal, decimal, and ASCII. Gain actionable skills through interactive exercises and real-world examples.
Register ➡️ buff.ly/3WVCrMR
#DFIR #ComputerForensics
Jim Simpson retweeted
1/We've nailed a framework to reliably detect if an LLM was trained on your dataset: LLM Dataset Inference.
After over a year of thinking of writing about how hard this is, we had a breakthrough that made me quite literally jump from my seat!
📝: arxiv.org/abs/2406.06443 Long🧵
Jim Simpson retweeted
In the latest HiddenLayer blog, we explore the AI adoption arms race, in which companies race to integrate AI amidst the dual pressures of rapid innovation and cybersecurity challenges.
Read more 👇
hubs.ly/Q02zQz460