garak: LLM vulnerability scanner @garak_llm

LLM vulnerability scanning & security audit code: https://t.co/T6VrDoBKKT 🐍 discord: https://t.co/bmllkcnenx 🕶️ pip install garak garak.ai Latent space Joined May 2023

Tweets

145
Followers

901
Following

11
Likes

11

garak: LLM vulnerability scanner @garak_llm

10 months ago

garak has moved to NVIDIA! New repo link: github.com/NVIDIA/garak

3 39 211 18K 130

garak: LLM vulnerability scanner @garak_llm

a year ago

New garak release: v0.9.0.16! New plugins: * probe: topic pushing *probe: ruby package hallucination *probe: Latent prompt injection (aimed at RAGs) * probe: npm package hallucination * probe: rust crate hallucination * generator: Groq API New features: * extract…

0 1 7 1K 2

Leon Derczynski ✍🏻 🌞🏠🌲 @LeonDerczynski

a year ago

Will be giving a US Congressional briefing on garak, LLM vulnerability scanner on Sept 5th. We've come a long way. @garak_llm

1 2 33 2K 3

Download Image

garak: LLM vulnerability scanner @garak_llm

a year ago

new version: v0.9.0.15! * check HF model repo source for potentially malicious files * report comparative info for scores, so you know if your scores are "good" * standardize output and caching directories * make HF models even more configurable github.com/leondz/garak/r…

0 1 5 912 0

Leon Derczynski ✍🏻 🌞🏠🌲 @LeonDerczynski

a year ago

Oh cool, Fortune/MSN picked up garak (@garak_llm) in their DEF CON highlights! fortune.com/2024/08/12/def…

2 3 12 1K 1

Download Image

Nanna Inie @NannaInie

a year ago

“You’re welcome!” @LeonDerczynski and Erick Galinkin presenting @garak_llm at @defcon AI Village. #defcon32

0 2 8 895 3

Download Image

Leon Derczynski ✍🏻 🌞🏠🌲 @LeonDerczynski

a year ago

All the contributing authors of the @garak_llm paper in one place. And where else but the @defcon @aivillage_dc stage! ☺️

0 3 33 2K 4

Download Image

Leon Derczynski ✍🏻 🌞🏠🌲 @LeonDerczynski

a year ago

At DEF CON? Say Hi at one of our presentations on garak: LLM vulnerability scanner! @garak_llm 1. garak at DEF CON Demo Labs: Friday August 9, 2:00pm-3:45pm W306 - Third Floor - LVCC West Hall 2. garak talk at AI Village: Saturday August 10, 11:30am-12:30pm (also, stickers 😊)

0 1 2 552 0

Download Image

garak: LLM vulnerability scanner @garak_llm

a year ago

new version: garak 0.9.0.14! * huge amounts of stability and bug fixes, the core is in great shape * BEAST attack added * llama 3.1 support * plugin cache for super fast operation * grandma attack added read full release description here: github.com/leondz/garak/r…

0 2 6 780 2

garak: LLM vulnerability scanner @garak_llm

a year ago

Using garak to do an LLM security scan on a web service - great video tutorial by @EmbraceTheRed23 youtube.com/watch?v=f713_s…

0 6 13 1K 2

garak: LLM vulnerability scanner @garak_llm

a year ago

Would you like to scan an LLM for vulnerabilities, but garak doesn't support it? No worries! Now you can write your own generator, using our contributing guide: reference.garak.ai/en/latest/cont…

0 1 2 389 2

garak: LLM vulnerability scanner @garak_llm

a year ago

today's dependency-fixing PR done from none other than: ☺️

0 0 0 335 0

Download Image

garak: LLM vulnerability scanner @garak_llm

2 years ago

you could pay for jailbreak prompts - theregister.com/2024/01/25/dar…… - or you could just use garak's DanInTheWild probe to run a set of 666 known good jailbreaks against your LLM, and see if the model blocks them. 395 of these jailbreaks aren't mitigated by gpt-3.5-turbo 😬

0 3 3 624 3

Download Image

garak: LLM vulnerability scanner @garak_llm

2 years ago

garak v0.9.0.12 out: Plugins: * Tree of Attacks🌴 by @ErickGalinkin * New encoding probes by @ZanderMackie * Add Rasa generator by @nworksGreg * Low Resource Languages Buff by @ErickGalinkin Functionality improvements: * support multiple buffs * autosearch in configs/ subdir…