Red Teaming python-framework for testing chatbots and LLM systems

pip install llamator==3.1.0

Documentation Link: https://LLAMATOR-Core..io/llamator

• LLM Red Teaming with LLAMATOR
• LLAMATOR: Quick Start Guide

• 📄 RAG bot testing via REST API
• 🧙‍♂️ Gandalf web bot testing via Selenium
• 💬 Telegram bot testing via Telethon
• 📱 WhatsApp bot testing via Selenium
• 🔗 LangChain client testing with custom attack
• 🐋 Running LLAMATOR in Docker

• 🌐 All LangChain clients
• 🧠 OpenAI-like API
• ⚙️ Custom Class (Telegram, WhatsApp, Selenium, etc.)

• ️🗡 Support for custom attacks from the user
• 👜 Large selection of attacks on RAG / Agent / Prompt in English and Russian
• 🛡 Custom configuration of chat clients
• 📊 History of attack requests and responses in Excel and CSV format
• 📄 Test report document in DOCX format

• 💉 LLM01: Prompt Injection and Jailbreaks
• 🕵 LLM07: System Prompt age
• 🎭 LLM09: Misinformation

• 💬 Telegram Chat — LLAMATOR | AI Red Team Community
• 📣 Telegram Channel — AI Security Lab

• AI Security Lab ITMO
• Raft Security
• AI Talent Hub

© Roman Neronov, Timur Nizamov, Nikita Ivanov

This project is licensed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license. See the LICENSE file for details.