Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)

Toolkit for research purposes in AIS. See the website for the paper.

[CoRL'23] Adversarial Training for Safe End-to-End Driving

Website to track people, organizations, and products (tools, websites, etc.) in AI safety

Can Large Language Models Solve Security Challenges? We test LLMs' ability to interact and break out of shell environments using the OverTheWire wargames environment, showing the models' surprising ability to do action-oriented cyberexploits in shell environments

Common repository for our readings and discussions

Safe Option Critic: Learning Safe Options in the A2OC Architecture

Winning entry for the UC Chile AI Safety Thinkathon 2023. Coauthor @mon-b

Tool to read and process CMS Open Data for jet flavour tagging purposes in the context of AI Safety, preparing datasets in a ML-friendly way, allowing further usage independent of root or experiment-specific software. Adds manually computed branches not part of standard tools, even for 2015 data.

where I learn and explore mechanistic interpretability of transformers