5 min read
Research Backdoor behaviours introduced into LLMs during fine-tuning can persist through subsequent safety alignment including RLHF and adversarial training, surviving standard red-teaming.
Backdoor behaviours introduced into LLMs during fine-tuning can persist through subsequent safety alignment including RLHF and adversarial training, surviving standard red-teaming.
Training data can be reconstructed from foundation model weights with significantly higher accuracy than previously reported, with implications for GDPR compliance and IP protection.