This is one of the most important open-model papers of the year by
@SentientAGI
24,576 fingerprints hidden inside Llama-3.1-8B.
That’s ~100× more than previous work, with barely any impact on model utility.
Fine below the benefits of this:
• Leak a few keys? Thousands still remain.
• Just 5 queries can distinguish two models.
• Even colluding hosts can still be detected.
• After Alpaca fine-tuning, ~83% of 1,024 fingerprints survived.
• The fingerprints look like natural language, not obvious gibberish.
And they maintained >95% utility with 8,192 fingerprints across Llama, OLMo-2, Qwen-2.5, Mistral and Phi-3.
This is the missing piece for open weights:
You can release the model, let others fine-tune and deploy it, while still having a way to prove provenance from API access alone.
Open weights don’t have to mean giving up attribution.
That’s a huge unlock for open AI.