I reported a LoRA fine-tuning and injection-defense result for “Solo Track 3.” The post describes fine-tuning Tiny Aya Global 3.35B, comparing against the base model on the same example IDs, and evaluating injection results with a guard.
I reported using LoRA SFT on Tiny Aya Global 3.35B.
I reported a fine-tuned score of 91.44% (235/257), increased from 3.33%.
I reported that the base model scored 0/257 on the same ids.
I reported evaluating on a split frozen before the run.
I reported that AuditKIT re-scored all 257 examples, with 257 examples; agreement 1.0000.
I reported an injection result of 13/208 -> 0 with a guard.
I reported that 208/208 were still solved with the guard.
I shared the result under the label Solo Track 3.
I linked the post to https://t.co/6Os7ocMf5z.