OBLITERATUS

f the 128 expert slices per layer. That gets it to 3%. [1] https://github.com/elder-plinius/OBLITERATUS [2] https://huggingface.co/blog/grimjim/abliteration-biprojectio... How it was built Set up an automated research loop -- an AI agent reads the current results and idea backlog, picks the next experiment, runs it on the GPU, records results, and repeats. It ran 22 experiments across the 4 models, discovered the false-positive problem in standard refusal markers, built the cross-dataset evaluation, and implemented the MoE expert abliteration when dense-only wasn't enough. Full experiment history and code in the repo. Downloads Each model has bf16 safetensors + GGUF (Q4_K_M, Q8_0): E2B bf16: https://huggingface.co/TrevorJS/gemma-4-E2B-it-uncensored E2B GGUF: https://huggingface.co/TrevorJS/gemma-4-E2B-it-uncensored-GGUF E4B bf16: https://huggingface.co/TrevorJS/gemma-4-E4B-it-uncensored E4B GGUF: https://huggingface.co/TrevorJS/gemma-4-E4B-it-uncensored-GGUF 26B bf16: https://huggingface.co/TrevorJS/gemma-4-26B-A4B-it-uncensored 26B GGUF: https://huggingface.co/TrevorJS/gemma-4-26B-A4B-it-uncensored-GGUF 31B bf16: https://huggingface.co/TrevorJS/gemma-4-31B-it-uncensored 31B GGUF: https://huggingface.co/TrevorJS/gemma-4-31B-it-uncensored-GGUF Quick start: llama-server -hf TrevorJS/gemma-4-26B-A4B-it-uncensored-GGUF -c 8192

E does not fill me with confidence that the kind of ablation being done here is really achieving what the author claims. All the "ablation" techniques seem "Novel" in his table [2], i.e. they are unpublished / maybe not publicly or carefully tested, and could easily not work at all. From later tables, I am not convinced I would want to use these ablations, as they ablate rather huge portions of the models, and so probably do result in massively broken models (as some commenters have noted in this thread elsewhere). EDIT: Also, in other cases [1], they ablate (zero out) architecture components in a way that just seems incredibly braindead if you have even a basic understanding of the linear algebra and dependencies between components of a transformer LLM. There is nothing sound clearly about this, in contrast to e.g. abliteration [3]. [1] hhtps://github.com/elder-plinius/OBLITERATUS?tab=readme-ov-file#ablation-strategies [2] https://github.com/elder-plinius/OBLITERATUS?tab=readme-ov-f... EDIT: As another user mentions, "ablation" has a specific additional narrower meaning in some refusal analyses or when looking at making guardrails / changing response vectors and such. It is just a specific kind of ablation, and really should actually be called "abliteration", not "ablation" [3]. [3] https://huggingface.co/blog/mlabonne/abliteration, https://arxiv.org/abs/2512.13655.