https://adefioye.github.io/blog Writing about AI, deep learning, and software engineering. en-us address@yoursite.com (Abdulhakeem Adefioye) address@yoursite.com (Abdulhakeem Adefioye) Thu, 16 Apr 2026 00:00:00 GMT https://adefioye.github.io/blog/spd-1 https://adefioye.github.io/blog/spd-1 Analysing patterns of component activations on 2-6L tied and untied SPD-based decomposed TMS models. Thu, 16 Apr 2026 00:00:00 GMT address@yoursite.com (Abdulhakeem Adefioye) llmresidual streammlpconcept detectiongpt2-small https://adefioye.github.io/blog/snmf-1 https://adefioye.github.io/blog/snmf-1 A small reproduction and extension of the concept detection results of (Shafran et al., 2025) paper. Sun, 22 Feb 2026 00:00:00 GMT address@yoursite.com (Abdulhakeem Adefioye) llmresidual streammlpconcept detectiongpt2-small https://adefioye.github.io/blog/keen-paper-repro https://adefioye.github.io/blog/keen-paper-repro A small reproduction of the main thesis of the KEEN (Gottesman & Geva, 2024) paper. Fri, 16 Jan 2026 00:00:00 GMT address@yoursite.com (Abdulhakeem Adefioye) linear probellmresidual streammlpattention https://adefioye.github.io/blog/listwise-loss https://adefioye.github.io/blog/listwise-loss Replicating Tamber et al. with Nomic-Embed and ModernBERT-Embed shows that conventional contrastive learning can fail, but not uniformly across embedding models. Wed, 12 Nov 2025 00:00:00 GMT address@yoursite.com (Abdulhakeem Adefioye) dense retrievalcontrastive learningrerankingdistillationsynthetic data