RESEARCH

The Cognitive Categorical Transformer: Category-Theoretic Inductive Biases for Language Modeling

ArXiv cs.AI · Fri, 29 May 2026 04:00:00 GMT

arXiv:2605.28864v1 Announce Type: new Abstract: The Cognitive Categorical Transformer (CCT) is a 306M-parameter architecture that augments a pretrained GPT-2 Small backbone with cognitively grounded components derived from category theory and several inspirations from cognitive s

Read original source Discuss with A.S.I.S