DoFormer

DoFormer is a Transformer for single-cell genomics that encodes gene interventions within attention, distinguishing observational and interventional regimes without requiring a directed acyclic graph. Using biologically informed training objectives, DoFormer improves prediction of held-out gene perturbations relative to baseline methods and transcriptomic foundation models. Preprint on bioRxiv.