Conceptual

Single-Cell Foundation Models: scGPT and Geneformer

Treating a cell's ranked gene expression as a sentence lets a transformer pretrain over tens of millions of cells and produce transferable cell and gene embeddings. Fine-tuning targets annotation, batch integration, and perturbation response prediction.