scfoundation-gene

Model Description

This is the gene embedding model from scFoundation. It generates gene-level embeddings from single-cell RNA-seq data.

Model weights were originally from the biomap-research/scFoundation repository and have been re-uploaded here for ease of use with the perturblab library.

Model Details

• Model Type: Gene embedding model
• Architecture: xTrimoGene with MAE (Masked Autoencoder), Performer/Transformer modules
• Parameters: 100M parameters
• Training Data: 50M+ human single-cell transcriptomics data
• Input: Single-cell or bulk RNA-seq expression data (19,264 fixed genes)
• Output: Gene-level embeddings

Source

• Original Repository: biomap-research/scFoundation
• Paper: Large Scale Foundation Model on Single-cell Transcriptomics (Nature Methods, 2024)

Usage

from perturblab.model.scfoundation import scFoundationModel

# Load model
model = scFoundationModel.from_pretrained('scfoundation-gene', device='cuda')

# Generate gene embeddings
gene_embeddings = model.predict_embedding(
    adata, 
    output_type='gene'
)

Note

Intended for internal use with the PerturbLab framework.