using model on CPU

#10
by mooncy - opened

Hi, may I ask if this model can be run on a CPU instead of a GPU? Any guidance would be greatly appreciated. Thank you!

NVIDIA org

Hi.
Sortformer is developed by NVIDIA NeMo team and we are not currently optimizing on any CPU models.
Having said that, this does not mean that Sortformer cannot be running on CPU - you can optimize and run it on CPU.
Thank you for showing your interest on this model!

Sign up or log in to comment