Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
Shards gets
processed separately and in parallel on different GPUs and the results are synced at the end of the processing step.