Firworks's picture

21 84

Firworks

Firworks

·

firworksyt

AI & ML interests

Local Inference, Fine Tunes, & NVFP4 Quantization

Recent Activity

updated a model 1 day ago

Firworks/Hermes-4.3-36B-nvfp4

published a model 1 day ago

Firworks/Hermes-4.3-36B-nvfp4

liked a dataset 1 day ago

ronantakizawa/twitter-trending-hashtags

View all activity

Organizations

None yet

New activity in Firworks/GLM-4.5-Air-REAP-82B-A12B-nvfp4 2 days ago

“I am unable to start this model using vllm serve on the RTX 5090.”

#1 opened 4 days ago by

New activity in Firworks/KAT-Dev-72B-Exp-nvfp4 2 days ago

How did you quantize it?

#1 opened 2 days ago by

New activity in Firworks/INTELLECT-3-nvfp4 3 days ago

Request quantization model

#6 opened 4 days ago by

New activity in Firworks/MiroThinker-v1.0-30B-nvfp4 3 days ago

Request quantization of VLM

#2 opened 12 days ago by

New activity in Firworks/INTELLECT-3-nvfp4 4 days ago

cost estimates?

#5 opened 4 days ago by

is NVFP4 supported on sm120 (blackwell rtx pro 6000, rtx 5090 etc)?

#4 opened 5 days ago by

New activity in Firworks/GLM-4.5-Air-nvfp4 5 days ago

not working at DGX Spark

#1 opened 8 days ago by

New activity in Firworks/Kimi-Linear-48B-A3B-Instruct-nvfp4 6 days ago

quant script

#7 opened 6 days ago by

New activity in Firworks/INTELLECT-3-nvfp4 6 days ago

Minimax

#3 opened 6 days ago by

New activity in stepfun-ai/Step-Audio-R1 7 days ago

Feedback and Missing File

#1 opened 7 days ago by

New activity in Firworks/INTELLECT-3-nvfp4 8 days ago

Can you redece the size from 62 GB to about 35-40 GB range in 4bit or lesser?

#1 opened 8 days ago by

works with vLLM, with FLASHINFER_MOE_FP4

#2 opened 8 days ago by

New activity in Firworks/Kimi-Linear-48B-A3B-Instruct-nvfp4 10 days ago

How many tokens/s are you seeing on those two 6000 Blackwell's?

#6 opened 10 days ago by

New activity in Firworks/MiroThinker-v1.0-30B-nvfp4 10 days ago

Good Job man!

#1 opened 14 days ago by

New activity in ArliAI/GLM-4.5-Air-Derestricted 10 days ago

Request nvfp4 quantization

#2 opened 12 days ago by

New activity in TheDrummer/Precog-123B-v1 21 days ago

Good Idea

#1 opened 21 days ago by

New activity in Firworks/Kimi-Linear-48B-A3B-Instruct-nvfp4 23 days ago

error on spark

#4 opened 27 days ago by

Looks like moonshot updated base repo

#5 opened 23 days ago by

New activity in Firworks/Valkyrie-49B-v2-nvfp4 28 days ago

thanks for doing these fp4 quants

#1 opened 29 days ago by

New activity in Firworks/Kimi-Linear-48B-A3B-Instruct-nvfp4 about 1 month ago

thank you + one more...

#3 opened about 1 month ago by