Abhinav Kulkarni

abhinavkulkarni

https://www.linkedin.com/in/abhinavmkulkarni/

AI & ML interests

NLP

Recent Activity

new activity 17 days ago

cpatonn/Qwen3-Next-80B-A3B-Thinking-AWQ-4bit:Multi token prediction not working

new activity 22 days ago

cpatonn/Qwen3-Next-80B-A3B-Thinking-AWQ-4bit:Multi token prediction not working

new activity 2 months ago

HuggingFaceFW/finepdfs:Were the original PDFs saved?

View all activity

Organizations

None yet

New activity in cpatonn/Qwen3-Next-80B-A3B-Thinking-AWQ-4bit 17 days ago

Multi token prediction not working

#6 opened 22 days ago by

abhinavkulkarni

New activity in HuggingFaceFW/finepdfs 2 months ago

Were the original PDFs saved?

#2 opened 3 months ago by

staghado

New activity in Qwen/Qwen3-30B-A3B 7 months ago

Enabling or disabling reasoning on-demand with remote vLLM server?

#15 opened 7 months ago by

abhinavkulkarni

New activity in abhinavkulkarni/mosaicml-mpt-30b-chat-w4-g128-awq over 1 year ago

Adding `safetensors` variant of this model

#1 opened over 1 year ago by

SFconvertbot

New activity in cjpais/llava-1.6-mistral-7b-gguf over 1 year ago

llava_eval_image_embed : failed to eval

#6 opened over 1 year ago by

jartine

New activity in abhinavkulkarni/mosaicml-mpt-7b-chat-w4-g128-awq almost 2 years ago

Adding `safetensors` variant of this model

#1 opened almost 2 years ago by

SFconvertbot

New activity in togethercomputer/StripedHyena-Nous-7B almost 2 years ago

Unable to quantize layers one at a time

#8 opened almost 2 years ago by

abhinavkulkarni

Unable to load the model.. Can you explain..

#7 opened almost 2 years ago by

jdc4429

Unable to load tokenizer

#5 opened almost 2 years ago by

abhinavkulkarni

New activity in abhinavkulkarni/codellama-CodeLlama-13b-Instruct-hf-w4-g128-awq about 2 years ago

Adding `safetensors` variant of this model

#1 opened about 2 years ago by

SFconvertbot

New activity in abhinavkulkarni/meta-llama-Llama-2-13b-chat-hf-w4-g128-awq over 2 years ago

70B AWQ model?

#2 opened over 2 years ago by

Teja-Gollapudi

New activity in TheBloke/starchat-beta-GPTQ over 2 years ago

is it possible to make this work with huggingface/text-generation-inference ?

#5 opened over 2 years ago by

captainst

New activity in abhinavkulkarni/meta-llama-Llama-2-13b-chat-hf-w4-g128-awq over 2 years ago

The code provided in the model card does not work

#1 opened over 2 years ago by

AnalogAiBert

New activity in VMware/open-llama-13b-open-instruct over 2 years ago

AWQ 4-bit 128g version of open-llama-13b-open-instruct!

#3 opened over 2 years ago by

abhinavkulkarni

New activity in mosaicml/mpt-7b-instruct over 2 years ago

AWQ 4-bit 128g version of mpt-7b-instruct!

#62 opened over 2 years ago by

abhinavkulkarni

New activity in VMware/open-llama-7b-open-instruct over 2 years ago

AWQ 4-bit 128g version of open-llama-7b-open-instruct!

#1 opened over 2 years ago by

abhinavkulkarni

New activity in tiiuae/falcon-7b-instruct over 2 years ago

AWQ 4-bit 128g version of falcon-7b-instruct!

❤️ 2

#55 opened over 2 years ago by

abhinavkulkarni

New activity in abhinavkulkarni/lmsys-vicuna-33b-v1.3-w4-g128-awq over 2 years ago

Inference

#1 opened over 2 years ago by

bartowski

New activity in abhinavkulkarni/tiiuae-falcon-40b-instruct-w4-g128-awq over 2 years ago

Fix q_group_size

#1 opened over 2 years ago by

mike-ravkine

New activity in abhinavkulkarni/tiiuae-falcon-7b-instruct-w4-g64-awq over 2 years ago

Thanks for this model!

#1 opened over 2 years ago by

mike-ravkine

Abhinav Kulkarni

AI & ML interests

Recent Activity

Organizations