Hugging Face's logo

ICTNLP
/
stream-omni-8b

Any-to-Any
Safetensors
stream_omni_llama
omni
Model card Files
xet
Community
2
张绍磊 commited on
Commit
cf6a785
·
1 Parent(s): 54f2fa1

update

Browse files
Files changed (1) hide show
  1. README.md +3 -4
README.md CHANGED
@@ -6,13 +6,15 @@ tags:
6
  ---
7
  # Stream-Omni: Simultaneous Multimodal Interactions with Large Language-Vision-Speech Model
8
 
9
- [![arXiv](https://img.shields.io/badge/arXiv-XXXX.XXXX-b31b1b.svg?logo=arXiv)](https://arxiv.org/abs/XXXX.XXXXX)
 
10
  [![model](https://img.shields.io/badge/%F0%9F%A4%97%20Huggingface%20-stream--omni--8b-orange.svg)](https://huggingface.co/ICTNLP/stream-omni-8b)
11
  [![data](https://img.shields.io/badge/%F0%9F%93%91%20Datasets%20-InstructOmni-green.svg)](https://huggingface.co/datasets/ICTNLP/InstructOmni)
12
  [![Badge](https://hitscounter.dev/api/hit?url=https%3A%2F%2Fgithub.com%2Fictnlp%2FStream-Omni&label=Visitors&icon=graph-up&color=%23dc3545)](https://github.com/ictnlp/Stream-Omni)
13
 
14
  > [**Shaolei Zhang**](https://zhangshaolei1998.github.io/), [**Shoutao Guo**](https://scholar.google.com.hk/citations?user=XwHtPyAAAAAJ), [**Qingkai Fang**](https://fangqingkai.github.io/), [**Yan Zhou**](https://zhouyan19.github.io/zhouyan/), [**Yang Feng**](https://people.ucas.edu.cn/~yangfeng?language=en)\*
15
 
 
16
 
17
  Stream-Omni is an end-to-end language-vision-speech chatbot that simultaneously supports interaction across various modality combinations, with the following features💡:
18
  - **Omni Interaction**: Support any multimodal inputs including text, vision, and speech, and generate both text and speech responses.
@@ -32,6 +34,3 @@ Stream-Omni is an end-to-end language-vision-speech chatbot that simultaneously
32
  > [!NOTE]
33
  >
34
  > **Stream-Omni can produce intermediate textual results (ASR transcription and text response) during speech interaction, offering users a seamless "see-while-hear" experience.**
35
-
36
-
37
- The introduction and usage of Stream-Omni refer to [https://github.com/ictnlp/Stream-Omni](https://github.com/ictnlp/Stream-Omni).
 
6
  ---
7
  # Stream-Omni: Simultaneous Multimodal Interactions with Large Language-Vision-Speech Model
8
 
9
+ [![arXiv](https://img.shields.io/badge/arXiv-2506.13642-b31b1b.svg?logo=arXiv)](https://arxiv.org/abs/2506.13642)
10
+ [![arXiv](https://img.shields.io/badge/GitHub-Stream--Omni-black.svg?logo=github)](https://github.com/ictnlp/Stream-Omni)
11
  [![model](https://img.shields.io/badge/%F0%9F%A4%97%20Huggingface%20-stream--omni--8b-orange.svg)](https://huggingface.co/ICTNLP/stream-omni-8b)
12
  [![data](https://img.shields.io/badge/%F0%9F%93%91%20Datasets%20-InstructOmni-green.svg)](https://huggingface.co/datasets/ICTNLP/InstructOmni)
13
  [![Badge](https://hitscounter.dev/api/hit?url=https%3A%2F%2Fgithub.com%2Fictnlp%2FStream-Omni&label=Visitors&icon=graph-up&color=%23dc3545)](https://github.com/ictnlp/Stream-Omni)
14
 
15
  > [**Shaolei Zhang**](https://zhangshaolei1998.github.io/), [**Shoutao Guo**](https://scholar.google.com.hk/citations?user=XwHtPyAAAAAJ), [**Qingkai Fang**](https://fangqingkai.github.io/), [**Yan Zhou**](https://zhouyan19.github.io/zhouyan/), [**Yang Feng**](https://people.ucas.edu.cn/~yangfeng?language=en)\*
16
 
17
+ The introduction and usage of Stream-Omni refer to [https://github.com/ictnlp/Stream-Omni](https://github.com/ictnlp/Stream-Omni).
18
 
19
  Stream-Omni is an end-to-end language-vision-speech chatbot that simultaneously supports interaction across various modality combinations, with the following features💡:
20
  - **Omni Interaction**: Support any multimodal inputs including text, vision, and speech, and generate both text and speech responses.
 
34
  > [!NOTE]
35
  >
36
  > **Stream-Omni can produce intermediate textual results (ASR transcription and text response) during speech interaction, offering users a seamless "see-while-hear" experience.**