Johnyquest7 commited on
Commit
3988453
·
verified ·
1 Parent(s): cbfafc7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +87 -1
README.md CHANGED
@@ -11,4 +11,90 @@ license: apache-2.0
11
  short_description: 'OnDevice medical transcription and note creation '
12
  ---
13
 
14
- Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
11
  short_description: 'OnDevice medical transcription and note creation '
12
  ---
13
 
14
+
15
+ # Medical Transcription & Note Generation
16
+
17
+ This Hugging Face Space provides an end-to-end solution for medical transcription and structured note generation from patient-doctor conversations.
18
+
19
+ ## Features
20
+
21
+ ### 🎙️ Audio Recording & Transcription
22
+ - **Multi-source Audio Input**: Record directly via microphone or upload audio files
23
+ - **Multiple Whisper Models**: Choose from all available Whisper models (tiny to large-v3)
24
+ - **GPU-Accelerated**: Utilizes GPU for fast transcription when available
25
+ - **Streaming Output**: Real-time transcription display with editable text
26
+ - **Audio Download**: Save recorded conversations as WAV files
27
+
28
+ ### 📋 Medical Note Generation
29
+ - **Side-by-side View**: Transcription and medical notes displayed together
30
+ - **Multiple LLM Models**: Select from various medical-focused language models
31
+ - **Dual Note Types**:
32
+ - **SOAP Notes**: Structured Subjective, Objective, Assessment, Plan format
33
+ - **Full Structured Notes**: Comprehensive 14-section clinical documentation
34
+ - **Copy Functionality**: Easy copying of transcription and generated notes
35
+
36
+ ## Note Types
37
+
38
+ ### SOAP Note Format
39
+ - **S (Subjective)**: Patient's reported symptoms and history
40
+ - **O (Objective)**: Clinical findings, vital signs, lab results
41
+ - **A (Assessment)**: Diagnosis and clinical reasoning
42
+ - **P (Plan)**: Treatment plan and management
43
+
44
+ ### Full Structured Medical Note
45
+ 1. Presenting Illness
46
+ 2. History of Presenting Illness
47
+ 3. Past Medical History
48
+ 4. Surgical History
49
+ 5. Family History
50
+ 6. Social History
51
+ 7. Allergy History
52
+ 8. Medication History
53
+ 9. Dietary History
54
+ 10. Review of Systems
55
+ 11. Physical Exam Findings
56
+ 12. Labs and Imaging
57
+ 13. Assessment
58
+ 14. Plan
59
+
60
+ ## Models Available
61
+
62
+ ### Whisper Models
63
+ - openai/whisper-tiny (Default - fastest)
64
+ - openai/whisper-base
65
+ - openai/whisper-small
66
+ - openai/whisper-medium
67
+ - openai/whisper-large-v2
68
+ - openai/whisper-large-v3
69
+
70
+ ### Medical LLM Models
71
+ - OnDeviceMedNotes/Struct_Med_Note_v01 (Default)
72
+ - microsoft/DialoGPT-medium
73
+ - meta-llama/Llama-2-7b-chat-hf
74
+ - mistralai/Mistral-7B-Instruct-v0.1
75
+
76
+ ## Usage Instructions
77
+
78
+ 1. **Record/Upload Audio**: Use the microphone to record or upload an audio file
79
+ 2. **Select Whisper Model**: Choose transcription model based on speed/accuracy needs
80
+ 3. **Transcribe**: Click "Transcribe Audio" to convert speech to text
81
+ 4. **Edit Transcription**: Review and edit the transcribed text if needed
82
+ 5. **Choose Note Type**: Select between SOAP note or full structured note
83
+ 6. **Select LLM Model**: Choose the medical language model
84
+ 7. **Generate Note**: Click "Generate Medical Note" to create structured documentation
85
+ 8. **Copy/Download**: Use copy buttons or download audio file as needed
86
+
87
+ ## Technical Details
88
+
89
+ - **GPU Support**: Automatic GPU utilization for both transcription and note generation
90
+ - **Memory Optimization**: Efficient model loading and inference
91
+ - **Error Handling**: Robust error handling for various input formats
92
+ - **Audio Processing**: Automatic resampling and format conversion
93
+
94
+ ## Privacy & Security
95
+
96
+ ⚠️ **Important**: This application is for demonstration purposes. Do not upload actual patient data or PHI (Protected Health Information). Always ensure compliance with HIPAA and local privacy regulations when handling medical data.
97
+
98
+ ## License
99
+
100
+ This project is open source. Please ensure appropriate licensing for any models used in production environments.