Spaces:
Running
on
Zero
Running
on
Zero
Update README.md
Browse files
README.md
CHANGED
|
@@ -11,4 +11,90 @@ license: apache-2.0
|
|
| 11 |
short_description: 'OnDevice medical transcription and note creation '
|
| 12 |
---
|
| 13 |
|
| 14 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 11 |
short_description: 'OnDevice medical transcription and note creation '
|
| 12 |
---
|
| 13 |
|
| 14 |
+
|
| 15 |
+
# Medical Transcription & Note Generation
|
| 16 |
+
|
| 17 |
+
This Hugging Face Space provides an end-to-end solution for medical transcription and structured note generation from patient-doctor conversations.
|
| 18 |
+
|
| 19 |
+
## Features
|
| 20 |
+
|
| 21 |
+
### 🎙️ Audio Recording & Transcription
|
| 22 |
+
- **Multi-source Audio Input**: Record directly via microphone or upload audio files
|
| 23 |
+
- **Multiple Whisper Models**: Choose from all available Whisper models (tiny to large-v3)
|
| 24 |
+
- **GPU-Accelerated**: Utilizes GPU for fast transcription when available
|
| 25 |
+
- **Streaming Output**: Real-time transcription display with editable text
|
| 26 |
+
- **Audio Download**: Save recorded conversations as WAV files
|
| 27 |
+
|
| 28 |
+
### 📋 Medical Note Generation
|
| 29 |
+
- **Side-by-side View**: Transcription and medical notes displayed together
|
| 30 |
+
- **Multiple LLM Models**: Select from various medical-focused language models
|
| 31 |
+
- **Dual Note Types**:
|
| 32 |
+
- **SOAP Notes**: Structured Subjective, Objective, Assessment, Plan format
|
| 33 |
+
- **Full Structured Notes**: Comprehensive 14-section clinical documentation
|
| 34 |
+
- **Copy Functionality**: Easy copying of transcription and generated notes
|
| 35 |
+
|
| 36 |
+
## Note Types
|
| 37 |
+
|
| 38 |
+
### SOAP Note Format
|
| 39 |
+
- **S (Subjective)**: Patient's reported symptoms and history
|
| 40 |
+
- **O (Objective)**: Clinical findings, vital signs, lab results
|
| 41 |
+
- **A (Assessment)**: Diagnosis and clinical reasoning
|
| 42 |
+
- **P (Plan)**: Treatment plan and management
|
| 43 |
+
|
| 44 |
+
### Full Structured Medical Note
|
| 45 |
+
1. Presenting Illness
|
| 46 |
+
2. History of Presenting Illness
|
| 47 |
+
3. Past Medical History
|
| 48 |
+
4. Surgical History
|
| 49 |
+
5. Family History
|
| 50 |
+
6. Social History
|
| 51 |
+
7. Allergy History
|
| 52 |
+
8. Medication History
|
| 53 |
+
9. Dietary History
|
| 54 |
+
10. Review of Systems
|
| 55 |
+
11. Physical Exam Findings
|
| 56 |
+
12. Labs and Imaging
|
| 57 |
+
13. Assessment
|
| 58 |
+
14. Plan
|
| 59 |
+
|
| 60 |
+
## Models Available
|
| 61 |
+
|
| 62 |
+
### Whisper Models
|
| 63 |
+
- openai/whisper-tiny (Default - fastest)
|
| 64 |
+
- openai/whisper-base
|
| 65 |
+
- openai/whisper-small
|
| 66 |
+
- openai/whisper-medium
|
| 67 |
+
- openai/whisper-large-v2
|
| 68 |
+
- openai/whisper-large-v3
|
| 69 |
+
|
| 70 |
+
### Medical LLM Models
|
| 71 |
+
- OnDeviceMedNotes/Struct_Med_Note_v01 (Default)
|
| 72 |
+
- microsoft/DialoGPT-medium
|
| 73 |
+
- meta-llama/Llama-2-7b-chat-hf
|
| 74 |
+
- mistralai/Mistral-7B-Instruct-v0.1
|
| 75 |
+
|
| 76 |
+
## Usage Instructions
|
| 77 |
+
|
| 78 |
+
1. **Record/Upload Audio**: Use the microphone to record or upload an audio file
|
| 79 |
+
2. **Select Whisper Model**: Choose transcription model based on speed/accuracy needs
|
| 80 |
+
3. **Transcribe**: Click "Transcribe Audio" to convert speech to text
|
| 81 |
+
4. **Edit Transcription**: Review and edit the transcribed text if needed
|
| 82 |
+
5. **Choose Note Type**: Select between SOAP note or full structured note
|
| 83 |
+
6. **Select LLM Model**: Choose the medical language model
|
| 84 |
+
7. **Generate Note**: Click "Generate Medical Note" to create structured documentation
|
| 85 |
+
8. **Copy/Download**: Use copy buttons or download audio file as needed
|
| 86 |
+
|
| 87 |
+
## Technical Details
|
| 88 |
+
|
| 89 |
+
- **GPU Support**: Automatic GPU utilization for both transcription and note generation
|
| 90 |
+
- **Memory Optimization**: Efficient model loading and inference
|
| 91 |
+
- **Error Handling**: Robust error handling for various input formats
|
| 92 |
+
- **Audio Processing**: Automatic resampling and format conversion
|
| 93 |
+
|
| 94 |
+
## Privacy & Security
|
| 95 |
+
|
| 96 |
+
⚠️ **Important**: This application is for demonstration purposes. Do not upload actual patient data or PHI (Protected Health Information). Always ensure compliance with HIPAA and local privacy regulations when handling medical data.
|
| 97 |
+
|
| 98 |
+
## License
|
| 99 |
+
|
| 100 |
+
This project is open source. Please ensure appropriate licensing for any models used in production environments.
|