sukriramli commited on
Commit
ce7c27c
ยท
verified ยท
1 Parent(s): 132986b

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +27 -11
README.md CHANGED
@@ -16,13 +16,13 @@ pipeline_tag: audio-classification
16
 
17
  Welcome to the central model hub registry for the **Maximized Global Bioacoustic Pipeline**. This repository acts as the lightweight telemetry layer housing optimized neural embedding anchors, geometric coordinate boundaries, and species indices trained over a dense global avian distribution dataset.
18
 
19
- Instead of running heavy cloud computing instances, this project uses an intelligent, decoupled edge computing pattern. Live inputs are mapped client-side directly against the pre-compiled biological cluster boundaries stored right here in this repository.
20
 
21
  ---
22
 
23
  ## ๐Ÿš€ Complete Application Portal
24
 
25
- All interactive components, digital signal processing layers, and frontend tools have been consolidated into a single, unified pipeline application workspace. Click the launch badge below to initialize the system runtime:
26
 
27
  [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1EL5VS_vAKvojPf5UPuQVFbK5gkgP51hB?usp=sharing)
28
 
@@ -30,26 +30,42 @@ All interactive components, digital signal processing layers, and frontend tools
30
 
31
  ## ๐Ÿ› ๏ธ Integrated Core Features
32
 
33
- When you open the unified application notebook, you gain instant access to two distinct software modules running concurrently on your hardware:
34
 
35
  ### 1. ๐ŸŽ™๏ธ DSP-Enhanced Live Microphone Classification
36
- * **Hardware-Level Gains:** Harnesses browser-side digital signal processing (`autoGainControl`, `noiseSuppression`) to amplify faint target signals while dropping background room reflections or environmental static.
37
- * **Volume Normalization:** Automatically scales incoming waveform peaks up to 100% vector capacity before forwarding vectors to the neural engine.
38
- * **Strict False Positive Shield:** Leverages a strict geometric Euclidean proximity filter (`Fail Limit: 0.8`) to safely declare ambiguous room noises as `NO BIRD DETECTED` rather than forcing an inaccurate match.
39
 
40
  ### 2. ๐ŸŽต 168-Species Scroll-Tab Jukebox
41
- * **Native Byte Streaming:** Bypasses standard backend bottlenecks to tap directly into raw data packets dynamically.
42
- * **Alphabetical Scroll Selection:** An interactive dropdown interface built using `ipywidgets` allowing you to seamlessly scroll through 168 entirely unique global species.
43
- * **On-Demand Memory Playback:** Strips, normalizes, and re-inflates targeted binary files directly in your browser, generating an instant, interactive playback controller strip.
44
 
45
  ---
46
 
47
  ## ๐Ÿงฌ Repository Asset Architecture
48
 
49
- The files hosted here under the `Files and versions` tab contain the underlying structural parameters consumed by the application notebook:
50
 
51
  * `trained_cluster_brain.joblib`: Contains the pre-fit multi-dimensional **UMAP coordinates** and **HDBSCAN mathematical density boundaries** tracking 149 distinct biological clusters.
52
- * `acoustic_atlas_metadata.csv`: The primary dictionary mapping vector tracking identifiers directly to verified scientific taxonomy classifications.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
53
 
54
  ---
55
  *Developed as a high-purity, decoupled machine learning architecture.*
 
16
 
17
  Welcome to the central model hub registry for the **Maximized Global Bioacoustic Pipeline**. This repository acts as the lightweight telemetry layer housing optimized neural embedding anchors, geometric coordinate boundaries, and species indices trained over a dense global avian distribution dataset.
18
 
19
+ Instead of running heavy, costly cloud computing instances, this project implements a highly efficient, decoupled edge computing design pattern. Live audio inputs are mapped client-side directly against the pre-compiled biological cluster boundaries stored securely right here on this repository.
20
 
21
  ---
22
 
23
  ## ๐Ÿš€ Complete Application Portal
24
 
25
+ All interactive classification tools, digital signal processing layers, and end-user jukebox interfaces have been consolidated into a single, unified pipeline application workspace. Click the official launch badge below to initialize the system runtime:
26
 
27
  [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1EL5VS_vAKvojPf5UPuQVFbK5gkgP51hB?usp=sharing)
28
 
 
30
 
31
  ## ๐Ÿ› ๏ธ Integrated Core Features
32
 
33
+ When you open the unified application notebook, you gain instant access to two distinct software modules running concurrently in your runtime memory:
34
 
35
  ### 1. ๐ŸŽ™๏ธ DSP-Enhanced Live Microphone Classification
36
+ * **Hardware-Level Optimization:** Harnesses browser-side digital signal processing (`autoGainControl`, `noiseSuppression`, `echoCancellation`) to actively amplify faint target signals while dropping background room reflections or environmental static.
37
+ * **Peak Volume Normalization:** Automatically scales incoming waveform peaks up to 100% vector capacity before forwarding vectors to the neural engine, preventing low-amplitude math degradation.
38
+ * **Strict False Positive Rejection:** Leverages an aggressive geometric Euclidean proximity filter (`Fail Limit: 0.8`) to safely declare ambiguous room noises or human speech as `NO BIRD DETECTED` rather than forcing an inaccurate taxonomic match.
39
 
40
  ### 2. ๐ŸŽต 168-Species Scroll-Tab Jukebox
41
+ * **Native Byte Streaming:** Bypasses standard backend serialization bottlenecks to tap directly into raw data packets dynamically.
42
+ * **Alphabetical Scroll Selection:** An interactive dropdown interface built using `ipywidgets` allowing users to seamlessly scroll through 168 entirely unique global species.
43
+ * **On-Demand Memory Playback:** Strips, normalizes, and re-inflates targeted binary files directly in your browser, generating an instant, interactive HTML5 playback controller strip.
44
 
45
  ---
46
 
47
  ## ๐Ÿงฌ Repository Asset Architecture
48
 
49
+ The compiled weights hosted under the `Files and versions` tab contain the underlying structural parameters consumed by the application notebook:
50
 
51
  * `trained_cluster_brain.joblib`: Contains the pre-fit multi-dimensional **UMAP coordinates** and **HDBSCAN mathematical density boundaries** tracking 149 distinct biological clusters.
52
+ * `acoustic_atlas_metadata.csv`: The primary data dictionary mapping vector tracking identifiers directly to verified scientific taxonomy classifications.
53
+
54
+ ---
55
+
56
+ ## ๐Ÿš€ Production Roadmap: Robust Data Augmentation
57
+ > ### โš ๏ธ The Real-World Challenge: Domain Shift
58
+ > When transitioning from a prototype to a commercial smartphone application (competing directly with industry standards like Cornell's Merlin bird app), training purely on pristine, studio-quality wildlife recordings creates a severe data distribution mismatch. Real-world users record audio using cheap smartphone microphones inside reflective environments filled with city static.
59
+
60
+ To bridge this gap and engineer an production-grade model, the next phase requires implementing **In-Pipeline Data Augmentation**. Instead of feeding the transformer clean audio vectors, we intentionally corrupt the training data before it hits the Vision Transformer layers. This forces the neural network to ignore environmental noise and focus strictly on underlying biological frequency shapes.
61
+
62
+ | Augmentation Strategy | Technical Implementation Mechanism | Operational Objective |
63
+ | :--- | :--- | :--- |
64
+ | **Additive White Noise** | Inject Gaussian white noise arrays directly into the audio tensors at variable Signal-to-Noise Ratios (SNRs) using `torch.randn_like(waveform)`. | Simulates wind rustle, rain interference, and atmospheric outdoor friction. |
65
+ | **Convoluted Reverb** | Convolve the raw bird audio waveforms with real-world Impulse Response (IR) files representing physical spaces via `torchaudio.functional.fftconvolve`. | Digitally simulates sound waves bouncing off hard bedroom walls or tree canopies, neutralizing acoustic room coloration. |
66
+ | **Dynamic Low-Pass Filtering** | Apply biquad low-pass frequency cuts (`torchaudio.functional.lowpass_biquad`) with randomized cutoff frequencies between 4kHz and 8kHz. | Artificially muffles high-frequency harmonics to match the hardware response limits of budget phone microphones. |
67
+
68
+ By building this synthetic adversarial environment during training, the model develops high acoustic resilience, allowing it to easily map heavily distorted physical microphone sounds directly back to their true digital coordinates.
69
 
70
  ---
71
  *Developed as a high-purity, decoupled machine learning architecture.*