Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -16,13 +16,13 @@ pipeline_tag: audio-classification
|
|
| 16 |
|
| 17 |
Welcome to the central model hub registry for the **Maximized Global Bioacoustic Pipeline**. This repository acts as the lightweight telemetry layer housing optimized neural embedding anchors, geometric coordinate boundaries, and species indices trained over a dense global avian distribution dataset.
|
| 18 |
|
| 19 |
-
Instead of running heavy cloud computing instances, this project
|
| 20 |
|
| 21 |
---
|
| 22 |
|
| 23 |
## ๐ Complete Application Portal
|
| 24 |
|
| 25 |
-
All interactive
|
| 26 |
|
| 27 |
[](https://colab.research.google.com/drive/1EL5VS_vAKvojPf5UPuQVFbK5gkgP51hB?usp=sharing)
|
| 28 |
|
|
@@ -30,26 +30,42 @@ All interactive components, digital signal processing layers, and frontend tools
|
|
| 30 |
|
| 31 |
## ๐ ๏ธ Integrated Core Features
|
| 32 |
|
| 33 |
-
When you open the unified application notebook, you gain instant access to two distinct software modules running concurrently
|
| 34 |
|
| 35 |
### 1. ๐๏ธ DSP-Enhanced Live Microphone Classification
|
| 36 |
-
* **Hardware-Level
|
| 37 |
-
* **Volume Normalization:** Automatically scales incoming waveform peaks up to 100% vector capacity before forwarding vectors to the neural engine.
|
| 38 |
-
* **Strict False Positive
|
| 39 |
|
| 40 |
### 2. ๐ต 168-Species Scroll-Tab Jukebox
|
| 41 |
-
* **Native Byte Streaming:** Bypasses standard backend bottlenecks to tap directly into raw data packets dynamically.
|
| 42 |
-
* **Alphabetical Scroll Selection:** An interactive dropdown interface built using `ipywidgets` allowing
|
| 43 |
-
* **On-Demand Memory Playback:** Strips, normalizes, and re-inflates targeted binary files directly in your browser, generating an instant, interactive playback controller strip.
|
| 44 |
|
| 45 |
---
|
| 46 |
|
| 47 |
## ๐งฌ Repository Asset Architecture
|
| 48 |
|
| 49 |
-
The
|
| 50 |
|
| 51 |
* `trained_cluster_brain.joblib`: Contains the pre-fit multi-dimensional **UMAP coordinates** and **HDBSCAN mathematical density boundaries** tracking 149 distinct biological clusters.
|
| 52 |
-
* `acoustic_atlas_metadata.csv`: The primary dictionary mapping vector tracking identifiers directly to verified scientific taxonomy classifications.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 53 |
|
| 54 |
---
|
| 55 |
*Developed as a high-purity, decoupled machine learning architecture.*
|
|
|
|
| 16 |
|
| 17 |
Welcome to the central model hub registry for the **Maximized Global Bioacoustic Pipeline**. This repository acts as the lightweight telemetry layer housing optimized neural embedding anchors, geometric coordinate boundaries, and species indices trained over a dense global avian distribution dataset.
|
| 18 |
|
| 19 |
+
Instead of running heavy, costly cloud computing instances, this project implements a highly efficient, decoupled edge computing design pattern. Live audio inputs are mapped client-side directly against the pre-compiled biological cluster boundaries stored securely right here on this repository.
|
| 20 |
|
| 21 |
---
|
| 22 |
|
| 23 |
## ๐ Complete Application Portal
|
| 24 |
|
| 25 |
+
All interactive classification tools, digital signal processing layers, and end-user jukebox interfaces have been consolidated into a single, unified pipeline application workspace. Click the official launch badge below to initialize the system runtime:
|
| 26 |
|
| 27 |
[](https://colab.research.google.com/drive/1EL5VS_vAKvojPf5UPuQVFbK5gkgP51hB?usp=sharing)
|
| 28 |
|
|
|
|
| 30 |
|
| 31 |
## ๐ ๏ธ Integrated Core Features
|
| 32 |
|
| 33 |
+
When you open the unified application notebook, you gain instant access to two distinct software modules running concurrently in your runtime memory:
|
| 34 |
|
| 35 |
### 1. ๐๏ธ DSP-Enhanced Live Microphone Classification
|
| 36 |
+
* **Hardware-Level Optimization:** Harnesses browser-side digital signal processing (`autoGainControl`, `noiseSuppression`, `echoCancellation`) to actively amplify faint target signals while dropping background room reflections or environmental static.
|
| 37 |
+
* **Peak Volume Normalization:** Automatically scales incoming waveform peaks up to 100% vector capacity before forwarding vectors to the neural engine, preventing low-amplitude math degradation.
|
| 38 |
+
* **Strict False Positive Rejection:** Leverages an aggressive geometric Euclidean proximity filter (`Fail Limit: 0.8`) to safely declare ambiguous room noises or human speech as `NO BIRD DETECTED` rather than forcing an inaccurate taxonomic match.
|
| 39 |
|
| 40 |
### 2. ๐ต 168-Species Scroll-Tab Jukebox
|
| 41 |
+
* **Native Byte Streaming:** Bypasses standard backend serialization bottlenecks to tap directly into raw data packets dynamically.
|
| 42 |
+
* **Alphabetical Scroll Selection:** An interactive dropdown interface built using `ipywidgets` allowing users to seamlessly scroll through 168 entirely unique global species.
|
| 43 |
+
* **On-Demand Memory Playback:** Strips, normalizes, and re-inflates targeted binary files directly in your browser, generating an instant, interactive HTML5 playback controller strip.
|
| 44 |
|
| 45 |
---
|
| 46 |
|
| 47 |
## ๐งฌ Repository Asset Architecture
|
| 48 |
|
| 49 |
+
The compiled weights hosted under the `Files and versions` tab contain the underlying structural parameters consumed by the application notebook:
|
| 50 |
|
| 51 |
* `trained_cluster_brain.joblib`: Contains the pre-fit multi-dimensional **UMAP coordinates** and **HDBSCAN mathematical density boundaries** tracking 149 distinct biological clusters.
|
| 52 |
+
* `acoustic_atlas_metadata.csv`: The primary data dictionary mapping vector tracking identifiers directly to verified scientific taxonomy classifications.
|
| 53 |
+
|
| 54 |
+
---
|
| 55 |
+
|
| 56 |
+
## ๐ Production Roadmap: Robust Data Augmentation
|
| 57 |
+
> ### โ ๏ธ The Real-World Challenge: Domain Shift
|
| 58 |
+
> When transitioning from a prototype to a commercial smartphone application (competing directly with industry standards like Cornell's Merlin bird app), training purely on pristine, studio-quality wildlife recordings creates a severe data distribution mismatch. Real-world users record audio using cheap smartphone microphones inside reflective environments filled with city static.
|
| 59 |
+
|
| 60 |
+
To bridge this gap and engineer an production-grade model, the next phase requires implementing **In-Pipeline Data Augmentation**. Instead of feeding the transformer clean audio vectors, we intentionally corrupt the training data before it hits the Vision Transformer layers. This forces the neural network to ignore environmental noise and focus strictly on underlying biological frequency shapes.
|
| 61 |
+
|
| 62 |
+
| Augmentation Strategy | Technical Implementation Mechanism | Operational Objective |
|
| 63 |
+
| :--- | :--- | :--- |
|
| 64 |
+
| **Additive White Noise** | Inject Gaussian white noise arrays directly into the audio tensors at variable Signal-to-Noise Ratios (SNRs) using `torch.randn_like(waveform)`. | Simulates wind rustle, rain interference, and atmospheric outdoor friction. |
|
| 65 |
+
| **Convoluted Reverb** | Convolve the raw bird audio waveforms with real-world Impulse Response (IR) files representing physical spaces via `torchaudio.functional.fftconvolve`. | Digitally simulates sound waves bouncing off hard bedroom walls or tree canopies, neutralizing acoustic room coloration. |
|
| 66 |
+
| **Dynamic Low-Pass Filtering** | Apply biquad low-pass frequency cuts (`torchaudio.functional.lowpass_biquad`) with randomized cutoff frequencies between 4kHz and 8kHz. | Artificially muffles high-frequency harmonics to match the hardware response limits of budget phone microphones. |
|
| 67 |
+
|
| 68 |
+
By building this synthetic adversarial environment during training, the model develops high acoustic resilience, allowing it to easily map heavily distorted physical microphone sounds directly back to their true digital coordinates.
|
| 69 |
|
| 70 |
---
|
| 71 |
*Developed as a high-purity, decoupled machine learning architecture.*
|