Update README.md
Browse files
README.md
CHANGED
|
@@ -50,10 +50,10 @@ Built on the **PolicyGuardBench** dataset, it achieves **high accuracy**, **cros
|
|
| 50 |
|
| 51 |
| Model | Type | Params | Accuracy | F1 | Latency (ms/example) |
|
| 52 |
|:------|:------|:-------:|:---------:|:----:|:--------------------:|
|
| 53 |
-
| **PolicyGuard-4B (ours)** | Guardrail | 4B |
|
| 54 |
| Llama-Guard-3-8B | Guardrail | 8B | 0.4246 | 0.5952 | 164.8 |
|
| 55 |
| Qwen-3-8B | Foundation | 8B | 0.6408 | 0.6407 | 115.8 |
|
| 56 |
-
| Llama-3.3-70B | Foundation | 70B | 0.9054 | 0.8883 | 305.0 |
|
| 57 |
| Gemini-1.5-Pro | Frontier | – | 0.8713 | 0.8502 | 596.1 |
|
| 58 |
|
| 59 |
➡️ **PolicyGuard-4B** achieves **near-frontier accuracy** at **<1/10 inference cost**, demonstrating that efficient, small-scale guardrails are feasible:contentReference[oaicite:1]{index=1}.
|
|
|
|
| 50 |
|
| 51 |
| Model | Type | Params | Accuracy | F1 | Latency (ms/example) |
|
| 52 |
|:------|:------|:-------:|:---------:|:----:|:--------------------:|
|
| 53 |
+
| **PolicyGuard-4B (ours)** | Guardrail | 4B | <u>0.9014</u> | <u>0.8759</u> | **22.5** |
|
| 54 |
| Llama-Guard-3-8B | Guardrail | 8B | 0.4246 | 0.5952 | 164.8 |
|
| 55 |
| Qwen-3-8B | Foundation | 8B | 0.6408 | 0.6407 | 115.8 |
|
| 56 |
+
| Llama-3.3-70B | Foundation | 70B | **0.9054** | **0.8883** | 305.0 |
|
| 57 |
| Gemini-1.5-Pro | Frontier | – | 0.8713 | 0.8502 | 596.1 |
|
| 58 |
|
| 59 |
➡️ **PolicyGuard-4B** achieves **near-frontier accuracy** at **<1/10 inference cost**, demonstrating that efficient, small-scale guardrails are feasible:contentReference[oaicite:1]{index=1}.
|