Commit 
							
							·
						
						b70aa86
	
1
								Parent(s):
							
							98d9793
								
Update config.json
Browse filesFixed on TGI: https://github.com/huggingface/text-generation-inference/releases/tag/v1.3.3
PR: https://github.com/huggingface/text-generation-inference/pull/1348
Is was never meant to support sliding window attention
- config.json +1 -1
    	
        config.json
    CHANGED
    
    | @@ -16,7 +16,7 @@ | |
| 16 | 
             
              "num_key_value_heads": 8,
         | 
| 17 | 
             
              "rms_norm_eps": 1e-05,
         | 
| 18 | 
             
              "rope_theta": 1000000.0,
         | 
| 19 | 
            -
              "sliding_window":  | 
| 20 | 
             
              "tie_word_embeddings": false,
         | 
| 21 | 
             
              "torch_dtype": "bfloat16",
         | 
| 22 | 
             
              "transformers_version": "4.36.0",
         | 
|  | |
| 16 | 
             
              "num_key_value_heads": 8,
         | 
| 17 | 
             
              "rms_norm_eps": 1e-05,
         | 
| 18 | 
             
              "rope_theta": 1000000.0,
         | 
| 19 | 
            +
              "sliding_window": null,
         | 
| 20 | 
             
              "tie_word_embeddings": false,
         | 
| 21 | 
             
              "torch_dtype": "bfloat16",
         | 
| 22 | 
             
              "transformers_version": "4.36.0",
         | 
