Beyond Real: Imaginary Extension of Rotary Position Embeddings for Long-Context LLMs
Paper • 2512.07525 • Published • 60
RoPE++
-
-
SII-xrliu/RoPE-DCLM-376M-4k
0.4B • Updated • 9 -
SII-xrliu/RoPEPP_EH-DCLM-376M-4k
0.4B • Updated • 4 -
SII-xrliu/RoPEPP_EC-DCLM-376M-4k
0.4B • Updated • 3 -
SII-xrliu/RoPE-DCLM-376M-32k
0.4B • Updated • 5 -
SII-xrliu/RoPEPP_EH-DCLM-376M-32k
0.4B • Updated • 5 -
SII-xrliu/RoPEPP_EC-DCLM-376M-32k
0.4B • Updated • 4 -
SII-xrliu/RoPE-DCLM-776M-4k
0.8B • Updated • 4 -
SII-xrliu/RoPEPP_EH-DCLM-776M-4k
0.7B • Updated • 3 -
SII-xrliu/RoPEPP_EC-DCLM-776M-4k
0.8B • Updated • 3 -
SII-xrliu/RoPE-DCLM-776M-32k
0.8B • Updated • 3 -
SII-xrliu/RoPEPP_EH-DCLM-776M-32k
0.7B • Updated • 3 -
SII-xrliu/RoPEPP_EC-DCLM-776M-32k
0.8B • Updated • 5 -
SII-xrliu/RoPE-DCLM-1_5B-4k
1B • Updated • 4 -
SII-xrliu/RoPEPP_EH-DCLM-1_5B-4k
1B • Updated • 1 -
SII-xrliu/RoPEPP_EC-DCLM-1_5B-4k
1B • Updated • 5 -
SII-xrliu/RoPE-DCLM-1_5B-32k
1B • Updated • 2 -
SII-xrliu/RoPEPP_EH-DCLM-1_5B-32k
1B • Updated • 2 -
SII-xrliu/RoPEPP_EC-DCLM-1_5B-32k
1B • Updated • 3