位置エンコーディング補間
https://arxiv.org/pdf/2306.15595
EXTENDING CONTEXT WINDOW OF LARGE LANGUAGE MODELS VIA POSITION INTERPOLATION
Shouyuan Chen
, Sherman Wong, Liangjian Chen, Yuandong Tian
Meta Platforms Inc.