Stevessr 在「arxiv」Slim attention: cut your context memory in half without loss of accuracy 中发帖用K cache 计算V cache :bili_040: [图片]

Stevessr 在「arxiv」Slim attention: cut your context memory in half without loss of accuracy 中发帖

用K cache 计算V cache :bili_040: 
                    
            [图片]