ByteDance Researchers Uncover Mechanism Behind Long-Context Retrieval Issues in DeepSeek Models
Researchers from ByteDance's Seed team have discovered a mechanism that contributes to inconsistent long-context retrieval in DeepSeek models. Their findings indicate that chunked KV-cache compression affects retrieval accuracy based on the position of information within a compression window, leadin...