HumanEvalPack

Paper challenges cosine similarity metric for neural representations

A new paper published on arXiv argues that mean-pooled cosine similarity, a common metric for comparing neural representations, is not length-invariant. The researchers demonstrate that sequence length alone can heavily…