Context size seems like a good marketing number since its easy for a wide audience to understand a bigger number is better. I have often wondered how well models actually use the context given. Goodhart's Law: "When a measure becomes a target, it seizes to be a good measure"