Keeping context is NOT the main issue of LLMs.

The main issue is DROPPING context which is not actual anymore.