A model answers using the text currently in front of it, and that space, the context window, is finite. Everything, the instructions, the conversation so far and any supporting documents, competes for the same room, measured in tokens.
When the window fills, earlier material must be summarised or dropped, which is why long conversations can lose track of their beginning. Larger windows help but cost more to process, so systems still manage carefully what they keep in view.