In what way do you think it learns?

It can use new information when performing new tasks. It can store experience based on mistakes it made. It can store knowledge in several ways (context, files) and use it when needed.

There is a chance it will forget something, but the same can be said for humans.

so like a novel or a working paper? Or notes?

like a digital, nearly instantly accessible notes, with additional notes describing where other notes are and what they contain