I was considering it from a practical angle. In day-to-day life, continuity and persistence are necessary. And past memories are what give that continuity and persistence.

Take something like riding a bicycle for example. When we first start learning, we fall and crash and wobble. But after some "learning", most of the actions necessary to rid the bicycle become persistent. Do we really want to look upon bicylce riding with "truly fresh eyes" every time we want to ride a bicycle to get someplace? I'm sure I don't. I would rather "contain the memory-based knowledge" of bicycle riding.

On the other hand, there is of course the "deeper knowledge". In an absolute/philosophical sense, there is only NOW. In that sense, yes, we do have the possibility of starting over each and every moment. And depending on your viewpoint (i.e. beliefs), this "deeper knowledge" could ultimately comprise all knowledge in the universe. So in that sense, one could replace "remembering" with "knowing" and completely bypass the "learning" process.

I was speaking from the perspective of deeper knowledge ultimately comprising all knowledge of the universe.

If one could completely replace "remembering" with "knowing", thereby completely bypassing "learning", there'd be no point in coming into human existence. If this happened to all of humanity... perhaps we (humanity) would be "done".

I'm happy to remember how to drive my car. It serves me in this life. Those memories that color all new incoming information with either a "good" or "bad" assessment, could be taken into consideration before making any final assumptions (in any new situation / relationship).

One could get all Psychoanalytical here, but it only seems to lead one in a never-ending, tail-chasing cycle.