What it is not to look back?

The pleasure of remembering had been taken from me, because there was no longer anyone to remember with. (TFIOS)