That's true. For Touma's case, he is trying to move on with his life without his memories and reckons his memories are stowed away somewhere in his heart. Although, he does have the urge to recover his lost memories but isn't really too bothered about it. I will be looking out for this animation "Golden Time".