Being loved and being known are not the same arrival. One is affection aimed at an idea of a person; the other is aimed at the actual specimen.
You can tell which by the details they have retained. How you take your tea, yes, but also what you are afraid of, and which of your stories you tell when you are nervous.
Joy sits downstream of that. It is difficult to be light-hearted around anyone you are still managing an impression for.
There is at least one thing they know about you that nobody else does, and that is where the ease comes from.