April 14, 1865: why did the Lincolns have guests?

[LincolnMan]

It always strikes me as odd that Grant would turn down Lincoln's invitation. Afterall, Lincoln was Grant's boss. I think it also speaks to the good relationship they borh had with each other that made it easier, perhaps, for Grant to do so.