Wouldn't it be funny if they missing thing is actually the body, and having one to give the subjective viewpoint something to center on directly leads to emerging sentience?

Though I think there's at least one more important thing missing, namely the ability to form memories - to incorporate recent context into the model's weights. I don't think it's a coincidence that this is a very complex process in humans as well (involving sleep and dreams as neccessary mechanisms).