spatial interfaces need to allow us to point
It’s important for the “virtual” nature of the interface to fall away, and for the group members to begin operating with the standard comforts of sharing a physical space. And I think that idea is embodied by the physical act of pointing to show something virtual to someone else who’s next to you.
There is also the element of the communication delay, but that shouldn’t be an issue in the With others scenario