thinking more about Vision Pro

Nilay Patel’s two doubts

Camera passthrough is a dead end

some devs said “overloading an input channel with output”

eyes are what we use for input,

devs do believe in hand tracking

this fits my thoughts

[Like you alluded, I think the most worrisome thing out of these reviews is the mention of the friction with using eye tracking as the main input method. I suspect our eyes happen to move more with our thoughts than with our actions, and we may have to align the thoughts and actions (and thus slow our thinking) to work with this interface. To be fair, this is kind of how the existing mouse interaction works, you can’t really click without checking that your pointer is where you expect it to be. But notably, proficient computer users try to stay on the keyboard as much as possible so they can have the comfort of separating actions from where their eyes are looking, which is more efficient. Perhaps the solution will lie in changing the interface (something other than buttons and text fields that’s not just voice), or in some new version of a mouse that allows us to move in 3D and use tactility to navigate the interface without having to look too concertedly.](graph/2024-02-01/66af8035-8883-453e-994f-00543684e7c9/66af8035-7913-4d4b-820e-5a28976697c9/66af8035-ca62-4cfd-b938-a011c86e2a62/65bd3221-af9a-4187-9c77-3dab3843f182)

I think I buy this, essentially

Eric Welander mentioned that he felt it would be nice to be able to reach out and tap on UI elements.

This seems like something that makes as we start placing apps more in physical space

Violet Whitney on the spaitial podcast

referencing the Niantic Labs CEO article on Vision Pro

about using devices that connect us to the real world

goal is not to be isolated

I agree with this, I think MIX is definitely on this path

points out that the eye tracking is not as good as more peripheral ways of interacting

wants the technology to be in the shadows, quieter, more sensory deprivation

book on japanese culture changes, in the shadows ?

but I think she doesn’t give enough credit to Apple that this is the best version of the way to head in this direction compared to existing tech