This sort of interface would likely work best at the operating system level, since the OS has so much information on your interactions and can control your engagements at a wider breadth.
The OS level system has been thought about by Andy Matuschak as part of a potential
Spaced Everything future, as well as by Rene Ritchie in what he calls SiriOS.