Tobii Spotlight tech uses eye tracking to reduce GPU stress

Quote:

---

Benchmarks show its dynamic foveated rendering can reduce 3D shading load by 57pc.

---

Read more.

I like the idea but I suspect latency will be an issue. The 5G idea is not going to work given the way your eye moves around and how the visual processing / data stream along the optic nerve works. You might be able to use some kind of predictive tech here but ultimately if you're reacting to movement of the eye, it won't work.

Quote:

---

Originally Posted by philehidiot

I like the idea but I suspect latency will be an issue.

---

Depends... whilst the eye is actively moving, our brain compensates in various ways and there's usually some latency from our side - e.g. the human eye takes a few fractions of a second for ocular muscles to pull our lens into the right shape to see the new target of our gaze in focus.

Tobii have a good track record, so let's hope this works as it's one of the most promising technologies for allowing us to eak out more performance from GPUs - spending GPU time on expensive effects, textures, shaders, etc only where the human eye can actually apprecaite these things.

Quote:

---

Originally Posted by KultiVator

Depends... whilst the eye is actively moving, our brain compensates in various ways and there's usually some latency from our side - e.g. the human eye takes a few fractions of a second for ocular muscles to pull our lens into the right shape to see the new target of our gaze in focus.

Tobii have a good track record, so let's hope this works as it's one of the most promising technologies for allowing us to eak out more performance from GPUs - spending GPU time on expensive effects, textures, shaders, etc only where the human eye can actually apprecaite these things.

---

However, when you move your eye, the signal basically shuts off and resumes in the new position. There's compensation, yes, but the way I understand that works (bearing in mind it has been many years since I did anything on physiology of the head) means that with current technology and latency you'll not be able to keep up with the speed of just the eyeball moving. It's nothing to do with focus (if you're on a flat screen with constant distance then focus time isn't much of an issue), it's the way the eyeball moves, the signal basically cuts off (and the brain interpolates a bit so you don't see black) and resumes. This takes less than the time it'll take for a packet to transverse a 5G connection. Whether you can exploit the interpolation of the brain somehow, I dunno and that's something for people brighter than me. On the surface, I do not see how this could work without sub ms latency networks. Bear in mind we're struggling to stream games with mouse and keyboard inputs. The latency issues here are probably an order of magnitude more intrusive.

Cool, hopefully more games starting using VRS in general.

VRS is not just hardware it can be done in software too in fact the forth coming Call of Duty game uses VRS on the PS4, confirmed by Digital Foundry.