All this talk of Nintendo made me check in on Sony.
Interesting patent Dec 23.
Obviously working towards SNN as well.
If only hey?
Sony Patent | Deployment of dynamic vision sensor hybrid element in method for tracking a controller and simultaneous body tracking, slam or safety shutter
Patent: Deployment of dynamic vision sensor hybrid element in method for tracking a controller and simultaneous body tracking, slam or safety shutter
Patent PDF: 20230398434
Publication Number: 20230398434
Publication Date: 2023-12-14
Assignee: Sony Interactive Entertainment Inc
Excerpt:
In an alternative implementation finger tracking may be performed without the use of one or more light sources. A machine learning model may be trained with a machine learning algorithm to detect finger position from events generated from ambient light changes due to finger movement. The machine learning model may be a general machine learning model such as a CNN, RNN or DNN as discussed above.
In some implementations specialized machine learning model such as for example and without limitation a spiking (or sparking) neural network (SNN) may be trained with a specialized machine learning algorithm. An SNN mimics biological NNs by having an activation threshold and a weight that is adjusted according to a relative spike time within an interval, also known as Spike-timing-dependent-plasticity (STDP). When the activation threshold is achieved the SNN is said to spike and transmit its weight to the next layer. An SNN may be trained via STDP and supervised or unsupervised learning techniques. and More information about SNNs can be found in Tavanaei, Amirhossein et al. “Deep Learning in Spiking Neural Networks” Neural Networks (2018) arXiv:1804.08150, the contents of which are incorporated herein by reference for all purposes.