Toward encoding vision-To-Touch with convolutional neural networks
| dc.contributor.author | Ribani R. | |
| dc.contributor.author | Lima R.F. | |
| dc.contributor.author | Marengoni M. | |
| dc.date.accessioned | 2024-03-12T23:54:41Z | |
| dc.date.available | 2024-03-12T23:54:41Z | |
| dc.date.issued | 2019 | |
| dc.description.abstract | © 2013 IEEE.The task of encoding visual information into tactile information has been studied since the 1960s. There is still an open challenge in converting the data of an image into a small set of signals that will be sent to the user as tactile input. In this study, we evaluated two methods that have never been used for encoding vision-To-Touch using convolutional neural networks, a bag of convolutional features (BoF) and a vector of locally aggregated descriptors (VLAD). We also present here a very new method for evaluating the semantic property of the encoded signal by taking the idea that objects with similar features must have similar signals in the tactile interface; we created a semantic property evaluation (SPE) metric. Using this metric, we proved the advantage of using the BoF and VLAD methods, obtaining an SPE of 70.7% and 64.5%, respectively, which is a considerable improvement over the downscaling method used by many systems such as BrainPort, with 56.2%. | |
| dc.description.firstpage | 161175 | |
| dc.description.lastpage | 161183 | |
| dc.description.volume | 7 | |
| dc.identifier.doi | 10.1109/ACCESS.2019.2951614 | |
| dc.identifier.issn | 2169-3536 | |
| dc.identifier.uri | https://dspace.mackenzie.br/handle/10899/35348 | |
| dc.relation.ispartof | IEEE Access | |
| dc.rights | Acesso Aberto | |
| dc.subject.otherlanguage | Assistive technology | |
| dc.subject.otherlanguage | computer vision | |
| dc.subject.otherlanguage | haptic interfaces | |
| dc.subject.otherlanguage | neural networks | |
| dc.subject.otherlanguage | sensory substitution | |
| dc.title | Toward encoding vision-To-Touch with convolutional neural networks | |
| dc.type | Artigo | |
| local.scopus.citations | 0 | |
| local.scopus.eid | 2-s2.0-85077807700 | |
| local.scopus.subject | Assistive technology | |
| local.scopus.subject | Convolutional neural network | |
| local.scopus.subject | Downscaling methods | |
| local.scopus.subject | Semantic properties | |
| local.scopus.subject | Sensory substitution | |
| local.scopus.subject | Tactile information | |
| local.scopus.subject | Vector of locally aggregated descriptors | |
| local.scopus.subject | Visual information | |
| local.scopus.updated | 2024-05-01 | |
| local.scopus.url | https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85077807700&origin=inward |