Organic neuromorphic electronics for sensorimotor integration and learning in robotics

dc.contributor.authorKrauhausen, Imke
dc.contributor.authorKoutsouras, Dimitrios A.
dc.contributor.authorMelianas, Armantas
dc.contributor.authorKeene, S. T.
dc.contributor.authorLieberth, Katharina
dc.contributor.authorLedanseur, Hadrien
dc.contributor.authorSheelamanthula, Rajendar
dc.contributor.authorGiovannitti, Alexander
dc.contributor.authorTorricelli, Fabrizio
dc.contributor.authorMcCulloch, Iain
dc.contributor.authorBlom, Paul W. M.
dc.contributor.authorSalleo, Alberto
dc.contributor.authorvan de Burgt, Yoeri
dc.contributor.authorGkoupidenis, Paschalis
dc.contributor.departmentKAUST Solar Center (KSC)
dc.contributor.departmentChemical Science Program
dc.contributor.institutionMax Planck Institute for Polymer Research, Mainz, Germany.
dc.contributor.institutionMicrosystems, Institute for Complex Molecular Systems, Eindhoven University of Technology, Eindhoven, Netherlands.
dc.contributor.institutionDepartment of Materials Science and Engineering, Stanford University, Stanford, CA 94305, USA.
dc.contributor.institutionExponent, 149 Commonwealth Dr, Menlo Park, CA 94025, USA.
dc.contributor.institutionDepartment of Engineering, University of Cambridge, Cambridge, UK.
dc.contributor.institutionDepartment of Information Engineering, University of Brescia, 25123 Brescia, Italy.
dc.contributor.institutionDepartment of Chemistry, University of Oxford, Oxford, UK.
dc.date.accessioned2021-12-12T11:38:19Z
dc.date.available2021-12-12T11:38:19Z
dc.date.issued2021-12-10
dc.description.abstractIn living organisms, sensory and motor processes are distributed, locally merged, and capable of forming dynamic sensorimotor associations. We introduce a simple and efficient organic neuromorphic circuit for local sensorimo-tor merging and processing on a robot that is placed in a maze. While the robot is exposed to external environ-mental stimuli, visuomotor associations are formed on the adaptable neuromorphic circuit. With this on-chip sensorimotor integration, the robot learns to follow a path to the exit of a maze, while being guided by visually indicated paths. The ease of processability of organic neuromorphic electronics and their unconventional form factors, in combination with education-purpose robotics, showcase a promising approach of an affordable, versatile, and readily accessible platform for exploring, designing, and evaluating behavioral intelligence through decen-tralized sensorimotor integration.
dc.description.sponsorshipWe acknowledge F. Keller, A. Steinmetz, and A. Becker from the Max Planck Institute for Polymer Research (MPIP) for significant contribution in the design and realization of the experimental setup (maze, 3D-printed parts, and video recording) and electronics (customization of the robot and additional hardware for conditioning). We also acknowledge H.-J. Guttmann and C. Bauer for assistance in the clean room facilities of MPIP. We also acknowledge G. Malliaras for relevant preliminary discussions and B. Meijer for support
dc.description.sponsorshipFunding Facilities of MPIP (clean room, device metrology, electronics, and mechanical workshop) are supported by the Max Planck Society (to P.W.M.B. and P.G.). nano@Stanford laboratories are supported by the National Science Foundation as part of the National Nanotechnology Coordinated Infrastructure under award ECCS-1542152 (to A.S.). This study is funded by a joint project between MPIP and the Institute for Complex Molecular Systems (ICMS), Eindhoven University of Technology, grant no. MPIPICMS2019001 (to Y.v.d.B., I.K., and P.G.); European Union’s Horizon 2020 Research and Innovation Programme, grant agreement no. 802615 (to Y.v.d.B.); the Carl-Zeiss Foundation (to P.G.); National Science Foundation and the Semiconductor Research Corporation, E2CDA award no. 1739795 (to A.S. and S.T.K.); and Stanford Graduate Fellowship fund (to S.T.K.)
dc.eprint.versionPublisher's Version/PDF
dc.identifier.citationKrauhausen, I., Koutsouras, D. A., Melianas, A., Keene, S. T., Lieberth, K., Ledanseur, H., … Gkoupidenis, P. (2021). Organic neuromorphic electronics for sensorimotor integration and learning in robotics. Science Advances, 7(50). doi:10.1126/sciadv.abl5068
dc.identifier.doi10.1126/sciadv.abl5068
dc.identifier.issn2375-2548
dc.identifier.issue50
dc.identifier.journalScience Advances
dc.identifier.urihttp://hdl.handle.net/10754/673986
dc.identifier.volume7
dc.publisherAmerican Association for the Advancement of Science (AAAS)
dc.relation.urlhttps://www.science.org/doi/10.1126/sciadv.abl5068
dc.rightsArchived with thanks to Science Advances. Copyright © 2021 The Authors, some rights reserved; exclusive licensee American Association for the Advancement of Science. Distributed under a Creative Commons Attribution NonCommercial License 4.0 (CC BY-NC). This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial license, which permits use, distribution, and reproduction in any medium, so long as the resultant use is not for commercial advantage and provided the original work is properly cited.
dc.rights.urihttps://creativecommons.org/licenses/by-nc/4.0/
dc.titleOrganic neuromorphic electronics for sensorimotor integration and learning in robotics
dc.typeArticle
display.details.left<span><h5>License</h5>https://creativecommons.org/licenses/by-nc/4.0/<br><br><h5>Type</h5>Article<br><br><h5>Authors</h5><a href="https://repository.kaust.edu.sa/search?query=orcid.id:0000-0001-5633-389X&spc.sf=dc.date.issued&spc.sd=DESC">Krauhausen, Imke</a> <a href="https://orcid.org/0000-0001-5633-389X" target="_blank"><img src="https://repository.kaust.edu.sa/server/api/core/bitstreams/82a625b4-ed4b-40c8-865a-d6a5225a26a4/content" width="16" height="16"/></a><br><a href="https://repository.kaust.edu.sa/search?query=orcid.id:0000-0002-9456-9630&spc.sf=dc.date.issued&spc.sd=DESC">Koutsouras, Dimitrios A.</a> <a href="https://orcid.org/0000-0002-9456-9630" target="_blank"><img src="https://repository.kaust.edu.sa/server/api/core/bitstreams/82a625b4-ed4b-40c8-865a-d6a5225a26a4/content" width="16" height="16"/></a><br><a href="https://repository.kaust.edu.sa/search?query=orcid.id:0000-0002-3443-0987&spc.sf=dc.date.issued&spc.sd=DESC">Melianas, Armantas</a> <a href="https://orcid.org/0000-0002-3443-0987" target="_blank"><img src="https://repository.kaust.edu.sa/server/api/core/bitstreams/82a625b4-ed4b-40c8-865a-d6a5225a26a4/content" width="16" height="16"/></a><br><a href="https://repository.kaust.edu.sa/search?query=orcid.id:0000-0002-6635-670X&spc.sf=dc.date.issued&spc.sd=DESC">Keene, S. T.</a> <a href="https://orcid.org/0000-0002-6635-670X" target="_blank"><img src="https://repository.kaust.edu.sa/server/api/core/bitstreams/82a625b4-ed4b-40c8-865a-d6a5225a26a4/content" width="16" height="16"/></a><br><a href="https://repository.kaust.edu.sa/search?query=orcid.id:0000-0001-6160-7162&spc.sf=dc.date.issued&spc.sd=DESC">Lieberth, Katharina</a> <a href="https://orcid.org/0000-0001-6160-7162" target="_blank"><img src="https://repository.kaust.edu.sa/server/api/core/bitstreams/82a625b4-ed4b-40c8-865a-d6a5225a26a4/content" width="16" height="16"/></a><br><a href="https://repository.kaust.edu.sa/search?spc.sf=dc.date.issued&spc.sd=DESC&f.author=Ledanseur, Hadrien,equals">Ledanseur, Hadrien</a><br><a href="https://repository.kaust.edu.sa/search?query=orcid.id:0000-0001-5223-9580&spc.sf=dc.date.issued&spc.sd=DESC">Sheelamanthula, Rajendar</a> <a href="https://orcid.org/0000-0001-5223-9580" target="_blank"><img src="https://repository.kaust.edu.sa/server/api/core/bitstreams/82a625b4-ed4b-40c8-865a-d6a5225a26a4/content" width="16" height="16"/></a><br><a href="https://repository.kaust.edu.sa/search?query=orcid.id:0000-0003-4778-3615&spc.sf=dc.date.issued&spc.sd=DESC">Giovannitti, Alexander</a> <a href="https://orcid.org/0000-0003-4778-3615" target="_blank"><img src="https://repository.kaust.edu.sa/server/api/core/bitstreams/82a625b4-ed4b-40c8-865a-d6a5225a26a4/content" width="16" height="16"/></a><br><a href="https://repository.kaust.edu.sa/search?query=orcid.id:0000-0002-7932-0677&spc.sf=dc.date.issued&spc.sd=DESC">Torricelli, Fabrizio</a> <a href="https://orcid.org/0000-0002-7932-0677" target="_blank"><img src="https://repository.kaust.edu.sa/server/api/core/bitstreams/82a625b4-ed4b-40c8-865a-d6a5225a26a4/content" width="16" height="16"/></a><br><a href="https://repository.kaust.edu.sa/search?query=orcid.id:0000-0002-6340-7217&spc.sf=dc.date.issued&spc.sd=DESC">McCulloch, Iain</a> <a href="https://orcid.org/0000-0002-6340-7217" target="_blank"><img src="https://repository.kaust.edu.sa/server/api/core/bitstreams/82a625b4-ed4b-40c8-865a-d6a5225a26a4/content" width="16" height="16"/></a><br><a href="https://repository.kaust.edu.sa/search?query=orcid.id:0000-0002-6474-9497&spc.sf=dc.date.issued&spc.sd=DESC">Blom, Paul W. M.</a> <a href="https://orcid.org/0000-0002-6474-9497" target="_blank"><img src="https://repository.kaust.edu.sa/server/api/core/bitstreams/82a625b4-ed4b-40c8-865a-d6a5225a26a4/content" width="16" height="16"/></a><br><a href="https://repository.kaust.edu.sa/search?query=orcid.id:0000-0002-7448-9123&spc.sf=dc.date.issued&spc.sd=DESC">Salleo, Alberto</a> <a href="https://orcid.org/0000-0002-7448-9123" target="_blank"><img src="https://repository.kaust.edu.sa/server/api/core/bitstreams/82a625b4-ed4b-40c8-865a-d6a5225a26a4/content" width="16" height="16"/></a><br><a href="https://repository.kaust.edu.sa/search?query=orcid.id:0000-0003-3472-0148&spc.sf=dc.date.issued&spc.sd=DESC">van de Burgt, Yoeri</a> <a href="https://orcid.org/0000-0003-3472-0148" target="_blank"><img src="https://repository.kaust.edu.sa/server/api/core/bitstreams/82a625b4-ed4b-40c8-865a-d6a5225a26a4/content" width="16" height="16"/></a><br><a href="https://repository.kaust.edu.sa/search?query=orcid.id:0000-0002-0139-0851&spc.sf=dc.date.issued&spc.sd=DESC">Gkoupidenis, Paschalis</a> <a href="https://orcid.org/0000-0002-0139-0851" target="_blank"><img src="https://repository.kaust.edu.sa/server/api/core/bitstreams/82a625b4-ed4b-40c8-865a-d6a5225a26a4/content" width="16" height="16"/></a><br><br><h5>KAUST Department</h5><a href="https://repository.kaust.edu.sa/search?spc.sf=dc.date.issued&spc.sd=DESC&f.department=KAUST Solar Center (KSC),equals">KAUST Solar Center (KSC)</a><br><a href="https://repository.kaust.edu.sa/search?spc.sf=dc.date.issued&spc.sd=DESC&f.department=Chemical Science Program,equals">Chemical Science Program</a><br><br><h5>Date</h5>2021-12-10</span>
display.details.right<span><h5>Abstract</h5>In living organisms, sensory and motor processes are distributed, locally merged, and capable of forming dynamic sensorimotor associations. We introduce a simple and efficient organic neuromorphic circuit for local sensorimo-tor merging and processing on a robot that is placed in a maze. While the robot is exposed to external environ-mental stimuli, visuomotor associations are formed on the adaptable neuromorphic circuit. With this on-chip sensorimotor integration, the robot learns to follow a path to the exit of a maze, while being guided by visually indicated paths. The ease of processability of organic neuromorphic electronics and their unconventional form factors, in combination with education-purpose robotics, showcase a promising approach of an affordable, versatile, and readily accessible platform for exploring, designing, and evaluating behavioral intelligence through decen-tralized sensorimotor integration.<br><br><h5>Citation</h5>Krauhausen, I., Koutsouras, D. A., Melianas, A., Keene, S. T., Lieberth, K., Ledanseur, H., … Gkoupidenis, P. (2021). Organic neuromorphic electronics for sensorimotor integration and learning in robotics. Science Advances, 7(50). doi:10.1126/sciadv.abl5068<br><br><h5>Acknowledgements</h5>We acknowledge F. Keller, A. Steinmetz, and A. Becker from the Max Planck Institute for Polymer Research (MPIP) for significant contribution in the design and realization of the experimental setup (maze, 3D-printed parts, and video recording) and electronics (customization of the robot and additional hardware for conditioning). We also acknowledge H.-J. Guttmann and C. Bauer for assistance in the clean room facilities of MPIP. We also acknowledge G. Malliaras for relevant preliminary discussions and B. Meijer for support<br>Funding Facilities of MPIP (clean room, device metrology, electronics, and mechanical workshop) are supported by the Max Planck Society (to P.W.M.B. and P.G.). nano@Stanford laboratories are supported by the National Science Foundation as part of the National Nanotechnology Coordinated Infrastructure under award ECCS-1542152 (to A.S.). This study is funded by a joint project between MPIP and the Institute for Complex Molecular Systems (ICMS), Eindhoven University of Technology, grant no. MPIPICMS2019001 (to Y.v.d.B., I.K., and P.G.); European Union’s Horizon 2020 Research and Innovation Programme, grant agreement no. 802615 (to Y.v.d.B.); the Carl-Zeiss Foundation (to P.G.); National Science Foundation and the Semiconductor Research Corporation, E2CDA award no. 1739795 (to A.S. and S.T.K.); and Stanford Graduate Fellowship fund (to S.T.K.)<br><br><h5>Publisher</h5><a href="https://repository.kaust.edu.sa/search?spc.sf=dc.date.issued&spc.sd=DESC&f.publisher=American Association for the Advancement of Science (AAAS),equals">American Association for the Advancement of Science (AAAS)</a><br><br><h5>Journal</h5><a href="https://repository.kaust.edu.sa/search?spc.sf=dc.date.issued&spc.sd=DESC&f.journal=Science Advances,equals">Science Advances</a><br><br><h5>DOI</h5><a href="https://doi.org/10.1126/sciadv.abl5068">10.1126/sciadv.abl5068</a><br><br><h5>Additional Links</h5>https://www.science.org/doi/10.1126/sciadv.abl5068</span>
kaust.personSheelamanthula, Rajendar
kaust.personMcCulloch, Iain
orcid.authorKrauhausen, Imke::0000-0001-5633-389X
orcid.authorKoutsouras, Dimitrios A.::0000-0002-9456-9630
orcid.authorMelianas, Armantas::0000-0002-3443-0987
orcid.authorKeene, S. T.::0000-0002-6635-670X
orcid.authorLieberth, Katharina::0000-0001-6160-7162
orcid.authorLedanseur, Hadrien
orcid.authorSheelamanthula, Rajendar::0000-0001-5223-9580
orcid.authorGiovannitti, Alexander::0000-0003-4778-3615
orcid.authorTorricelli, Fabrizio::0000-0002-7932-0677
orcid.authorMcCulloch, Iain::0000-0002-6340-7217
orcid.authorBlom, Paul W. M.::0000-0002-6474-9497
orcid.authorSalleo, Alberto::0000-0002-7448-9123
orcid.authorvan de Burgt, Yoeri::0000-0003-3472-0148
orcid.authorGkoupidenis, Paschalis::0000-0002-0139-0851
orcid.id0000-0002-0139-0851
orcid.id0000-0003-3472-0148
orcid.id0000-0002-7448-9123
orcid.id0000-0002-6474-9497
orcid.id0000-0002-6340-7217
orcid.id0000-0002-7932-0677
orcid.id0000-0003-4778-3615
orcid.id0000-0001-5223-9580
orcid.id0000-0001-6160-7162
orcid.id0000-0002-6635-670X
orcid.id0000-0002-3443-0987
orcid.id0000-0002-9456-9630
orcid.id0000-0001-5633-389X
refterms.dateFOA2021-12-12T11:40:47Z
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
sciadv.abl5068.pdf
Size:
2.15 MB
Format:
Adobe Portable Document Format
Description:
Publisher's Version/PDF