Handle URI:
http://hdl.handle.net/10754/599883
Title:
The cat is out of the bag
Authors:
Ananthanarayanan, Rajagopal; Esser, Steven K.; Simon, Horst D.; Modha, Dharmendra S.
Abstract:
In the quest for cognitive computing, we have built a massively parallel cortical simulator, C2, that incorporates a number of innovations in computation, memory, and communication. Using C2 on LLNL's Dawn Blue Gene/P supercomputer with 147, 456 CPUs and 144 TB of main memory, we report two cortical simulations - at unprecedented scale - that effectively saturate the entire memory capacity and refresh it at least every simulated second. The first simulation consists of 1.6 billion neurons and 8.87 trillion synapses with experimentally-measured gray matter thalamocortical connectivity. The second simulation has 900 million neurons and 9 trillion synapses with probabilistic connectivity. We demonstrate nearly perfect weak scaling and attractive strong scaling. The simulations, which incorporate phenomenological spiking neurons, individual learning synapses, axonal delays, and dynamic synaptic channels, exceed the scale of the cat cortex, marking the dawn of a new era in the scale of cortical simulations. Copyright 2009 ACM.
Citation:
Ananthanarayanan R, Esser SK, Simon HD, Modha DS (2009) The cat is out of the bag. Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis - SC ’09. Available: http://dx.doi.org/10.1145/1654059.1654124.
Publisher:
Association for Computing Machinery (ACM)
Journal:
Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis - SC '09
Issue Date:
2009
DOI:
10.1145/1654059.1654124
Type:
Conference Paper
Sponsors:
The research reported in this paper was sponsored by Defense Ad-vanced Research Projects Agency, Defense Sciences O±ce (DSO),Program: Systems of Neuromorphic Adaptive Plastic ScalableElectronics (SyNAPSE), Issued by DARPA CMO under ContractNo. HR0011 ¡ 09 ¡ C ¡ 0002. The views and conclusions con-tained in this document are those of the authors and should notbe interpreted as representing the o±cial policies, either expresslyor implied, of the Defense Advanced Research Projects Agencyor the U.S. Government.This work was supported in part by the Director, O±ce of Science,of the U.S. Department of Energy under Contract No. DE-AC02-05CH11231.We would like to thank Dave Fox and Steve Louis for Dawn tech-nical support at Lawrence Livermore National Laboratory, andMichel McCoy and the DOE NNSA Advanced Simulation andComputing Program for time on Dawn. Lawrence Livermore Na-tional Laboratory is operated by Lawrence Livermore NationalSecurity, LLC, for the U.S. Department of Energy, National Nu-clear Security Administration under Contract DE-AC52¡07NA27344.This research used resources of the IBM-KAUST WatsonShaheenBG/P system. We are indebted to Fred Mintzer and Dave Singerfor their help.We are thankful to Raghav Singh and Shyamal Chandra for theircollaboration on BrainCam. We are grateful to Tom Binzegger,Rodney J. Douglas, and Kevan A. C. Martin for sharing thalamo-cortical connectivity data. Mouse, Rat, Cat, and Human photos:°c iStockphoto.com / Emilia Stasiak, Fabian Guignard, VasiliyYakobchuk, Ina Peters.
Appears in Collections:
Publications Acknowledging KAUST Support

Full metadata record

DC FieldValue Language
dc.contributor.authorAnanthanarayanan, Rajagopalen
dc.contributor.authorEsser, Steven K.en
dc.contributor.authorSimon, Horst D.en
dc.contributor.authorModha, Dharmendra S.en
dc.date.accessioned2016-02-28T06:31:38Zen
dc.date.available2016-02-28T06:31:38Zen
dc.date.issued2009en
dc.identifier.citationAnanthanarayanan R, Esser SK, Simon HD, Modha DS (2009) The cat is out of the bag. Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis - SC ’09. Available: http://dx.doi.org/10.1145/1654059.1654124.en
dc.identifier.doi10.1145/1654059.1654124en
dc.identifier.urihttp://hdl.handle.net/10754/599883en
dc.description.abstractIn the quest for cognitive computing, we have built a massively parallel cortical simulator, C2, that incorporates a number of innovations in computation, memory, and communication. Using C2 on LLNL's Dawn Blue Gene/P supercomputer with 147, 456 CPUs and 144 TB of main memory, we report two cortical simulations - at unprecedented scale - that effectively saturate the entire memory capacity and refresh it at least every simulated second. The first simulation consists of 1.6 billion neurons and 8.87 trillion synapses with experimentally-measured gray matter thalamocortical connectivity. The second simulation has 900 million neurons and 9 trillion synapses with probabilistic connectivity. We demonstrate nearly perfect weak scaling and attractive strong scaling. The simulations, which incorporate phenomenological spiking neurons, individual learning synapses, axonal delays, and dynamic synaptic channels, exceed the scale of the cat cortex, marking the dawn of a new era in the scale of cortical simulations. Copyright 2009 ACM.en
dc.description.sponsorshipThe research reported in this paper was sponsored by Defense Ad-vanced Research Projects Agency, Defense Sciences O±ce (DSO),Program: Systems of Neuromorphic Adaptive Plastic ScalableElectronics (SyNAPSE), Issued by DARPA CMO under ContractNo. HR0011 ¡ 09 ¡ C ¡ 0002. The views and conclusions con-tained in this document are those of the authors and should notbe interpreted as representing the o±cial policies, either expresslyor implied, of the Defense Advanced Research Projects Agencyor the U.S. Government.This work was supported in part by the Director, O±ce of Science,of the U.S. Department of Energy under Contract No. DE-AC02-05CH11231.We would like to thank Dave Fox and Steve Louis for Dawn tech-nical support at Lawrence Livermore National Laboratory, andMichel McCoy and the DOE NNSA Advanced Simulation andComputing Program for time on Dawn. Lawrence Livermore Na-tional Laboratory is operated by Lawrence Livermore NationalSecurity, LLC, for the U.S. Department of Energy, National Nu-clear Security Administration under Contract DE-AC52¡07NA27344.This research used resources of the IBM-KAUST WatsonShaheenBG/P system. We are indebted to Fred Mintzer and Dave Singerfor their help.We are thankful to Raghav Singh and Shyamal Chandra for theircollaboration on BrainCam. We are grateful to Tom Binzegger,Rodney J. Douglas, and Kevan A. C. Martin for sharing thalamo-cortical connectivity data. Mouse, Rat, Cat, and Human photos:°c iStockphoto.com / Emilia Stasiak, Fabian Guignard, VasiliyYakobchuk, Ina Peters.en
dc.publisherAssociation for Computing Machinery (ACM)en
dc.titleThe cat is out of the bagen
dc.typeConference Paperen
dc.identifier.journalProceedings of the Conference on High Performance Computing Networking, Storage and Analysis - SC '09en
dc.contributor.institutionIBM Almaden Research Center, San Jose, United Statesen
dc.contributor.institutionLawrence Berkeley National Laboratory, Berkeley, United Statesen
All Items in KAUST are protected by copyright, with all rights reserved, unless otherwise indicated.