Answers.Body: <p>The human brain contains about 100 billion neurons (<span class="math-container">$10^{11}$</span>) and about a hundred trillion synapses (<span class="math-container">$10^{14}$</span>). Each neuron can fire about 100 times a second. If we model the brain as a simple neural network, then it would be equivalent to a machine that requires 1016 calculations per second and 1013 bits of memory.</p>
  <p>From <a href="https://en.wikipedia.org/wiki/The_Singularity_Is_Near#The_brain" rel="nofollow noreferrer">Wikipedia</a></p>
  <blockquote>
  <p>Kurzweil introduces the idea of &quot;uploading&quot; a specific brain with every mental process intact, to be instantiated on a &quot;suitably powerful computational substrate&quot;. He writes that general modeling requires 1016 calculations per second and 1013 bits of memory, but then explains uploading requires additional detail, perhaps as many as 1019 cps and 1018 bits. Kurzweil says the technology to do this will be available by 2040.</p>
  </blockquote>
  <p>According to this site <a href="http://www.extremetech.com/extreme/163051-simulating-1-second-of-human-brain-activity-takes-82944-processors" rel="nofollow noreferrer">here</a>:</p>
  <blockquote>
  <p>Using the NEST software framework, the team led by Markus Diesmann and Abigail Morrison succeeded in creating an artificial neural network of 1.73 billion nerve cells connected by 10.4 trillion synapses. While impressive, this is only a fraction of the neurons every human brain contains. Scientists believe we all carry 80-100 billion nerve cells</p>
  <p>It took 40 minutes with the combined muscle of 82,944 processors in K computer to get just 1 second of biological brain processing time. While running, the simulation ate up about 1PB of system memory as each synapse was modeled individually.</p>
  </blockquote>
  <p>Computing power will continue to ramp up while transistors scale down, which could make true neural simulations possible in real-time with supercomputers.</p>
  <p><a href="https://en.wikipedia.org/wiki/SpiNNaker" rel="nofollow noreferrer">SpiNNaker</a> is a manycore computer architecture designed to <a href="https://en.wikipedia.org/wiki/Human_Brain_Project" rel="nofollow noreferrer">simulate the human brain</a>. It is planned to use 1 million ARM processors (currently .5 million). The completed design will hold 100,000 cores</p>
  <p>In this <a href="https://www.youtube.com/watch?v=2e06C-yUwlc" rel="nofollow noreferrer">video</a>, they showed a completed rack with 100,000 cores emulating 25 million neurons (at <span class="math-container">$\frac{1}{4}$</span> the efficiency—it will eventually run 1,000 neurons per core).</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2024-11-01T18:39:05.333Z
Answers.Text: "1013 bits of memory"? How did you arrive at that?
Answers.UserDisplayName: Geremia
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-04T17:59:10.237Z
Answers.Text: This concept is a bit brute-force... I'm a bioneurocybernetics specialist and I can tell you the thing that the classical - in terms of general IT - simulation or emulation of brain is **impossible** due to the structure of brain-body "interfaces".
Answers.UserDisplayName: Alexey Vesnin
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-04T18:04:47.793Z
Answers.Text: Ik even the SpiNNaker the final design would only be able to simulate just 1% of the brain (also we still need to understand a lot about human brain)
Answers.UserDisplayName: Vishnu JK
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2016-08-04T17:15:56.423Z
Answers.LastActivityDate: 2021-01-26T01:55:25.793Z
Answers.LastEditDate: 2021-01-26T01:55:25.793Z
Answers.UserDisplayName: Vishnu JK
Answers.Body: <p>Not just how much, but what kind of processing power : there're specially-crafted <a href="http://www.research.ibm.com/cognitive-computing/neurosynaptic-chips.shtml#fbid=V01grppeOIs" rel="nofollow">dedicated chips</a>, and it has a <a href="http://www.dailymail.co.uk/sciencetech/article-3516047/IBM-reveals-brain-supercomputer-neurosynaptic-chip-replicate-16-million-neurons-work-using-hearing-aid-battery.html" rel="nofollow">practical applications</a>, so it's not a lab-only project</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-04T14:36:01.980Z
Answers.LastActivityDate: 2016-08-04T14:36:01.980Z
Answers.UserDisplayName: Alexey Vesnin
Answers.Body: <p>H+ magazine wrote an estimate <a href="http://hplusmagazine.com/2009/04/07/brain-chip/" rel="noreferrer">in 2009</a> that seems broadly comparable to other things I've seen; they think the human brain is approximately 37 petaflops. A supercomputer larger than that 37 petaflop estimate <a href="https://en.wikipedia.org/wiki/Sunway_TaihuLight" rel="noreferrer">exists today</a>.</p>
  
  <p>But emulation is hard. See <a href="https://stackoverflow.com/questions/471973/what-makes-building-game-console-emulators-so-hard">this SO question about hardware emulation</a> or <a href="http://www.tested.com/tech/gaming/2712-why-perfect-hardware-snes-emulation-requires-a-3ghz-cpu/" rel="noreferrer">this article</a> on emulating the SNES, in which they require <strong>140 times</strong> the processing power of the SNES chip to get it right. <a href="http://gizmodo.com/an-83-000-processor-supercomputer-only-matched-one-perc-1045026757" rel="noreferrer">This 2013 article</a> claims that a second of human brain activity took 40 minutes to emulate on a 10 petaflop computer (a <em>2400-times</em> slowdown, not the 4-times slowdown one might naively expect).</p>
  
  <p>And all this assumes that neurons are relatively simple objects! It could be that the amount of math we have to do to model a single neuron is actually much more than the flops estimate above. Or it could be the case that dramatic simplifications can be made, and if we knew what the brain was actually trying to accomplish we could do it much more cleanly and simply. (One advantage that ANNs have, for example, is that they are doing computations with much more precision than we expect biological neurons to have. But this means emulation is <em>harder</em>, not easier, while replacement <em>is</em> easier.)</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-04T14:35:16.053Z
Answers.LastActivityDate: 2016-08-04T14:35:16.053Z
Answers.LastEditDate: 2017-05-23T12:39:33.010Z
Answers.UserDisplayName: Matthew Gray
Body: <p>How much processing power is needed to emulate the human brain? More specifically, the neural simulation, such as communication between the neurons and processing certain data in real-time.</p>
  <p>I understand that this may be a bit of speculation and it's not possible to be accurate, but I'm sure there is some data available or research studies that attempted to estimate it based on our current understanding of the human brain.</p>
  
Tags: <hardware><neuromorphic-engineering><neuroscience><brain>
Title: How powerful a computer is required to simulate the human brain?
UserDisplayName: kenorb
ThreadText: # How powerful a computer is required to simulate the human brain?
  
  (Asked by: username_0 on 2016-08-04)
  
  How much processing power is needed to emulate the human brain? More specifically, the neural simulation, such as communication between the neurons and processing certain data in real-time.
  
  I understand that this may be a bit of speculation and it's not possible to be accurate, but I'm sure there is some data available or research studies that attempted to estimate it based on our current understanding of the human brain.
  
  **Tags:** hardware, neuromorphic-engineering, neuroscience, brain
  
  ---
  
  ## 3 answers
  
  ### Answer by username_4 on 2016-08-04. Score: 11 | Accepted answer
  
  H+ magazine wrote an estimate [in 2009](http://hplusmagazine.com/2009/04/07/brain-chip/) that seems broadly comparable to other things I've seen; they think the human brain is approximately 37 petaflops. A supercomputer larger than that 37 petaflop estimate [exists today](https://en.wikipedia.org/wiki/Sunway_TaihuLight).
  
  But emulation is hard. See [this SO question about hardware emulation](https://stackoverflow.com/questions/471973/what-makes-building-game-console-emulators-so-hard) or [this article](http://www.tested.com/tech/gaming/2712-why-perfect-hardware-snes-emulation-requires-a-3ghz-cpu/) on emulating the SNES, in which they require **140 times** the processing power of the SNES chip to get it right. [This 2013 article](http://gizmodo.com/an-83-000-processor-supercomputer-only-matched-one-perc-1045026757) claims that a second of human brain activity took 40 minutes to emulate on a 10 petaflop computer (a *2400-times* slowdown, not the 4-times slowdown one might naively expect).
  
  And all this assumes that neurons are relatively simple objects! It could be that the amount of math we have to do to model a single neuron is actually much more than the flops estimate above. Or it could be the case that dramatic simplifications can be made, and if we knew what the brain was actually trying to accomplish we could do it much more cleanly and simply. (One advantage that ANNs have, for example, is that they are doing computations with much more precision than we expect biological neurons to have. But this means emulation is *harder*, not easier, while replacement *is* easier.)
  
  
  ---
  
  ### Answer by username_1 on 2016-08-04. Score: 6
  
  The human brain contains about 100 billion neurons ($10^{11}$) and about a hundred trillion synapses ($10^{14}$). Each neuron can fire about 100 times a second. If we model the brain as a simple neural network, then it would be equivalent to a machine that requires 1016 calculations per second and 1013 bits of memory.
  
  From [Wikipedia](https://en.wikipedia.org/wiki/The_Singularity_Is_Near#The_brain)
  
  > Kurzweil introduces the idea of "uploading" a specific brain with every mental process intact, to be instantiated on a "suitably powerful computational substrate". He writes that general modeling requires 1016 calculations per second and 1013 bits of memory, but then explains uploading requires additional detail, perhaps as many as 1019 cps and 1018 bits. Kurzweil says the technology to do this will be available by 2040.
  
  According to this site [here](http://www.extremetech.com/extreme/163051-simulating-1-second-of-human-brain-activity-takes-82944-processors):
  
  > Using the NEST software framework, the team led by Markus Diesmann and Abigail Morrison succeeded in creating an artificial neural network of 1.73 billion nerve cells connected by 10.4 trillion synapses. While impressive, this is only a fraction of the neurons every human brain contains. Scientists believe we all carry 80-100 billion nerve cells
  >
  > It took 40 minutes with the combined muscle of 82,944 processors in K computer to get just 1 second of biological brain processing time. While running, the simulation ate up about 1PB of system memory as each synapse was modeled individually.
  
  Computing power will continue to ramp up while transistors scale down, which could make true neural simulations possible in real-time with supercomputers.
  
  [SpiNNaker](https://en.wikipedia.org/wiki/SpiNNaker) is a manycore computer architecture designed to [simulate the human brain](https://en.wikipedia.org/wiki/Human_Brain_Project). It is planned to use 1 million ARM processors (currently .5 million). The completed design will hold 100,000 cores
  
  In this [video](https://www.youtube.com/watch?v=2e06C-yUwlc), they showed a completed rack with 100,000 cores emulating 25 million neurons (at $\frac{1}{4}$ the efficiency—it will eventually run 1,000 neurons per core).
  
  > **Comments:**
  > **username_3**: This concept is a bit brute-force... I'm a bioneurocybernetics specialist and I can tell you the thing that the classical - in terms of general IT - simulation or emulation of brain is **impossible** due to the structure of brain-body "interfaces".  
  > **username_1**: Ik even the SpiNNaker the final design would only be able to simulate just 1% of the brain (also we still need to understand a lot about human brain)  
  > **username_2**: "1013 bits of memory"? How did you arrive at that?  
  
  ---
  
  ### Answer by username_3 on 2016-08-04. Score: 2
  
  Not just how much, but what kind of processing power : there're specially-crafted [dedicated chips](http://www.research.ibm.com/cognitive-computing/neurosynaptic-chips.shtml#fbid=V01grppeOIs), and it has a [practical applications](http://www.dailymail.co.uk/sciencetech/article-3516047/IBM-reveals-brain-supercomputer-neurosynaptic-chip-replicate-16-million-neurons-work-using-hearing-aid-battery.html), so it's not a lab-only project
  
  
  ---
  
  