Answers.Body: <p><strong><em>tl;dr</em>–</strong> Yes, we can give machines IQ-tests.  And we basically already do, just often skipping the last step of explicitly recognizing an IQ-score.</p>
  <hr />
  <h3>IQ-scores can be assigned based on relative performance on some intelligence-test.</h3>
  <p>Sure, we can give machines IQ-tests.</p>
  <p>To be clear, IQ tests are basically just:</p>
  <ol>
  <li><p>Create a test that assigns higher scores to test-takers with higher intelligence.</p>
  <ul>
  <li>For example, if you're primary interested in &quot;<em>intelligence</em>&quot; as in &quot;<em>ability to solve crossword-puzzles quickly</em>&quot;, then you can give a test with a bunch of crossword-puzzles, then score test-takers based on stuff like how quickly and completely they do the crossword-puzzles.</li>
  </ul>
  </li>
  <li><p>Test a bunch of intelligences and score their exams.</p>
  </li>
  <li><p>Rank the test-takers from lowest-to-highest.</p>
  </li>
  <li><p>Assign each test-taker a percentile-ranking.</p>
  <ul>
  <li>For example, if a test-taker got a median score, then their percentile-ranking would be 50%.</li>
  </ul>
  </li>
  <li><p>Calculate IQ by casting the percentile-rankings to a normal-curve with a median of 100 and a standard-deviation of 15.</p>
  <ul>
  <li><p>Equation's <span class="math-container">$\text{IQ} = \sqrt{2} \operatorname{erf}^{-1}{\left(2p - 1\right)} ~~ p \in \left(0, 1\right) \, ,$</span> where <span class="math-container">$p$</span> is the percentile-rank (e.g., <span class="math-container">$p=0.5$</span> for a median-percentile of 50%).</p>
  </li>
  <li><p>On WolframAlpha: <a href="https://www.wolframalpha.com/input?i=100+%2B+15+*+sqrt%282%29+*+erf%5E%28-1%29+%282+*+0.5+-+1%29" rel="nofollow noreferrer"><span class="math-container">$\texttt{100 + 15 * sqrt(2) * erf^(-1) (2 *}\underbrace{\texttt{ 0.5 }}_{p}\texttt{- 1)}$</span></a>.</p>
  </li>
  <li><p>On Microsoft-Excel: <span class="math-container">$\texttt{=100+15*NORM.S.INV(}\underbrace{\texttt{0.5}}_{p}\texttt{)} \,.$</span></p>
  </li>
  </ul>
  </li>
  </ol>
  <p>Folks basically already do this with various AI-models, e.g. when ranking their relative performance on a series of tasks, just don't normally do Steps 4 or 5.</p>
  <hr />
  <h3>How to compare human-IQ's with machine-IQ's?</h3>
  <p>Basically just give both humans and machines the same test and rank them, then calculate.  That's it.</p>
  <p>The main thing would be picking a test that'd test for some notion of &quot;<em>intelligence</em>&quot; that you'd be interested in.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-04-02T09:13:20.580Z
Answers.LastActivityDate: 2023-04-02T09:13:20.580Z
Answers.UserDisplayName: Nat
Body: <p>In the age of artificial intelligence, super-intelligent machines like GPT have become a reality, leading to the question of how to quantify or measure their intelligence. While IQ tests are widely used to measure human intelligence, could a similar approach be used to assess the intelligence of machines? Is it possible to compare the intelligence of a machine to that of a human in this context, given that machines possess certain cognitive abilities and limitations that differ from those of humans? Additionally, what are some alternative methods for evaluating machine intelligence, and how do they differ from traditional IQ tests used for humans? Finally, what implications might arise from the development of super-intelligent machines, both in terms of how we measure and compare intelligence and in terms of their impact on society as a whole?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2023-04-01T14:01:12.867Z
Comments.Text: @user253751: For me, your comment would also work as an answer.
Comments.UserDisplayName: Broele
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2023-04-02T02:23:15.620Z
Comments.Text: @user253751 Your comment addresses both of my questions.
Comments.UserDisplayName: R1-
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2023-04-02T08:58:46.973Z
Comments.Text: I see four or three questions, if the first and the second are merged: IQ for machines, alternative methods and social implications of super-intelligence. Is that broad scope the reason for the close vote?
Comments.UserDisplayName: Jaume Oliver Lafont
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2023-04-03T13:18:13.590Z
Comments.Text: In which sense is ChatGPT super-intelligent? If counting the letters in a sentence is a necessary condition for intelligence, then ChatGPT is stupid. ChatGPT is just a stochastic parrot. If you consider that intelligent, ok, but well good luck with your use of it...
Comments.UserDisplayName: nbro
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2023-04-12T21:27:34.920Z
Comments.Text: @nbro you are not fighting me, rather than you fighting yourself, I have a feeling by saying "super-intelligent" is like the old days when Galileo Galilei told that the Earth is not flat. the downvotes have no effect on the question, even voting to close the question is not important, me asking the question is out of curiosity after watching some interviews of Lex Fridman with some guests that the talk was all about GPT4, such as Sam Altman, Ilya Sutskever and Edward Frenkel. I believe you are making the AI.SE worthless with such reactions, we will find out soon whether GPT4 is stupid or not.
Comments.UserDisplayName: R1-
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2023-04-29T19:56:07.197Z
Comments.Text: At present, ChatGPT can only accept text input.  IQ tests involve a lot of images, so that would seem to rule out IQ tests for the time being.
Comments.UserDisplayName: Dennis H
Tags: <open-ai><gpt><large-language-models><intelligence-quotient>
Title: Could it be probable to quantify or measure the IQ of a super-intelligent machine like GPT?
UserDisplayName: R1-
ThreadText: # Could it be probable to quantify or measure the IQ of a super-intelligent machine like GPT?
  
  (Asked by: username_0 on 2023-03-31)
  
  In the age of artificial intelligence, super-intelligent machines like GPT have become a reality, leading to the question of how to quantify or measure their intelligence. While IQ tests are widely used to measure human intelligence, could a similar approach be used to assess the intelligence of machines? Is it possible to compare the intelligence of a machine to that of a human in this context, given that machines possess certain cognitive abilities and limitations that differ from those of humans? Additionally, what are some alternative methods for evaluating machine intelligence, and how do they differ from traditional IQ tests used for humans? Finally, what implications might arise from the development of super-intelligent machines, both in terms of how we measure and compare intelligence and in terms of their impact on society as a whole?
  
  **Tags:** open-ai, gpt, large-language-models, intelligence-quotient
  
  > **Comments:**
  > **username_1**: @user253751: For me, your comment would also work as an answer.  
  > **username_0**: @user253751 Your comment addresses both of my questions.  
  > **username_2**: I see four or three questions, if the first and the second are merged: IQ for machines, alternative methods and social implications of super-intelligence. Is that broad scope the reason for the close vote?  
  > **username_3**: In which sense is ChatGPT super-intelligent? If counting the letters in a sentence is a necessary condition for intelligence, then ChatGPT is stupid. ChatGPT is just a stochastic parrot. If you consider that intelligent, ok, but well good luck with your use of it...  
  > **username_0**: @username_3 you are not fighting me, rather than you fighting yourself, I have a feeling by saying "super-intelligent" is like the old days when Galileo Galilei told that the Earth is not flat. the downvotes have no effect on the question, even voting to close the question is not important, me asking the question is out of curiosity after watching some interviews of Lex Fridman with some guests that the talk was all about GPT4, such as Sam Altman, Ilya Sutskever and Edward Frenkel. I believe you are making the AI.SE worthless with such reactions, we will find out soon whether GPT4 is stupid or not.  
  > **username_4**: At present, ChatGPT can only accept text input.  IQ tests involve a lot of images, so that would seem to rule out IQ tests for the time being.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_5 on 2023-04-02. Score: 1 | Accepted answer
  
  ***tl;dr*–** Yes, we can give machines IQ-tests. And we basically already do, just often skipping the last step of explicitly recognizing an IQ-score.
  
  ---
  
  ### IQ-scores can be assigned based on relative performance on some intelligence-test.
  
  Sure, we can give machines IQ-tests.
  
  To be clear, IQ tests are basically just:
  
  1. Create a test that assigns higher scores to test-takers with higher intelligence.
  
     * For example, if you're primary interested in "*intelligence*" as in "*ability to solve crossword-puzzles quickly*", then you can give a test with a bunch of crossword-puzzles, then score test-takers based on stuff like how quickly and completely they do the crossword-puzzles.
  2. Test a bunch of intelligences and score their exams.
  3. Rank the test-takers from lowest-to-highest.
  4. Assign each test-taker a percentile-ranking.
  
     * For example, if a test-taker got a median score, then their percentile-ranking would be 50%.
  5. Calculate IQ by casting the percentile-rankings to a normal-curve with a median of 100 and a standard-deviation of 15.
  
     * Equation's $\text{IQ} = \sqrt{2} \operatorname{erf}^{-1}{\left(2p - 1\right)} ~~ p \in \left(0, 1\right) \, ,$ where $p$ is the percentile-rank (e.g., $p=0.5$ for a median-percentile of 50%).
     * On WolframAlpha: [$\texttt{100 + 15 \* sqrt(2) \* erf^(-1) (2 \*}\underbrace{\texttt{ 0.5 }}\_{p}\texttt{- 1)}$](https://www.wolframalpha.com/input?i=100+%2B+15+*+sqrt%282%29+*+erf%5E%28-1%29+%282+*+0.5+-+1%29).
     * On Microsoft-Excel: $\texttt{=100+15\*NORM.S.INV(}\underbrace{\texttt{0.5}}\_{p}\texttt{)} \,.$
  
  Folks basically already do this with various AI-models, e.g. when ranking their relative performance on a series of tasks, just don't normally do Steps 4 or 5.
  
  ---
  
  ### How to compare human-IQ's with machine-IQ's?
  
  Basically just give both humans and machines the same test and rank them, then calculate. That's it.
  
  The main thing would be picking a test that'd test for some notion of "*intelligence*" that you'd be interested in.
  
  
  ---
  
  