Answers.Body: <p>A method that could possibly work is utilising optical illusions such as one where two lines down a hallway are identical but one seems longer to the human eye, then they could be prompted with a multiple choice question as to the state of the line, which to our eyes looks longer, but to a computer, is still the same length of line. Of course, there is always the issue of people with eye based disabilities not being able to complete them, but different illusions could be used to accommodate that.</p>
  
  <p><a href="https://www.brainbashers.com/showillusion.asp?85" rel="nofollow">Example</a></p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-10-09T19:46:45.827Z
Answers.LastActivityDate: 2016-10-10T06:19:57.007Z
Answers.LastEditDate: 2016-10-10T06:19:57.007Z
Answers.UserDisplayName: sgtdragonfire
Answers.Body: <p><strong>Have the user label highlighted objects in video that a state of the art classifier cannot solve</strong></p>
  
  <p>Create a state of the art video classifier. Might as well train it on Google's <a href="https://research.googleblog.com/2016/09/announcing-youtube-8m-large-and-diverse.html" rel="nofollow">YouTube-8M</a> video training data. But you will want to continually feed it original video as well.</p>
  
  <p>Have the classifier label as many objects as it can. Have it isolate which objects it can recognize as objects but which it is unable to label.</p>
  
  <p>Have it output videos that outlines the objects. Preferably GIFs, which can be easily embedded in forms.</p>
  
  <p>For 100 of these, ask 100 users what the object is. If 90% of the users agree on the name of an object, add that video to the captcha-set. Call this the pre-trained set.</p>
  
  <p>Every time a user needs to authenticate, show them one of the highlighted objects in a video <em>not from the pre-trained set</em>. If the image has less than 100 showings, record the label and give the user another one from the pre-trained set. If they get it right, let them through, if not, give them another from the pretrained set.</p>
  
  <p>Once the non-pre-trained video has more than 100 showings and more than 90% of the captcha-users agree, add that video to the post-trained set.</p>
  
  <p>Over time, slowly remove the pre-trained set. Put expirations on each video in the post-trained set and remove them after expiration, so that they don't get used too many times.</p>
  
  <p>Ideally, this process would constantly improve the video classifier, keeping it state of the art and slightly ahead of other classifiers. Perhaps it could also favor less common words and objects and more esoteric things, so as to specialize this classifier against other classifiers.</p>
  
  <p>The same could be done for image labeling, but the utility of the video classifier will probably last longer, given advances in AI.</p>
  
  <p>Strictly speaking, though, short of some quantum trickery, there is no captcha system that will not one day be solved by external AI systems.</p>
  
  <p>(edit: oh, I just noticed you specifically said "textual captcha." If that's what you mean, then no I don't think text classification has much mystery left in it. Computers can probably glean text from pictures better than humans now. But techically, the <em>input</em> in the above described captcha system is textual.) </p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-10-07T23:29:59.280Z
Answers.LastActivityDate: 2016-10-09T18:16:26.393Z
Answers.LastEditDate: 2016-10-09T18:16:26.393Z
Answers.UserDisplayName: Doxosophoi
Answers.Body: <p>It's an interesting question about what makes humans unique. There is a good book on the subject titled <a href="https://archive.org/stream/whatcomputerscan017504mbp/whatcomputerscan017504mbp_djvu.txt" rel="noreferrer">What Computers Cant Do</a> by <a href="https://en.wikipedia.org/wiki/Hubert_Dreyfus" rel="noreferrer">Hubert Dreyfus</a>.</p>
  
  <p>One task that a computer can't handle (for now at least) is ranking important things. For example, CAPTCHA asks you to order a random list of things (small one, five or six items) by importance. This particular exercise requires AI to take decisions (not always rational) based on human judgement.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-10-13T09:33:07.423Z
Answers.LastActivityDate: 2016-10-13T09:33:07.423Z
Answers.UserDisplayName: kvfi
Body: <p>Are there any modern techniques of generating <strong>textual</strong> CAPTCHA (so person needs to type the right text) challenges which can easily <a href="https://ai.stackexchange.com/q/92/8">fool AI</a> with some visual obfuscation methods, but at the same time human can solve them without any struggle?</p>
  
  <p>For example I'm talking about plain ability of <strong>recognising text embedded into image</strong> (without considering any external plugins like flash or java, image classification, etc.) and re-typing the text that has been written or something similar.</p>
  
  <p>I guess adding noise, gradient, rotating letters or changing colours are not reliable methods any more, since they can be quickly broken.</p>
  
  <p>Any suggestions or research has been done?</p>
  
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2016-10-09T02:41:57.610Z
Comments.Text: Try to think about what humans can do better than computers. We can reason and we (native speakers) will know nearly every idiom. [See this for further ideas](https://www.google.com/search?client=safari&rls=en&q=what+can+humans+do+better+than+computers&ie=UTF-8&oe=UTF-8). I think that as far as text goes, the best would be to have the user enter text that is analyzed with NLP to match a declared sentiment or perhaps express something. Computers are not very good at drafting clear, well-structured sentences (but I guess most humans aren't great at that either).
Comments.UserDisplayName: Jake Dube
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2016-10-10T20:30:16.427Z
Comments.Text: Usually textual CAPTCHA is used to mean that the CATPCHA is presented as text, not that the required user input must be text. For example [TextCaptcha](http://textcaptcha.com/).
Comments.UserDisplayName: Theraot
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2016-08-05T08:17:39.197Z
Comments.Text: Isn't this sort of backwards? Usually someone first makes a Captcha that they think can fool a bot, THEN other people start working on solving it automatically. Anything new you might think of will become obsolete very quickly.
Comments.UserDisplayName: Disenchanted Lurker
Tags: <image-recognition><research><optical-character-recognition>
Title: Are there any textual CAPTCHA challenges which can fool AI, but not human?
UserDisplayName: kenorb
ThreadText: # Are there any textual CAPTCHA challenges which can fool AI, but not human?
  
  (Asked by: username_0 on 2016-08-05)
  
  Are there any modern techniques of generating **textual** CAPTCHA (so person needs to type the right text) challenges which can easily [fool AI](https://ai.stackexchange.com/q/92/8) with some visual obfuscation methods, but at the same time human can solve them without any struggle?
  
  For example I'm talking about plain ability of **recognising text embedded into image** (without considering any external plugins like flash or java, image classification, etc.) and re-typing the text that has been written or something similar.
  
  I guess adding noise, gradient, rotating letters or changing colours are not reliable methods any more, since they can be quickly broken.
  
  Any suggestions or research has been done?
  
  **Tags:** image-recognition, research, optical-character-recognition
  > **Comments:**
  > **username_3**: Isn't this sort of backwards? Usually someone first makes a Captcha that they think can fool a bot, THEN other people start working on solving it automatically. Anything new you might think of will become obsolete very quickly.  
  > **username_1**: Try to think about what humans can do better than computers. We can reason and we (native speakers) will know nearly every idiom. [See this for further ideas](https://www.google.com/search?client=safari&rls=en&q=what+can+humans+do+better+than+computers&ie=UTF-8&oe=UTF-8). I think that as far as text goes, the best would be to have the user enter text that is analyzed with NLP to match a declared sentiment or perhaps express something. Computers are not very good at drafting clear, well-structured sentences (but I guess most humans aren't great at that either).  
  > **username_2**: Usually textual CAPTCHA is used to mean that the CATPCHA is presented as text, not that the required user input must be text. For example [TextCaptcha](http://textcaptcha.com/).  
  
  ---
  
  ## 3 answers
  
  ### Answer by username_6 on 2016-10-13. Score: 5 | Accepted answer
  
  It's an interesting question about what makes humans unique. There is a good book on the subject titled [What Computers Cant Do](https://archive.org/stream/whatcomputerscan017504mbp/whatcomputerscan017504mbp_djvu.txt) by [Hubert Dreyfus](https://en.wikipedia.org/wiki/Hubert_Dreyfus).
  
  One task that a computer can't handle (for now at least) is ranking important things. For example, CAPTCHA asks you to order a random list of things (small one, five or six items) by importance. This particular exercise requires AI to take decisions (not always rational) based on human judgement.
  
  
  ---
  
  ### Answer by username_4 on 2016-10-09. Score: 5
  
  A method that could possibly work is utilising optical illusions such as one where two lines down a hallway are identical but one seems longer to the human eye, then they could be prompted with a multiple choice question as to the state of the line, which to our eyes looks longer, but to a computer, is still the same length of line. Of course, there is always the issue of people with eye based disabilities not being able to complete them, but different illusions could be used to accommodate that.
  
  [Example](https://www.brainbashers.com/showillusion.asp?85)
  
  
  ---
  
  ### Answer by username_5 on 2016-10-07. Score: 2
  
  **Have the user label highlighted objects in video that a state of the art classifier cannot solve**
  
  Create a state of the art video classifier. Might as well train it on Google's [YouTube-8M](https://research.googleblog.com/2016/09/announcing-youtube-8m-large-and-diverse.html) video training data. But you will want to continually feed it original video as well.
  
  Have the classifier label as many objects as it can. Have it isolate which objects it can recognize as objects but which it is unable to label.
  
  Have it output videos that outlines the objects. Preferably GIFs, which can be easily embedded in forms.
  
  For 100 of these, ask 100 users what the object is. If 90% of the users agree on the name of an object, add that video to the captcha-set. Call this the pre-trained set.
  
  Every time a user needs to authenticate, show them one of the highlighted objects in a video *not from the pre-trained set*. If the image has less than 100 showings, record the label and give the user another one from the pre-trained set. If they get it right, let them through, if not, give them another from the pretrained set.
  
  Once the non-pre-trained video has more than 100 showings and more than 90% of the captcha-users agree, add that video to the post-trained set.
  
  Over time, slowly remove the pre-trained set. Put expirations on each video in the post-trained set and remove them after expiration, so that they don't get used too many times.
  
  Ideally, this process would constantly improve the video classifier, keeping it state of the art and slightly ahead of other classifiers. Perhaps it could also favor less common words and objects and more esoteric things, so as to specialize this classifier against other classifiers.
  
  The same could be done for image labeling, but the utility of the video classifier will probably last longer, given advances in AI.
  
  Strictly speaking, though, short of some quantum trickery, there is no captcha system that will not one day be solved by external AI systems.
  
  (edit: oh, I just noticed you specifically said "textual captcha." If that's what you mean, then no I don't think text classification has much mystery left in it. Computers can probably glean text from pictures better than humans now. But techically, the *input* in the above described captcha system is textual.)
  
  
  ---
  
  