Answers.Body: <p>If I understand your question correctly, you are asking for a way to automatically double-check an OCR conversion from image to text. I'm afraid that is not possible: checking would require conversion from image to text via OCR, which I'm sure you can see is circular. If you want to proof an OCR conversion, you'll have to do it the old-fashioned way. At least it's faster than typing the whole thing out (and then proofing it again)!</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-02-09T08:43:09.853Z
Answers.Text: hi .,,  these are the process i did 
  
  1. i have a image pdf then i use abby to perform OCR function
  
  2. then i convert my pdf to scanble pdf in abby transformer 3.0 
  
  3. then i compare both the source file and ocr file but all those hyphens are in error how to skip those hyphens while searching ?
Answers.UserDisplayName: User_3535
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-02-09T03:22:45.213Z
Answers.LastActivityDate: 2016-02-09T03:22:45.213Z
Answers.UserDisplayName: Tom
Answers.Body: <p>I cannot answer you with certainty because I do not have the tools yo
  use. Hence I am not sure what kind of file they create (PDF can come
  in different flavors). Furthermore, besides the basic character
  recognition, OCR may or may not involve various steps, often based on
  linguistic analysis, intended to improve the result. Hyphen removal is
  one such step, since there is usually no point in keeping hyphenation
  in the resulting OCRed text.</p>
  
  <p>See for example this question: <a href="https://ebooks.stackexchange.com/questions/566/how-to-remove-hard-hyphens">How to remove hard hyphens?</a> or this
  <a href="https://www.duo.uio.no/bitstream/handle/10852/9043/Bauge2012-dehyphenation.pdf" rel="nofollow noreferrer">Master thesis on Dehyphenation</a>.</p>
  
  <p>Comparing images is sometimes possible, but unlikely to give you
  easily usable results for textual purposes.</p>
  
  <p>Thus one must assume that you used one tool (ABBYY FineReader 11) to
  get a first OCRed document, and that your comparison did a second OCR on
  the image to compare it with the first result.</p>
  
  <p>This may make sense, and help identify some possibly erroneous
  locations in the OCRed text (though I do not know that it is used, as
  there may be other ways). It is also likely that both OCR process will
  sometimes agree on making the same mistake, which then remains
  undetected.</p>
  
  <p>Now it is possible that one OCR system does hyphenation removal while
  the other does not. Then the comparison of resulting files would show
  differences wherever there was an hyphen in the original image. BTW, does acrobat find (mostly) extra hyphens or missing hyphens?</p>
  
  <p>To do away with the problem would require that both OCR steps do the
  same regarding hyphenation, either keep it or remove it. I would
  expect that some OCR algorithms can be configured to do either which
  might solve your problem.</p>
  
  <p>Note however that hyphen removal may sometimes be ambiguous, requiring
  somewhat arbitrary choice. Thus if both OCR systems used for double
  checking do hyphen removal, they may sometimes disagree on which
  hyphens should be removed, and there is not much one can do to avoid
  this.</p>
  
  <p>Another way to avoid hyphens is to write a piece of software that will
  filter out reported hyphen differences. How to do that depends on the
  context you work in.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-02-09T11:22:59.833Z
Answers.LastActivityDate: 2016-02-09T11:22:59.833Z
Answers.LastEditDate: 2017-04-13T13:00:05.480Z
Answers.UserDisplayName: babou
Body: <p>I have two pdf files:</p>
  
  <ul>
  <li><p><strong>original image pdf</strong> <em>where the pdf file is just an image of the text</em></p></li>
  <li><p><strong>ocr pdf</strong> <em>produced by OCR, using <a href="http://www.abbyy.com/finereader/" rel="nofollow">ABBYY FineReader</a> 11</em> </p></li>
  </ul>
  
  <p>these are the process i did </p>
  
  <ol>
  <li><p>i have a image pdf then i use abby to perform OCR function</p></li>
  <li><p>then i convert my pdf to scanble pdf in abby transformer 3.0 </p></li>
  <li><p>then i compare both the source file and ocr file using acrobat but all those hyphens are in error how to skip those hyphens while searching ?</p></li>
  </ol>
  
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2016-02-04T15:26:25.183Z
Comments.Text: Your question is not too clear. Do you get the second file by applying
  ABBYY FineReader 11 to the first file.  Is the second file just
  standard PDF text (no image). Why do you want to compare? What do you
  call an hyphen error? Is an erreur just a difference between the
  files?  Actually, I am surprised Acrobat will compare an image and a
  text, but I am no expert on Acrobat.  BTW, there are PDF files that
  contain both text and image (in a correlated structure), so that one can search the text, while
  retaining the original image for accuracy. Are you using one of those?
Comments.UserDisplayName: babou
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2016-02-09T08:47:37.067Z
Comments.Text: i update the question please check those
Comments.UserDisplayName: User_3535
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2016-02-09T11:28:06.740Z
Comments.Text: You should probably add the tag  [tag:hyphenation] in your question. Also `scanble` does not seem to be an existing word. I guess you mean "scannable", and there is a tool with that name. Is that what you actually mean?
Comments.UserDisplayName: babou
Tags: <epub><pdf><image><ocr>
Title: How to skip those hyphens while searching in acrobat
UserDisplayName: User_3535
ThreadText: # How to skip those hyphens while searching in acrobat
  
  (Asked by: username_0 on 2016-02-04)
  
  I have two pdf files:
  
  * **original image pdf** *where the pdf file is just an image of the text*
  * **ocr pdf** *produced by OCR, using [ABBYY FineReader](http://www.abbyy.com/finereader/) 11*
  
  these are the process i did
  
  1. i have a image pdf then i use abby to perform OCR function
  2. then i convert my pdf to scanble pdf in abby transformer 3.0
  3. then i compare both the source file and ocr file using acrobat but all those hyphens are in error how to skip those hyphens while searching ?
  
  **Tags:** epub, pdf, image, ocr
  
  > **Comments:**
  > **username_1**: Your question is not too clear. Do you get the second file by applying ABBYY FineReader 11 to the first file.  Is the second file just standard PDF text (no image). Why do you want to compare? What do you call an hyphen error? Is an erreur just a difference between the files?  Actually, I am surprised Acrobat will compare an image and a text, but I am no expert on Acrobat.  BTW, there are PDF files that contain both text and image (in a correlated structure), so that one can search the text, while retaining the original image for accuracy. Are you using one of those?  
  > **username_0**: i update the question please check those  
  > **username_1**: You should probably add the tag  [tag:hyphenation] in your question. Also `scanble` does not seem to be an existing word. I guess you mean "scannable", and there is a tool with that name. Is that what you actually mean?  
  
  ---
  
  ## 2 answers
  
  ### Answer by username_2 on 2016-02-09. Score: 1
  
  If I understand your question correctly, you are asking for a way to automatically double-check an OCR conversion from image to text. I'm afraid that is not possible: checking would require conversion from image to text via OCR, which I'm sure you can see is circular. If you want to proof an OCR conversion, you'll have to do it the old-fashioned way. At least it's faster than typing the whole thing out (and then proofing it again)!
  
  > **Comments:**
  > **username_0**: hi .,,  these are the process i did   1. i have a image pdf then i use abby to perform OCR function  2. then i convert my pdf to scanble pdf in abby transformer 3.0   3. then i compare both the source file and ocr file but all those hyphens are in error how to skip those hyphens while searching ?  
  
  ---
  
  ### Answer by username_1 on 2016-02-09. Score: 0
  
  I cannot answer you with certainty because I do not have the tools yo
  use. Hence I am not sure what kind of file they create (PDF can come
  in different flavors). Furthermore, besides the basic character
  recognition, OCR may or may not involve various steps, often based on
  linguistic analysis, intended to improve the result. Hyphen removal is
  one such step, since there is usually no point in keeping hyphenation
  in the resulting OCRed text.
  
  See for example this question: [How to remove hard hyphens?](https://ebooks.stackexchange.com/questions/566/how-to-remove-hard-hyphens) or this
  [Master thesis on Dehyphenation](https://www.duo.uio.no/bitstream/handle/10852/9043/Bauge2012-dehyphenation.pdf).
  
  Comparing images is sometimes possible, but unlikely to give you
  easily usable results for textual purposes.
  
  Thus one must assume that you used one tool (ABBYY FineReader 11) to
  get a first OCRed document, and that your comparison did a second OCR on
  the image to compare it with the first result.
  
  This may make sense, and help identify some possibly erroneous
  locations in the OCRed text (though I do not know that it is used, as
  there may be other ways). It is also likely that both OCR process will
  sometimes agree on making the same mistake, which then remains
  undetected.
  
  Now it is possible that one OCR system does hyphenation removal while
  the other does not. Then the comparison of resulting files would show
  differences wherever there was an hyphen in the original image. BTW, does acrobat find (mostly) extra hyphens or missing hyphens?
  
  To do away with the problem would require that both OCR steps do the
  same regarding hyphenation, either keep it or remove it. I would
  expect that some OCR algorithms can be configured to do either which
  might solve your problem.
  
  Note however that hyphen removal may sometimes be ambiguous, requiring
  somewhat arbitrary choice. Thus if both OCR systems used for double
  checking do hyphen removal, they may sometimes disagree on which
  hyphens should be removed, and there is not much one can do to avoid
  this.
  
  Another way to avoid hyphens is to write a piece of software that will
  filter out reported hyphen differences. How to do that depends on the
  context you work in.
  
  
  ---
  
  