Answers.Body: <blockquote>
  <p>any subjective ideas or comments are more than welcome</p>
  </blockquote>
  <p>Not a complete answer, but some ideas:</p>
  <p>Your goal is subdivided into many tasks. It's not exactly the same as OCR because you also need to find the vertical alignment for each note.</p>
  <hr />
  <blockquote>
  <p>One should be able to read musical notes with lower quality images.</p>
  </blockquote>
  <p>If you want your model to perform on low quality image, you'll need such database.</p>
  <p>But instead of labeling and taking pictures of printed sheets, you could just generate the images and virtually apply all sorts of distortion on them.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-08-21T06:48:41.917Z
Answers.LastActivityDate: 2021-08-21T06:48:41.917Z
Answers.UserDisplayName: Andre Goulart
Answers.Body: <p>refer to <a href="https://www.kaggle.com/c/digit-recognizer" rel="nofollow noreferrer">MNIST on kagle</a>
  to train model to recognize given set of notes in your case.</p>
  
  <p><a href="https://i.sstatic.net/B2oQ3.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/B2oQ3.png" alt="your example"></a></p>
  
  <p>if you start training model will understand pattern depending on bits in your image.</p>
  
  <p>issue comes with blurry images when last 2 sets of pics with minute change. will be difficult task for computer to distinguish.</p>
  
  <p>there is one sure shot method which works almost every time but is resource intensive and needs plethora of data to train. is DNN.</p>
  
  <p>this is my take on your question.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-03-25T06:01:46.900Z
Answers.LastActivityDate: 2019-03-25T06:01:46.900Z
Answers.UserDisplayName: Devidas
Body: <p>I was looking for an approach to recognise musical notes from photos.</p>
  <p>I found this repository <a href="https://github.com/mpralat/notesRecognizer" rel="nofollow noreferrer">https://github.com/mpralat/notesRecognizer</a>. However, it doesn't seem good enough. If you look into the <a href="https://i.sstatic.net/XtB0y.png" rel="nofollow noreferrer"><code>bad</code></a> folder, you can see that just tiny variations of lightning can already cause problems. One should be able to read musical notes with lower quality images.</p>
  <p>I found other projects. However, they all use high resolution images.</p>
  <ul>
  <li><a href="https://github.com/suyalcinkaya/music-note-recognition" rel="nofollow noreferrer">https://github.com/suyalcinkaya/music-note-recognition</a> (<a href="https://github.com/suyalcinkaya/music-note-recognition/blob/master/input_images/im2s.JPG?raw=true" rel="nofollow noreferrer">example of image</a>)</li>
  <li><a href="https://github.com/nikolalsvk/note-play" rel="nofollow noreferrer">https://github.com/nikolalsvk/note-play</a> (<a href="https://github.com/nikolalsvk/note-play/blob/master/images/notes-1.png?raw=true" rel="nofollow noreferrer">example</a>)</li>
  </ul>
  <p>Now, this is unsatisfying. If you want to snap a photo of some tunes, and want them to be recognized.</p>
  <p>So, what could one do to achieve a good solution?</p>
  <p>I was thinking about treating the musical notes just like written letters. The computer can easily learn written characters with the Arabic symbols.</p>
  <p>I wonder, though, how easy would it be for a non-Arabic? For example, in Chinese or Japanese, several characters combine into one.</p>
  <p>The same applies to musical notes, they can be connected and form something slightly different through that. For example,</p>
  <p><a href="https://i.sstatic.net/XtB0y.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/XtB0y.png" alt="enter image description here" /></a></p>
  <p>or:</p>
  <p><a href="https://i.sstatic.net/P6X9K.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/P6X9K.png" alt="enter image description here" /></a></p>
  <p>in contrast to just simple notes like:</p>
  <p><a href="https://i.sstatic.net/ds7tf.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/ds7tf.png" alt="enter image description here" /></a></p>
  <p>What would be a good approach to recognize musical notes even for slightly low-resolution images or bit blurry deformed images?</p>
  <p>I'm not saying to read out a symphony out of a thumbnail. But less than optimal captures.</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2019-03-25T08:26:16.103Z
Comments.Text: Its possible if you can cut the images to chunks of musical notes. as they are evenly spaced and within 5 lines boundary. problem to tackle here is detecting rotation. would be first step to doing so. and pass through identifier to guess what note is it will be a better way of going forward.
Comments.UserDisplayName: Devidas
Tags: <image-recognition><optical-character-recognition>
Title: How can we recognise musical notes in low-resolution or blurry images?
UserDisplayName: Toskan
ThreadText: # How can we recognise musical notes in low-resolution or blurry images?
  
  (Asked by: username_0 on 2019-03-24)
  
  I was looking for an approach to recognise musical notes from photos.
  
  I found this repository <https://github.com/mpralat/notesRecognizer>. However, it doesn't seem good enough. If you look into the [`bad`](https://i.sstatic.net/XtB0y.png) folder, you can see that just tiny variations of lightning can already cause problems. One should be able to read musical notes with lower quality images.
  
  I found other projects. However, they all use high resolution images.
  
  * <https://github.com/suyalcinkaya/music-note-recognition> ([example of image](https://github.com/suyalcinkaya/music-note-recognition/blob/master/input_images/im2s.JPG?raw=true))
  * <https://github.com/nikolalsvk/note-play> ([example](https://github.com/nikolalsvk/note-play/blob/master/images/notes-1.png?raw=true))
  
  Now, this is unsatisfying. If you want to snap a photo of some tunes, and want them to be recognized.
  
  So, what could one do to achieve a good solution?
  
  I was thinking about treating the musical notes just like written letters. The computer can easily learn written characters with the Arabic symbols.
  
  I wonder, though, how easy would it be for a non-Arabic? For example, in Chinese or Japanese, several characters combine into one.
  
  The same applies to musical notes, they can be connected and form something slightly different through that. For example,
  
  [![enter image description here](https://i.sstatic.net/XtB0y.png)](https://i.sstatic.net/XtB0y.png)
  
  or:
  
  [![enter image description here](https://i.sstatic.net/P6X9K.png)](https://i.sstatic.net/P6X9K.png)
  
  in contrast to just simple notes like:
  
  [![enter image description here](https://i.sstatic.net/ds7tf.png)](https://i.sstatic.net/ds7tf.png)
  
  What would be a good approach to recognize musical notes even for slightly low-resolution images or bit blurry deformed images?
  
  I'm not saying to read out a symphony out of a thumbnail. But less than optimal captures.
  
  **Tags:** image-recognition, optical-character-recognition
  > **Comments:**
  > **username_1**: Its possible if you can cut the images to chunks of musical notes. as they are evenly spaced and within 5 lines boundary. problem to tackle here is detecting rotation. would be first step to doing so. and pass through identifier to guess what note is it will be a better way of going forward.  
  
  ---
  
  ## 2 answers
  
  ### Answer by username_2 on 2021-08-21. Score: 1
  
  > any subjective ideas or comments are more than welcome
  
  Not a complete answer, but some ideas:
  
  Your goal is subdivided into many tasks. It's not exactly the same as OCR because you also need to find the vertical alignment for each note.
  
  ---
  
  > One should be able to read musical notes with lower quality images.
  
  If you want your model to perform on low quality image, you'll need such database.
  
  But instead of labeling and taking pictures of printed sheets, you could just generate the images and virtually apply all sorts of distortion on them.
  
  
  ---
  
  ### Answer by username_1 on 2019-03-25. Score: -2
  
  refer to [MNIST on kagle](https://www.kaggle.com/c/digit-recognizer)
  to train model to recognize given set of notes in your case.
  
  [![your example](https://i.sstatic.net/B2oQ3.png)](https://i.sstatic.net/B2oQ3.png)
  
  if you start training model will understand pattern depending on bits in your image.
  
  issue comes with blurry images when last 2 sets of pics with minute change. will be difficult task for computer to distinguish.
  
  there is one sure shot method which works almost every time but is resource intensive and needs plethora of data to train. is DNN.
  
  this is my take on your question.
  
  
  ---
  
  