Answers.Body: <p>LMGTFY ;)</p>
  <p>The problem is called <a href="https://en.wikipedia.org/wiki/Optical_music_recognition" rel="nofollow noreferrer">Optical Music Recognition</a>. <a href="https://machinelearningtutorials.weebly.com/home/i-built-a-music-sheet-transcriber-heres-how" rel="nofollow noreferrer">Here</a> you can find tutorial that desribes OMR with deep learning and <a href="https://www.mdpi.com/2076-3417/8/4/606/htm" rel="nofollow noreferrer">here</a> you have scientific paper. I think it is very good start for your investigations.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-03-17T08:02:15.030Z
Answers.LastActivityDate: 2022-03-17T08:02:15.030Z
Answers.UserDisplayName: Slawomir Orlowski
Answers.Body: <p>AI/ML can solve the task described, a solution is as below:</p>
  <ul>
  <li>Regular image processing algorithm (pixel row with min black pixels, adjacent rows are considered as 1) to split the sheet music (as image) into rows (<strong>red lines</strong>)<br/>
  <a href="https://i.sstatic.net/lA5Gg.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/lA5Gg.png" alt="enter image description here" /></a></li>
  <li>Regular image processing algorithm (pixel column with min black pixels, adjacent columns are considered as 1) to split a row into notes based on scanning vertically (<strong>blue lines</strong>)<br/>
  <a href="https://i.sstatic.net/sPsfq.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/sPsfq.png" alt="enter image description here" /></a></li>
  <li>Do image classification on every cell created by red lines and blue lines to get notes, and play them</li>
  <li>Real-time image classification may be slow and not possible to play note by note directly, the programme should process the whole sheet music first.</li>
  </ul>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-03-17T04:28:13.947Z
Answers.LastActivityDate: 2022-03-17T04:42:03.543Z
Answers.LastEditDate: 2022-03-17T04:42:03.543Z
Answers.UserDisplayName: Dan D.
Body: <p><a href="https://www.google.com/search?q=musical%20notes&amp;prmd=ibnv&amp;source=lnms&amp;tbm=isch&amp;sa=X&amp;ved=2ahUKEwjMm5vA-Mv2AhUuGqYKHSrGCyYQ_AUoAXoECAIQAQ&amp;biw=360&amp;bih=626&amp;dpr=2" rel="nofollow noreferrer">Musical notes</a></p>
  <p><a href="https://www.google.com/search?q=music%20notes%20from%20youtube%20video&amp;source=hp&amp;ei=Q6wyYryxBvDb2roPmZasIA&amp;oq=musiical%20notes%20video%20youtube&amp;gs_lcp=ChFtb2JpbGUtZ3dzLXdpei1ocBABGAAyBggAEBYQHjoLCAAQgAQQsQMQgwE6DgguEIAEELEDEMcBENEDOhEILhCABBCxAxCDARDHARDRAzoLCC4QgAQQsQMQgwE6EQguEIAEELEDEIMBEMcBEKMCOgUIABCABDoLCC4QgAQQsQMQ1AI6CAgAEIAEELEDOggILhCABBCxAzoICC4QsQMQgwE6CAgAEIAEEMkDOgUIABCSAzoHCAAQsQMQCjoHCAAQgAQQCjoHCAAQyQMQCjoKCAAQsQMQsQMQCjoECAAQCjoKCAAQsQMQgwEQCjoECAAQDToKCAAQsQMQgwEQDToGCAAQDRAKOgcIIRAKEKABOggIIRAWEB0QHlCZDljPcGCxf2gCcAB4AIABzwKIAY8skgEIMC4xOS45LjGYAQCgAQGwAQA&amp;sclient=mobile-gws-wiz-hp#vuanr=4" rel="nofollow noreferrer">Musical notes videos</a></p>
  <p><a href="https://bigpiano.com" rel="nofollow noreferrer">Piano</a></p>
  <p>Can AI, Machine learning, Data science, Computer vision, image processing technologies assist in interpreting musical notes ?</p>
  <p>Input dataset : Musical notes</p>
  <p>Output : Sound played.</p>
  <p>A python program which can assist in interpreting or converting text to speech ?.</p>
  <p>The text inputted is Musical notes captured as a image by camera as input device.</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2022-03-17T09:28:17.007Z
Comments.Text: What are your findings so far? Are you back to our site to pollute it with poor questions? Please, don't do that. For the 1 millionth time, please, read https://ai.stackexchange.com/help/how-to-ask and https://ai.stackexchange.com/help/on-topic. To ask a good question, you need to do a little bit of research before asking it and share with us your findings. You can easily find answers to this question on the web. There's no excuse. If you could find our site to ask this question, you could also have find the answer on the web.
Comments.UserDisplayName: nbro
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2022-03-17T09:33:22.310Z
Comments.Text: Also, why are you linking us to images of notes? Do you think that people here don't know what a musical note is? It makes no sense to me.
Comments.UserDisplayName: nbro
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2022-03-17T10:57:10.133Z
Comments.Text: Similar if not duplicate question https://ai.stackexchange.com/q/11431/2444.
Comments.UserDisplayName: nbro
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2022-03-17T15:36:28.860Z
Comments.Text: I am closing this question for being too broad, because it is basically asking about an entire pipeline of a rather big task (image inputs --> sound outputs based on image contents) whether "it is possible using AI/ML". This invites either just "yes"/"no" answers, or 50-page reports on how to handle the entire pipeline. We require more specific and precise questions about well-defined, specific problems.
Comments.UserDisplayName: Dennis Soemers
Tags: <machine-learning><image-recognition><ai-design><image-processing><data-science>
Title: Musical notes interpretation
UserDisplayName: Prashant Akerkar
ThreadText: # Musical notes interpretation
  
  (Asked by: username_0 on 2022-03-17)
  
  [Musical notes](https://www.google.com/search?q=musical%20notes&prmd=ibnv&source=lnms&tbm=isch&sa=X&ved=2ahUKEwjMm5vA-Mv2AhUuGqYKHSrGCyYQ_AUoAXoECAIQAQ&biw=360&bih=626&dpr=2)
  
  [Musical notes videos](https://www.google.com/search?q=music%20notes%20from%20youtube%20video&source=hp&ei=Q6wyYryxBvDb2roPmZasIA&oq=musiical%20notes%20video%20youtube&gs_lcp=ChFtb2JpbGUtZ3dzLXdpei1ocBABGAAyBggAEBYQHjoLCAAQgAQQsQMQgwE6DgguEIAEELEDEMcBENEDOhEILhCABBCxAxCDARDHARDRAzoLCC4QgAQQsQMQgwE6EQguEIAEELEDEIMBEMcBEKMCOgUIABCABDoLCC4QgAQQsQMQ1AI6CAgAEIAEELEDOggILhCABBCxAzoICC4QsQMQgwE6CAgAEIAEEMkDOgUIABCSAzoHCAAQsQMQCjoHCAAQgAQQCjoHCAAQyQMQCjoKCAAQsQMQsQMQCjoECAAQCjoKCAAQsQMQgwEQCjoECAAQDToKCAAQsQMQgwEQDToGCAAQDRAKOgcIIRAKEKABOggIIRAWEB0QHlCZDljPcGCxf2gCcAB4AIABzwKIAY8skgEIMC4xOS45LjGYAQCgAQGwAQA&sclient=mobile-gws-wiz-hp#vuanr=4)
  
  [Piano](https://bigpiano.com)
  
  Can AI, Machine learning, Data science, Computer vision, image processing technologies assist in interpreting musical notes ?
  
  Input dataset : Musical notes
  
  Output : Sound played.
  
  A python program which can assist in interpreting or converting text to speech ?.
  
  The text inputted is Musical notes captured as a image by camera as input device.
  
  **Tags:** machine-learning, image-recognition, ai-design, image-processing, data-science
  
  > **Comments:**
  > **username_1**: What are your findings so far? Are you back to our site to pollute it with poor questions? Please, don't do that. For the 1 millionth time, please, read https://ai.stackexchange.com/help/how-to-ask and https://ai.stackexchange.com/help/on-topic. To ask a good question, you need to do a little bit of research before asking it and share with us your findings. You can easily find answers to this question on the web. There's no excuse. If you could find our site to ask this question, you could also have find the answer on the web.  
  > **username_1**: Also, why are you linking us to images of notes? Do you think that people here don't know what a musical note is? It makes no sense to me.  
  > **username_1**: Similar if not duplicate question https://ai.stackexchange.com/q/11431/2444.  
  > **username_2**: I am closing this question for being too broad, because it is basically asking about an entire pipeline of a rather big task (image inputs --> sound outputs based on image contents) whether "it is possible using AI/ML". This invites either just "yes"/"no" answers, or 50-page reports on how to handle the entire pipeline. We require more specific and precise questions about well-defined, specific problems.  
  
  ---
  
  ## 2 answers
  
  ### Answer by username_4 on 2022-03-17. Score: 4 | Accepted answer
  
  AI/ML can solve the task described, a solution is as below:
  
  * Regular image processing algorithm (pixel row with min black pixels, adjacent rows are considered as 1) to split the sheet music (as image) into rows (**red lines**)  
    [![enter image description here](https://i.sstatic.net/lA5Gg.png)](https://i.sstatic.net/lA5Gg.png)
  * Regular image processing algorithm (pixel column with min black pixels, adjacent columns are considered as 1) to split a row into notes based on scanning vertically (**blue lines**)  
    [![enter image description here](https://i.sstatic.net/sPsfq.png)](https://i.sstatic.net/sPsfq.png)
  * Do image classification on every cell created by red lines and blue lines to get notes, and play them
  * Real-time image classification may be slow and not possible to play note by note directly, the programme should process the whole sheet music first.
  
  
  ---
  
  ### Answer by username_3 on 2022-03-17. Score: 2
  
  LMGTFY ;)
  
  The problem is called [Optical Music Recognition](https://en.wikipedia.org/wiki/Optical_music_recognition). [Here](https://machinelearningtutorials.weebly.com/home/i-built-a-music-sheet-transcriber-heres-how) you can find tutorial that desribes OMR with deep learning and [here](https://www.mdpi.com/2076-3417/8/4/606/htm) you have scientific paper. I think it is very good start for your investigations.
  
  
  ---
  
  