Getting Alexa to Respond to Sign Language Using Your Webcam and TensorFlow.js
ASL student here. I just wanted to highlight how many challenges there are to translating, even for humans. Here's two examples.First is dialect. One would think the Internet/youtube/videochat would vaporize geography differences, and it's starting to happen, but that's not (yet) the case. Lots of signs have "synonyms" based on signer's preference, etymology, who they learned from and who they hang out with, etc.Another is grammar. What OP is doing in his video, for example is English grammar, where signs are directly substitited for words.  But ASL has its own sign order, modifiers like facial expressions, and idioms for brevity. For example "have you ever been to San Francisco before?" might be "SF TOUCH YOU FINISH" with raised eyebrows at the end, as a modifier.  Note also there are no conjugations or articles like some languages, but there are pronouns.  In fact, there are local bindings where you make up a sign name for someone on the fly and then use it during a conversation.I think with large enough training sets, this will all be mitigated, like Google needed years of speech samples to get Translate working okay.