blogonthefly

[blogonthefly]

As a person who did work on such a project

These are all true, which I learnt much later when researching for more time and interacting with the disabled community on here.

Some more additions:

Loads of these talk about Sign to Speech and not the other way around which is incredibly hard to do. Perhaps when humanoid bots become a thing. But it’s a weird bias. Like it’s way more beneficial to hearing people, than communicating to deaf people.

Barely takes into account that different people have different sign languages, even English has variations. And English is atleast easy to work with, but tons of language fly under the radar.

It’s not a problem you can solve in a 6 month semester. But then again that’s a HUGE number of projects really.

Media that’s reporting such stories should really do their proper groundwork. The Hindu had this story which is a national news agency… makes no sense.

ASL interpreters are far superior and experienced, and for written you have braille. I genuinely wish academia included them into the syllabus as a fundamental learning skill same as computers were. Because it’s a REAL LIFE usable skill that makes the world better for everyone.

A computer science student named Priyanjali Gupta, studying in her third year at Vellore Institute of Technology, has developed an AI-based model that can translate sign language into English.

[blogonthefly]

Wow this has reached even Tumblr!?

I don’t know if me saying this even matters BUT, this girls project is a total rip off of this YouTuber project Nicholas Renottee

And you might say, ofc you can refer to peoples project and make your own stuff. I agree, expect he’s given a step by step tutorial and SHE HASNT EVEN BOTHERED TO CHANGE OR ADD A DIFFERENT SIGN.

How do I know this? Same college a year senior, did a similar project. Except we had all the letters of the alphabet to be able to spell out and write a paragraph including an erase option. And we tried to bring in Hindi as well as making the whole thing to speech. (Which is only a couple of line of code but still)

And the reason it makes me so mad is IT DOESN’T CREDIT THE ORIGINAL PERSON.

AND MORE IMPORTANTLY we should be paying attention to this:

There’s another Chennai based student (who was also deaf) news I saw who worked on an end to end solution for learning for herself Cant find the link at the moment.

And there’s this

And there’s LOADS more people and students working on such projects

My basic point is don’t copy code from YouTube and make it news for God’s sake!! Especially when you don’t have the knowledge to particularly scale it.

But yes AI is useful for that, the model used here in MediaPipe, through which you can make datasets for Hands, head and shoulder position recognitions, and it’s a pretty decent pipeline compared to MATLAB ones and way more robust.

Edit:

However for something like this to work smoothly there’s a LOT of work to be done and very rarely do these projects take into account disabled people views, which is why I stopped working on it. Example this helps people who use sign language to people don’t know it but not the other way around

A computer science student named Priyanjali Gupta, studying in her third year at Vellore Institute of Technology, has developed an AI-based model that can translate sign language into English.