This require an app written in PHP(ideally) or NodeJS using real time speech to text APIs from Google or Microsoft to convert spoken words to text and save a mysql database with second by second timestamp
REQUIREMENTS - PHASE 1 of project: As a video is playing inside an HTML5 <video></video> segment, we need to record any words (English for now) being spoken (microphone input only) on a computer or mobile device, in an audio file (MP3) along with the words being converted to text and made visible in a "textarea" field for subsequent update on a MySQL database. It is very important to track the timestamp of the entire session (every second), so that we keep the video synchronized with the audio stream being recorded and the corresponding text transcription being made. The timestamp will be in seconds for the length of the video. While the "textarea" mentioned above simply displays the speech to text content, in the background however every second for the duration of the video (starting with 0 seconds), the system needs to store either nothing or the text version of the word being spoken.
For example if the word "tester" is spoken and translated to text at the 223rd second into the video, then in a two dimensional array the word "tester" would be updated on the 223 second record in the array. Upon "submit" that contents of the array would be updated in a table in the MySQL database. Any open source speech to text APIs (such as Google or Microsoft) that allows speech to text translation for multiple languages, based on developer's recommendation, may be used in this process.
FUTURE PHASES: For your information, this timestamp tracking will be required in a future milestone of the larger program, but the groundwork for that future application must be ready now.
7 freelancers are bidding on average $192 for this job
I am expert for nodejs , Socket IO, Express, Sails and Hapi Framework for nodejs. Here are my few sample projects which are based on nodejs API [login to view URL] [login to view URL]
This is Saadia from Pakistan I have a Website design and development experience since 2011 Check my Portfolio: [login to view URL] Will wait for your reply. Thanks Saadia