Playmaker Forum

PlayMaker Feedback => Action Requests => Topic started by: cel on March 21, 2019, 01:43:56 AM

Title: action for speech recognition (windows,uwp)[SOLVED]
Post by: cel on March 21, 2019, 01:43:56 AM
Upon reading this https://lightbuzz.com/speech-recognition-unity/ would it be possible to make an action that let us define and add the words we want recognised and then fire an event?

thanks
Title: Re: action for speech recognition (windows,uwp)
Post by: jeanfabre on March 29, 2019, 01:19:05 AM
Hi,

 Sounds like an old project ( 2017 ), is it still up?

Does the project on github works for you? https://github.com/lightbuzz/speech-recognition-unity


Bye,

 Jean
Title: Re: action for speech recognition (windows,uwp)
Post by: cel on March 29, 2019, 01:32:36 AM
yes, I works for me... I actually used the script from here and changed it so that when it recognises a word the script makes an fsm fire an event.... and it works like a charm in unity 2018
Title: Re: action for speech recognition (windows,uwp)
Post by: jeanfabre on April 01, 2019, 01:13:44 AM
Hi,

Can you try this package : https://github.com/PlayMakerEcosystem/PlayMakerCustomActions_U2018/blob/master/PlayMaker/Ecosystem/Custom%20Packages/Audio/SpeechRecongnition.unitypackage?raw=true

use the component PlayMakerSpeechRecognitionProxy, define the words you want to catch, and define the playmaker event target and event you want to send.

 the event will have tis event data string set the recognized word.

 Let me know how it goes, if it's ok, I'll put it on the ecosystem.


 Bye,

 Jean
Title: Re: action for speech recognition (windows,uwp)
Post by: cel on April 02, 2019, 12:51:37 AM
I can't get it to work.... tried everything, fsm, broadcast all, game object, it just doesn't list any event on the onphraserecognised, it's always none, maybe I'm doing something wrong...
Title: Re: action for speech recognition (windows,uwp)
Post by: jeanfabre on April 02, 2019, 04:30:39 AM
Hi,

 you have to have global events defined first.

 it works here:

(https://i.imgur.com/2ox2Piv.png)

what version of PlayMaker are you using?


Bye,

 Jean
Title: Re: action for speech recognition (windows,uwp)
Post by: cel on April 02, 2019, 08:33:26 AM
yep, got it working, events need to be global... one last thing, is there a chance to have the "last spoken word" stored in an fsm variable? I'm trying to avoid get property.
Title: Re: action for speech recognition (windows,uwp)
Post by: jeanfabre on April 02, 2019, 10:59:51 PM
Hi,

 it's passed as an event data with the event being sent. so use GetEventInfo to retrieve the spoken word.

 Bye,

 Jean
Title: Re: action for speech recognition (windows,uwp)
Post by: cel on April 03, 2019, 10:07:09 AM
Brilliant,  works as a charm... Just need to test it on an xbox one. Thank you so much
Title: Re: action for speech recognition (windows,uwp)
Post by: jeanfabre on April 04, 2019, 12:19:44 AM
Hi,

 cool, I'll put it on the ecosystem in the coming days.

 Bye,

 Jean
Title: Re: action for speech recognition (windows,uwp)[SOLVED]
Post by: jeanfabre on April 07, 2019, 10:54:43 PM
Hi,

Done (http://hutonggames.com/playmakerforum/index.php?topic=20343.0)

 Bye,

 Jean
Title: Re: action for speech recognition (windows,uwp)[SOLVED]
Post by: sofianehamza on May 10, 2019, 07:05:33 AM
amazing...it works like a charm, I was wondering if it's possible to set the keywords as variables
Title: Re: action for speech recognition (windows,uwp)[SOLVED]
Post by: jeanfabre on May 16, 2019, 10:57:25 PM
Hi,

ok, I created a new action called "SpeechRecognitionSetKeywords"

Can you try and let me know how it goes ( it's blind coding)

Bye,

 Jean
Title: Re: action for speech recognition (windows,uwp)[SOLVED]
Post by: sofianehamza on October 23, 2019, 09:46:19 PM
thanks for your reply
but I can't find the new action
Title: Re: action for speech recognition (windows,uwp)[SOLVED]
Post by: jeanfabre on October 28, 2019, 05:43:47 AM
Hi,

 have you updated the package from the Ecosystem?

Bye,

 Jean
Title: Re: action for speech recognition (windows,uwp)[SOLVED]
Post by: LordHorusNL on October 28, 2019, 08:15:04 AM
Are you sure you updated the speech recognition package jean?

I'm not seeing the new action when updating, just the proxy script.
Title: Re: action for speech recognition (windows,uwp)[SOLVED]
Post by: jeanfabre on October 28, 2019, 11:51:11 PM
Hi,

 true... my bad, my packer rules where messed up, can you try now? I just uploaded a new version of the package.

Bye,

 Jean
Title: Re: action for speech recognition (windows,uwp)[SOLVED]
Post by: LordHorusNL on October 29, 2019, 07:53:41 AM
I am getting the update however i'm also getting the following error on the "SpeechRecognitionSetKeywords" action where the FsmArray variable is suppose to be.

Error editing fields: Keywords
Unknown FsmArray Type: Use ArrayEditorAttribute to specify a VariableType

Thanks

Title: Re: action for speech recognition (windows,uwp)[SOLVED]
Post by: jeanfabre on October 29, 2019, 11:35:27 PM
Hi,

 odd, what version of Unity and Playmaker do you have?

Bye,

 Jean
Title: Re: action for speech recognition (windows,uwp)[SOLVED]
Post by: LordHorusNL on October 30, 2019, 09:12:04 AM
2019.1.8f1
Latest asset store PlayMaker version
Clean project

Still getting the error, not that i'm using the action right now but i just thought you should know in case somebody else runs into this problem.

Thanks.
Title: Re: action for speech recognition (windows,uwp)[SOLVED]
Post by: jeanfabre on November 01, 2019, 12:33:39 AM
Hi,

 my bad, I was not looking properly :) it's fixed, should be all good now.

Bye,

 Jean