playMaker

Author Topic: action for speech recognition (windows,uwp)[SOLVED]  (Read 10499 times)

cel

  • Full Member
  • ***
  • Posts: 132
action for speech recognition (windows,uwp)[SOLVED]
« on: March 21, 2019, 04:43:56 AM »
Upon reading this https://lightbuzz.com/speech-recognition-unity/ would it be possible to make an action that let us define and add the words we want recognised and then fire an event?

thanks
« Last Edit: April 08, 2019, 01:54:23 AM by jeanfabre »

jeanfabre

  • Administrator
  • Hero Member
  • *****
  • Posts: 15500
  • Official Playmaker Support
Re: action for speech recognition (windows,uwp)
« Reply #1 on: March 29, 2019, 04:19:05 AM »
Hi,

 Sounds like an old project ( 2017 ), is it still up?

Does the project on github works for you? https://github.com/lightbuzz/speech-recognition-unity


Bye,

 Jean

cel

  • Full Member
  • ***
  • Posts: 132
Re: action for speech recognition (windows,uwp)
« Reply #2 on: March 29, 2019, 04:32:36 AM »
yes, I works for me... I actually used the script from here and changed it so that when it recognises a word the script makes an fsm fire an event.... and it works like a charm in unity 2018

jeanfabre

  • Administrator
  • Hero Member
  • *****
  • Posts: 15500
  • Official Playmaker Support
Re: action for speech recognition (windows,uwp)
« Reply #3 on: April 01, 2019, 04:13:44 AM »
Hi,

Can you try this package : https://github.com/PlayMakerEcosystem/PlayMakerCustomActions_U2018/blob/master/PlayMaker/Ecosystem/Custom%20Packages/Audio/SpeechRecongnition.unitypackage?raw=true

use the component PlayMakerSpeechRecognitionProxy, define the words you want to catch, and define the playmaker event target and event you want to send.

 the event will have tis event data string set the recognized word.

 Let me know how it goes, if it's ok, I'll put it on the ecosystem.


 Bye,

 Jean

cel

  • Full Member
  • ***
  • Posts: 132
Re: action for speech recognition (windows,uwp)
« Reply #4 on: April 02, 2019, 03:51:37 AM »
I can't get it to work.... tried everything, fsm, broadcast all, game object, it just doesn't list any event on the onphraserecognised, it's always none, maybe I'm doing something wrong...

jeanfabre

  • Administrator
  • Hero Member
  • *****
  • Posts: 15500
  • Official Playmaker Support
Re: action for speech recognition (windows,uwp)
« Reply #5 on: April 02, 2019, 07:30:39 AM »
Hi,

 you have to have global events defined first.

 it works here:



what version of PlayMaker are you using?


Bye,

 Jean

cel

  • Full Member
  • ***
  • Posts: 132
Re: action for speech recognition (windows,uwp)
« Reply #6 on: April 02, 2019, 11:33:26 AM »
yep, got it working, events need to be global... one last thing, is there a chance to have the "last spoken word" stored in an fsm variable? I'm trying to avoid get property.

jeanfabre

  • Administrator
  • Hero Member
  • *****
  • Posts: 15500
  • Official Playmaker Support
Re: action for speech recognition (windows,uwp)
« Reply #7 on: April 03, 2019, 01:59:51 AM »
Hi,

 it's passed as an event data with the event being sent. so use GetEventInfo to retrieve the spoken word.

 Bye,

 Jean

cel

  • Full Member
  • ***
  • Posts: 132
Re: action for speech recognition (windows,uwp)
« Reply #8 on: April 03, 2019, 01:07:09 PM »
Brilliant,  works as a charm... Just need to test it on an xbox one. Thank you so much

jeanfabre

  • Administrator
  • Hero Member
  • *****
  • Posts: 15500
  • Official Playmaker Support
Re: action for speech recognition (windows,uwp)
« Reply #9 on: April 04, 2019, 03:19:44 AM »
Hi,

 cool, I'll put it on the ecosystem in the coming days.

 Bye,

 Jean

jeanfabre

  • Administrator
  • Hero Member
  • *****
  • Posts: 15500
  • Official Playmaker Support
Re: action for speech recognition (windows,uwp)[SOLVED]
« Reply #10 on: April 08, 2019, 01:54:43 AM »
Hi,

Done

 Bye,

 Jean
« Last Edit: May 17, 2019, 01:33:56 AM by jeanfabre »

sofianehamza

  • Playmaker Newbie
  • *
  • Posts: 35
Re: action for speech recognition (windows,uwp)[SOLVED]
« Reply #11 on: May 10, 2019, 10:05:33 AM »
amazing...it works like a charm, I was wondering if it's possible to set the keywords as variables

jeanfabre

  • Administrator
  • Hero Member
  • *****
  • Posts: 15500
  • Official Playmaker Support
Re: action for speech recognition (windows,uwp)[SOLVED]
« Reply #12 on: May 17, 2019, 01:57:25 AM »
Hi,

ok, I created a new action called "SpeechRecognitionSetKeywords"

Can you try and let me know how it goes ( it's blind coding)

Bye,

 Jean

sofianehamza

  • Playmaker Newbie
  • *
  • Posts: 35
Re: action for speech recognition (windows,uwp)[SOLVED]
« Reply #13 on: October 24, 2019, 12:46:19 AM »
thanks for your reply
but I can't find the new action

jeanfabre

  • Administrator
  • Hero Member
  • *****
  • Posts: 15500
  • Official Playmaker Support
Re: action for speech recognition (windows,uwp)[SOLVED]
« Reply #14 on: October 28, 2019, 08:43:47 AM »
Hi,

 have you updated the package from the Ecosystem?

Bye,

 Jean