playMaker

Author Topic: action for speech recognition (windows,uwp)[SOLVED]  (Read 1769 times)

cel

  • Full Member
  • ***
  • Posts: 100
    • View Profile
action for speech recognition (windows,uwp)[SOLVED]
« on: March 21, 2019, 01:43:56 AM »
Upon reading this https://lightbuzz.com/speech-recognition-unity/ would it be possible to make an action that let us define and add the words we want recognised and then fire an event?

thanks
« Last Edit: April 07, 2019, 10:54:23 PM by jeanfabre »

jeanfabre

  • Administrator
  • Hero Member
  • *****
  • Posts: 14684
  • Official Playmaker Support
    • View Profile
Re: action for speech recognition (windows,uwp)
« Reply #1 on: March 29, 2019, 01:19:05 AM »
Hi,

 Sounds like an old project ( 2017 ), is it still up?

Does the project on github works for you? https://github.com/lightbuzz/speech-recognition-unity


Bye,

 Jean

cel

  • Full Member
  • ***
  • Posts: 100
    • View Profile
Re: action for speech recognition (windows,uwp)
« Reply #2 on: March 29, 2019, 01:32:36 AM »
yes, I works for me... I actually used the script from here and changed it so that when it recognises a word the script makes an fsm fire an event.... and it works like a charm in unity 2018

jeanfabre

  • Administrator
  • Hero Member
  • *****
  • Posts: 14684
  • Official Playmaker Support
    • View Profile
Re: action for speech recognition (windows,uwp)
« Reply #3 on: April 01, 2019, 01:13:44 AM »
Hi,

Can you try this package : https://github.com/PlayMakerEcosystem/PlayMakerCustomActions_U2018/blob/master/PlayMaker/Ecosystem/Custom%20Packages/Audio/SpeechRecongnition.unitypackage?raw=true

use the component PlayMakerSpeechRecognitionProxy, define the words you want to catch, and define the playmaker event target and event you want to send.

 the event will have tis event data string set the recognized word.

 Let me know how it goes, if it's ok, I'll put it on the ecosystem.


 Bye,

 Jean

cel

  • Full Member
  • ***
  • Posts: 100
    • View Profile
Re: action for speech recognition (windows,uwp)
« Reply #4 on: April 02, 2019, 12:51:37 AM »
I can't get it to work.... tried everything, fsm, broadcast all, game object, it just doesn't list any event on the onphraserecognised, it's always none, maybe I'm doing something wrong...

jeanfabre

  • Administrator
  • Hero Member
  • *****
  • Posts: 14684
  • Official Playmaker Support
    • View Profile
Re: action for speech recognition (windows,uwp)
« Reply #5 on: April 02, 2019, 04:30:39 AM »
Hi,

 you have to have global events defined first.

 it works here:



what version of PlayMaker are you using?


Bye,

 Jean

cel

  • Full Member
  • ***
  • Posts: 100
    • View Profile
Re: action for speech recognition (windows,uwp)
« Reply #6 on: April 02, 2019, 08:33:26 AM »
yep, got it working, events need to be global... one last thing, is there a chance to have the "last spoken word" stored in an fsm variable? I'm trying to avoid get property.

jeanfabre

  • Administrator
  • Hero Member
  • *****
  • Posts: 14684
  • Official Playmaker Support
    • View Profile
Re: action for speech recognition (windows,uwp)
« Reply #7 on: April 02, 2019, 10:59:51 PM »
Hi,

 it's passed as an event data with the event being sent. so use GetEventInfo to retrieve the spoken word.

 Bye,

 Jean

cel

  • Full Member
  • ***
  • Posts: 100
    • View Profile
Re: action for speech recognition (windows,uwp)
« Reply #8 on: April 03, 2019, 10:07:09 AM »
Brilliant,  works as a charm... Just need to test it on an xbox one. Thank you so much

jeanfabre

  • Administrator
  • Hero Member
  • *****
  • Posts: 14684
  • Official Playmaker Support
    • View Profile
Re: action for speech recognition (windows,uwp)
« Reply #9 on: April 04, 2019, 12:19:44 AM »
Hi,

 cool, I'll put it on the ecosystem in the coming days.

 Bye,

 Jean

jeanfabre

  • Administrator
  • Hero Member
  • *****
  • Posts: 14684
  • Official Playmaker Support
    • View Profile
Re: action for speech recognition (windows,uwp)[SOLVED]
« Reply #10 on: April 07, 2019, 10:54:43 PM »
Hi,

Done

 Bye,

 Jean
« Last Edit: May 16, 2019, 10:33:56 PM by jeanfabre »

sofianehamza

  • Playmaker Newbie
  • *
  • Posts: 21
    • View Profile
Re: action for speech recognition (windows,uwp)[SOLVED]
« Reply #11 on: May 10, 2019, 07:05:33 AM »
amazing...it works like a charm, I was wondering if it's possible to set the keywords as variables

jeanfabre

  • Administrator
  • Hero Member
  • *****
  • Posts: 14684
  • Official Playmaker Support
    • View Profile
Re: action for speech recognition (windows,uwp)[SOLVED]
« Reply #12 on: May 16, 2019, 10:57:25 PM »
Hi,

ok, I created a new action called "SpeechRecognitionSetKeywords"

Can you try and let me know how it goes ( it's blind coding)

Bye,

 Jean

sofianehamza

  • Playmaker Newbie
  • *
  • Posts: 21
    • View Profile
Re: action for speech recognition (windows,uwp)[SOLVED]
« Reply #13 on: October 23, 2019, 09:46:19 PM »
thanks for your reply
but I can't find the new action

jeanfabre

  • Administrator
  • Hero Member
  • *****
  • Posts: 14684
  • Official Playmaker Support
    • View Profile
Re: action for speech recognition (windows,uwp)[SOLVED]
« Reply #14 on: October 28, 2019, 05:43:47 AM »
Hi,

 have you updated the package from the Ecosystem?

Bye,

 Jean