skip to Main Content

How can my bot (Bot Framework Microsoft) handle an audio message from facebook.

How it’s received in the Post Message in MessagesController? So I can call the SpeechToText API?

Does the data go all the way to

2

Answers


  1. Your Post controller takes an Activity as an argument. The Audio message will show up in the Attachment array as a link to the audio location provided by Facebook. You can pass that to the Bing Speech API. One thing to note that the ContentType provided by Facebook is “video/mp4” (which could be confusing).

    Login or Signup to reply.
  2. You get an attachment of the type “audio/aac”. You need to access it via your activity object.

    var sound = activity.Attachments?.FirstOrDefault(a => a.ContentType.Equals("audio/aac"));
    

    Now you can easily access the actual message via sound.ContentUrl and have a URI to the file, which you then can put into an encoder to convert it to wav. Then you can put it into you Bing speech Api.

    Login or Signup to reply.
Please signup or login to give your own answer.
Back To Top
Search