6 ай бұрын
8 ай бұрын
8 ай бұрын
8 ай бұрын
10 ай бұрын
Жыл бұрын
Жыл бұрын
Жыл бұрын
Жыл бұрын
2 жыл бұрын
2 жыл бұрын
2 жыл бұрын
Пікірлер
@ArslanAI02 5 күн бұрын
Hi, If i need UAE local number, from twilio, as we cannot put our own number in twilio? Is there any way ti request that? It is for our business, we are ready to provide all of our documents, if required, and ready to pay the extra cost.
@saedsaify9944 7 күн бұрын
Great. How difficult it is to modify this to use the realtime api with an openAI assistant trained on a specific knowledge base instead of a generic openAI?
@wissammoussa7540 9 күн бұрын
Can I use this as it is and deploy it on Twilio itself as a function/build?
@bhargavpatel5208 10 күн бұрын
Hello sir, i can able to call but AI is not connect I am not able to see the incomming-call when I receive the call
@hardeepindigital6655 10 күн бұрын
I'm facing an issue with sending multiple messages to the same person. For example, after sending a birthday message to a client and later client will send to their employees, the next message may not get delivered even though the system shows it as successful. Asking the client to reply once to re-enable the messaging seems to work initially, but after 2-3 messages, they stop receiving them. (happens with my current service provider) does twilio solves this?
@DiasporicRanger 10 күн бұрын
Legend
@AvigitMandal-d5z 15 күн бұрын
Does it require an active number, or can we test it using a trial Twilio account?
@TwilioDevs 14 күн бұрын
You should be able to try it out with a trial number. You'll need to call it rather than using the dev phone as shown in this video since that requires 2 Twilio numbers.
@vdreamteam8958 16 күн бұрын
Hello Devs! Is there a way to rebill our clients sub-accounts in our twilio account? and is there an option to put their card on the platform to charge them automatically?
@oyrfasdf 17 күн бұрын
It seams like this code cannot work using websockets version 14. can only use websockets 13
@arpitpatel7065 14 күн бұрын
Exactly! Your comment saved so much time
@EntertainmentDoseByAkash 21 күн бұрын
How can we integrate the knowledge base to this so that our voice assistant can answer referring to a given data source?
@bahubaliavenger472 24 күн бұрын
Hello sir, i did something similar in python flaks. But i am getting huge delay ( 5 second ) to download the audio file. From twilio. Any alternative please reply
@mohibahmed5098 25 күн бұрын
It doesn't handle interruptions while the AI is speaking. Am i missing something?
@TwilioDevs 25 күн бұрын
Check the repo that is linked in the description. We figured out how to add that after the video shipped. Thanks for watching!
@vactum0 25 күн бұрын
great!
@FintanDeveloper 29 күн бұрын
is it possible to make a call on my given number with this setup ?
@xiaomaye Ай бұрын
Hello, brother, do you have the contact information of Twilio sales manager?
@TwilioDevs Ай бұрын
Best course of action is through the Contact Sales form: www.twilio.com/en-us/help/sales
@xiaomaye Ай бұрын
@ Do you have WhatsApp contact information?
@fillypireuel Ай бұрын
You can use it like WhatsApp on BlackBerry10
@world_changers Ай бұрын
Man I love how grounded your explanations can get. Makes things simple enough for non-devs like me to understand
@thechannel8x Ай бұрын
Deployment? Great work, great explanation - what's the best place to deploy this? TW Services? Or that wouldn't work?
@TwilioDevs Ай бұрын
I usually leave out deployment since it can be a fairly personal choice and outside of the scope of the tutorial. That said, this code should work anywhere you can deploy a full Node.js app. Some popular options include Render (render.com), Railway (railway.app), DigitalOcean or building your own setup within a VPS. Lots of options out there! Thanks for watching and let us know if you need any further help.
@cherishsachdeva5186 Ай бұрын
On doing twilio dev-phone it overrides the webhook configuration. How will I test it then ?
@TwilioDevs Ай бұрын
I should have called this out properly in the video but for dev phone you need a second Twilio number. You can test by just calling from your phone. I used the dev phone because it was the easiest way to demo in the video (and is a cool tool to test with).
@PELUKA613 Ай бұрын
Great course, thanks. Does someone else get this error when login to CLI? Could not validate the provided credentials. Not saving.
@TwilioDevs Ай бұрын
Are you positive that you're providing the correct AccountSid and Auth Token to twilio login?
@PELUKA613 Ай бұрын
@@TwilioDevs hi, yes I am sure. At the end it was not the credentials but restrictions in the laptop, in a virtual machine it worked, thank you for quick reply
@suyashsaxena7320 Ай бұрын
Can we implement a caching layer here as the openai realtime api is too costly to use and I do not want to spend that much on a set of responses. Also I tested the realtime switching between English and Hindi and it worked flawlessly. I am open to any ideas.
@TwilioDevs Ай бұрын
I asked around internally: "Caching on the Realtime API is hard if not impossible but also realistically OpenAI has their own caching built in already which is reducing the effective cost already. I don't know if you can do things on top of that." You may want to look at Twilio's ConversationRelay which should provide a bit more flexibility since you control the LLM side of it. www.twilio.com/en-us/blog/conversationrelay-voice-ai-made-human While we don't have a video for it yet, we do have a reference implementation using AWS: www.twilio.com/en-us/blog/conversation-relay-aws-reference-architecture
@suyashsaxena7320 Ай бұрын
@ Thankyou for your help! I'll look into it and share my implementation if I figure it out
@arnabing Ай бұрын
This is awesome! I keep getting a busy signal when call the twilio number in my setup. I'm using free Ngrok, twilio (purchased a number). I can see Ngrok, and Uvicorn running in terminal and I'm getting "Twilio Media Stream Server is running!"
@timmymonsterai Ай бұрын
that face in the background though lol.
@TwilioDevs Ай бұрын
🗿
@Markmoody-dd6rz Ай бұрын
so how can i get this interrupt code?
@TwilioDevs Ай бұрын
It's in the repo: github.com/twilio-samples/speech-assistant-openai-realtime-api-node
@ziv4gamer Ай бұрын
Is there a way to trigger the first response without needing to say something first?
@TwilioDevs Ай бұрын
Check the GitHub repo. It has a "assistant speaks first" option in it that got added after this video was made.
@ziv4gamer Ай бұрын
Is there a way to trigger the first response without needing to say something first?
@TwilioDevs Ай бұрын
Check the GitHub repo. It has a "assistant speaks first" option in it that got added after this video was made.
@Gus_inc Ай бұрын
Is it possible to do rag in the middle of the conversation with this setup or is it only speach-to-speach?
@TwilioDevs Ай бұрын
Take a look at the function calling docs for the OpenAI Realtime API: platform.openai.com/docs/guides/realtime/overview?text-generation-quickstart-example=audio#function-calls
@bulutosman Ай бұрын
The repo in the description and the code in the video does not match
@TwilioDevs Ай бұрын
Hi! Yes, there have been improvements in the repo since the video was made.
@gioegiogcbr Ай бұрын
Great video! Can one interrupt the AI assistant while is talking?
@TwilioDevs Ай бұрын
Yes! If you check the repo there is an update for that: github.com/twilio-samples/speech-assistant-openai-realtime-api-python
@grzegorzgrodzki3855 Ай бұрын
Hi! Great video. I have a problem with setting a language other than English. transcription does not work as it should. Sometimes it changes the language to another and shows different words. How can I fix this?
@TwilioDevs Ай бұрын
Have you tried being very clear in the system prompt that it should always use the language you're trying to work with? I tried giving a prompt to only speak in Spanish and that the caller would always be Spanish and when I tried to insist to the assistant that I only spoke English, it wouldn't break out of Spanish.
@ShivanshKumar-007 Ай бұрын
does it makes inbound and outbound calls both or only outbound?
@TwilioDevs Ай бұрын
You can make outbound calls as well. Haven't finished a video for it but here's a blog post: www.twilio.com/en-us/blog/outbound-calls-python-openai-realtime-api-voice
@Rohan-o9w Ай бұрын
Can you make a Video on Using Twilio with Azure OpenAI Realtime API?
@riley_blackwell Ай бұрын
Thank you for creating this demo in python! As I am building a startup, I have come to realize how essential the Twilio platform is. 1. You need Stripe to collect payments from users 2. You need user authentication such as Oauth 3. You need to be able to communicate with your users and collect data about your users. That is where Twilio is essential with its communications apis and segment to collect user data and build profiles. Keep up the great work, and keep investing in the core communications and data products. 😊
@TwilioDevs Ай бұрын
Thank you for watching and for the kind words! Happy to be in your customer engagement toolbelt! Let us know if there's any other videos we could make that would be helpful.
@mspicela Ай бұрын
Thanks again for the tutorial. What is needed to make it possible to interrupt the AI? I think Twilio may be buffering received audio from OpenAI that it finishes playing even when interrupted. I tried several changes to try to fix things. I wonder if the audio from OpenAI is sent to twilio that is buffering it. Then when it is interrupted, that is why it still keeps playing what it's already received. Is there a way to tell twilio to stop playing what had already been sent when an interruption is detected. The Web only implementations with webrtc handle interruptions immediately just like the ChatGPT official app. I know phone networks have a delay but this is more than that is seems to keep talking for many seconds. Thank you in advance.
@TwilioDevs Ай бұрын
Hey hey! Check out this timestamp from our recent livestream where I helped Alex and Bianca add this (i'm the robot 😂). The timestamp starts at their first interaction with it where they see how the lack of interruptions impacts things and then we walk through how to add a version of interrupt to it: kzbin.info/www/bejne/lZrXo5WfqN-Zn6cfeature=shared&t=2843
@mspicela Ай бұрын
@@TwilioDevs Perfect and thank you! I watched the livestream recording and rebased my stuff on the newer version. It is working well now. What are you using to be a robot in the livestream?
@TwilioDevs Ай бұрын
@@mspicela Total custom build inside of OBS (obsproject.com). It's a pile of PNG files, a waveform generator for the mouth, and some subtle motion effects.
@TwilioDevs Ай бұрын
@@mspicela Also super glad you got it working! Let us know if there's anything else we can help with!
@mspicela Ай бұрын
Thank you for the tutorial. I built an AI phone agent/bot with this combined with function calling from OpenAI and it worked very well. Unfortunately, now I can no longer edit my phone numbers configuration -- "Voice configuration is unavailable for this phone number" -- but this isn't true because it lists my URL still and worked for days. To make things worse, the support spins and spins so I can't submit a trouble ticket.
@TwilioDevs Ай бұрын
Hi! Thanks for watching and I'm happy you built this. Sorry you're having trouble though (both with the app, and support). If you go here: help.twilio.com/ and ask a question, see if anything there helps resolve this. If not, there's a section at the bottom asking "Is this helpful?" and you can hit the thumbs down which will prompt you to either log in to submit a ticket or click the link next to it to submit a ticket without logging in. Once you have a ticket number, I can try to help escalate (no promises but worth a try!).
@TwilioDevs Ай бұрын
Hello Michael, Thank you for getting in touch with our Social Support Team. We sincerely apologize for the inconvenience caused. Could you please dm us the email address on file?
@mspicela Ай бұрын
@@TwilioDevs thank you for the reply. It's working now! I didn't do anything to change it but it resolved itself.
@TwilioDevs Ай бұрын
Awesome news! That's much easier to triage 😀 Glad it's working again!
@interestedinbread3634 2 ай бұрын
Came to this video while going through the teacher's notes for the beginner APIs video. This, the system path video, and the terminal video are all excellent. You've taken topics that are overwhelming and intimidating to learners and you've made them fun and approachable. This is a huge service, thank you
@TwilioDevs 2 ай бұрын
Thanks for watching! We're so glad this was helpful. Passing your comments along to Craig. He's over at Cloudflare now where he's continuing to make excellent educational content!
@interestedinbread3634 2 ай бұрын
@ thank you for passing it on! I wish him and your team all the best
@TwilioDevs Ай бұрын
Thank you so much! -Brent
@jjhonmoreno6357 2 ай бұрын
Hi, I am trying to send a message to my platform user in the USA but I can't I am getting this message, A2P 10DLC registration required for US messaging. A registration process will be required for each number sending SMS/MMS messages to the US. Initiate A2P 10DLC registration or Request CSV Report with your number status, do you have some videos how to do that, I need you help
@TwilioDevs 2 ай бұрын
Hi! You'll want to watch this one: Understanding US A2P 10DLC Registration kzbin.info/www/bejne/gYjZk4WKpLehfck
@johns332 2 ай бұрын
How would you personally set up a wait room if multiple users called?
@TwilioDevs 2 ай бұрын
On an upgraded business account you can have unlimited concurrent calls: help.twilio.com/articles/223180028-How-fast-can-I-place-or-receive-phone-calls-with-Twilio- If you did want to do a waiting room style concept you could use Twilio Queue: www.twilio.com/docs/voice/queue-calls
@pisgahmedia_20xx 2 ай бұрын
How do l get to connect to twilio to send WhatsApp text from Matlab?
@esek-2 2 ай бұрын
Is this still working? I got it to work some weeks ago, but strangely, it is not working anymore - When I call my Twilio Phone Number, in the nodejs output I get the event "input_audio_buffer.speech_started", and after I finished speaking, nothing happens, and the bot does not answer me.
@AbhishekMishra-db2tj 2 ай бұрын
Hey, I am also facing the same problem, did you find anything to solve this?
@TwilioDevs 2 ай бұрын
Should still be working, yes. We just were building again it on our livestream today and it was working.
@esek-2 2 ай бұрын
@@AbhishekMishra-db2tj Hey, somehow it does not properly detect when I finished speaking with my phone. When trying from a different phone, it worked. Not sure why that is the case.
@Anything-eb1wf 2 ай бұрын
I am deploying this thing in gcloud and trying to call the webhook through public url and calling the webhooks through call initiation . Up here it's saying the initial things but call is getting disconnected and saying websocket refusal error. Is there anybody in your team who could help me with this?
@ivant_true Ай бұрын
yep, I get the same
@Anything-eb1wf Ай бұрын
@ivant_true try ngrok approach . It solves
@punarvdinakar 2 ай бұрын
Any way we get the number to call us and still use the webhook?
@TwilioDevs 2 ай бұрын
So you want to be able to make the agent place a call?
@josefsieber6226 2 ай бұрын
@@TwilioDevs This relates to my use case - I would like it to make outbound calls. I also want to put controls on the responses, since it needs to perform specific actions for me.
@TwilioDevs 2 ай бұрын
@@josefsieber6226 I'm working on an outbound tutorial right now actually!
@TwilioDevs 2 ай бұрын
Yes, we are working on an outbound call tutorial right now.
@ryanam26 2 ай бұрын
@@TwilioDevs Hi, thanks for putting all of this together. I am using this as a starting point for an elderly companion app. For the outbound call tutorial, will it be an add-on to this code base, or will it be separate?
@ArtemBeliaev-y5q 2 ай бұрын
Thanks for the guide. Can you tell me how you called the same phone you use as an call receiver? When I setup "Dev phone" to test my app it reset the configuration of the phone number
@TwilioDevs 2 ай бұрын
Yeah you would need a second Twilio phone number for the Dev Phone. Probably easier to just call from your cellphone. I used the Dev Phone because it was easier to demo for the video.
@thefamousdjx 2 ай бұрын
Is this the same model as the one in chatgpt voice mode. Seems pretty dumb and lots of times doesnt understand what im saying and talks about something else completely irrelevant
@TwilioDevs 2 ай бұрын
This is a little bit different since you have some ways to control it. It has been pretty accurate and you can guide it with the system prompt as well as control the "temperature" which will control how much randomness it uses.
@thefamousdjx 2 ай бұрын
@@TwilioDevs I see. But I pretty much followed everything you did and its quite unusable for me. Will try again
@gamemonster9179 2 ай бұрын
Nice!Could u make it so that it can be in a website by like using cradio and python along with openai? If u do make this video,thank you in advance
@TwilioDevs 2 ай бұрын
I'll see if I can work something in. Thanks for watching!
@MarkPhippsAlway 2 ай бұрын
Can you share any modification that would be needed to have the AI assistant collaborate on an outgoing call?
@TwilioDevs 2 ай бұрын
Yes, we've been working on an outbound tutorial. Should have something for you soon.
@ConAim 2 ай бұрын
Listen to the voices and you can tell how she***tty is Twilio's prompt voice... :)
@PhoneGenieAI 2 ай бұрын
Interesting. Thanks, Bart. What's the best RAG solution for using and storing vector bindings in the Twilio / OpenAI ecosystem? Looking specifically for code examples.
@PhoneGenieAI 2 ай бұрын
RAG implementation is in Part II. Got it. Liked. Subscribed. Commented. 😀
@TwilioDevs 2 ай бұрын
Hey @PhoneGenieAI! Thanks for watching. We don't have a standalone RAG solution that you can use with the OpenAI Real-time API.
@TwilioDevs 2 ай бұрын
If you haven't checked it out yet though, take a look at Twilio AI Assistants. It won't work for this use case but worth exploring nonetheless: kzbin.info/www/bejne/inXZYYJoZdF2aa8
@aiplaygrounds 2 ай бұрын
What you need is functionality, you need to be able to use external API. I think it is to expensive at the moment, elevenlabs is working on voice agents as well but very limited. Great video. Thanks 🙏
@TwilioDevs 2 ай бұрын
Would you prefer to see this tutorial in Python? Check it out here: kzbin.info/www/bejne/hYfKpnVnnZKYitU