Hey is it possible to get the timeout
Hey, is it possible to get the timeout for my HTTPS endpoints increased? The endpoint calls a GPT model and takes a little while to execute. This is critical to get my product working. I actually had it increased earlier for Treehacks but I think it got set back.
4 Replies
I tried reordering my endpoint so there would be one that you call to start the task, then another so you can keep checking in on it, but I found that even if you don't await an action the endpoint won't return until everything is complete.
Funny thing is that all of the code in the endpoint does execute, and the logs say that a 200 response is being sent, but looking at the response on Burp you can tell that a 408 timeout response is being sent by the server right before it finishes, every time it is called.
Honestly, given the timing of the 408s I'm wondering if it's not actually a timeout but somehow something deeper. The 408 gets received milliseconds after the 200 OK response is sent out. This happens regardless of whether it took 15 or 30 seconds to do so. There's no errors in the console.
hey @OccultSlolem, sorry for this! we had done a hack for treehacks + have been working on a proper fix, and the hack got lost in the mix. I'll put it back in right now 🙂
as you've noticed, there's a lot of oddities with timeout enforcement with the hack, so that's why it's been more than just changing a constant on our side.
okay, I increased it back to 2m for the two deployments from https://discord.com/channels/1019350475847499849/1076808610602025020/1076864742519484416
let me know if that works on your side! and sorry for breaking your app. we'll have the proper fix out shortly.
Lolol thanks! It would be cool if you could set your own custom timeout.
@OccultSlolem, I just pushed out the more robust timeout fix. let me know if you run into any more issues!