PRODUCTION ERROR
My production environment has been down for a long time (at least 40 minutes).
The dashboard doesn't work. The websocket doesn't connect from the application site. The Discord community is unresponsive. The website doesn't reflect this production outage.
This is alarming to me. Paying customer.
18 Replies
Thanks for posting in <#1088161997662724167>.
Reminder: If you have a Convex Pro account, use the Convex Dashboard to file support tickets.
- Provide context: What are you trying to achieve, what is the end-user interaction, what are you seeing? (full error message, command output, etc.)
- Use search.convex.dev to search Docs, Stack, and Discord all at once.
- Additionally, you can post your questions in the Convex Community's <#1228095053885476985> channel to receive a response from AI.
- Avoid tagging staff unless specifically instructed.
Thank you!
oh hi let's continue here. can you share your deployment name so we can look into it closely?
Hello! api.dCH3oAPU.js:2 WebSocket connection to 'wss://unique-rabbit-469.convex.cloud/api/1.17.0/sync' failed:
Now it actually seems to fail for my test environment too in the same way.
thanks! we're looking into it
Probably irrelevant, but both Safari and Chrome have warnings like this on the sites.
yeah i'm seeing those too. it's happening even on convex apps whose websockets seem to be working (like https://convex-chess.vercel.app/ works but chrome marks its convex urls http://wandering-fish-513.convex.cloud/ as dangerous). still looking. thank you for flagging
Convex + Next.js + Convex Auth
Generated by npm create convex
@COCPORN can you confirm that you're running into the availability issue on both your local ISP and also tethered over a mobile network? want to isolate any network impact
I only have access to a single network right now. Are you not seeing the same thing as me?
I'll be on a call in 30-ish minutes, I can have my call collaborator test from his end.
we are able to access your backend ok, do you have a link to your actual application i can try?
feel free to delete those links now if you don't want your unlaunched service on here yet
i checked the network tab and the websocket is connecting for me
so i think this might be network dependent
That is a good indication that this is "just me", sorry for crying wolf here. What could be the reason for this?
oh it might not be "just you"
i think it's possible an ISP is flagging the link somewhere
we'll keep digging
Thank you so much for looking into it. I am arguably not on the best network to test this, nor report this right now. As a thank you for your efforts I will be gifting you a year's full access to 6digit studio, soon to be released on un unsuspecting public.
š
@COCPORN see here ( https://discord.com/channels/1019350475847499849/1019350478817079338/1339294418603081771 ) for updates
Hey, I got a VPN and just from the first node in that VPN I tested, it works again, so this could be extremely local to me for all I know. Sorry about the wolf-crying and the FUD.
I would obviously love to see it work without having to use a VPN, so if you figure it out that would be great. "Everything else" works here, so it is definitely something that would be nice to have fixed.
Now it's working again without VPN.
that's great news!
a security vendor called fortinet had convex.cloud flagged and has since removed that
i'm still working with two other vendors but it looks like you might be in good shape now
Thank you so much for fixing it!