Pete•2w ago

Dev environment stuck in a timeout loop.

My dashboard and entire dev environment are stuck in a timeout loop. The dashboard has been showing a loading spinner for over 10 minutes and the console just repeats

Attempting reconnect in 573ms
WebSocket reconnected at t=405.7s after disconnect due to InternalServerError

Attempting reconnect in 573ms
WebSocket reconnected at t=405.7s after disconnect due to InternalServerError

When I run npx convex dev locally, my server logs [CONVEX M(crons:recover)] Your request timed out. over and over. I am able to switch to the production environment using the dropdown in the header and that loads just fine. I am pretty sure this is being caused by an internalMutation I was working on because it froze up right after I executed the mutation from the dashboard. Is there any way to cancel this internalMutation via CLI? I would have expected the dashboard to recover by now, how long should I expect? I've seen this issue crop up in discord a few times but I haven't seen any resolutions

7 Replies

ari•2w ago

Hi @Pete, can you try running a Convex network test? https://network-test.previews.convex.dev/

PeteOP•2w ago

Sorry I forgot to mention that I did that All greens on the website npx convex network-test shows this

✔ OK: DNS lookup => 52.200.179.149:ipv4 (5.38ms)
✔ OK: TCP connect (39.22ms)
✔ OK: TCP connect (40.08ms)
✔ OK: HTTP check (81.63ms)
✖ FAIL: HTTPS check (Error: Error fetching  https://convex-project-slug.convex.cloud/instance_name 503 Service Unavailable: ServiceUnavailable: Service temporarily unavailable)

✔ OK: DNS lookup => 52.200.179.149:ipv4 (5.38ms)
✔ OK: TCP connect (39.22ms)
✔ OK: TCP connect (40.08ms)
✔ OK: HTTP check (81.63ms)
✖ FAIL: HTTPS check (Error: Error fetching  https://convex-project-slug.convex.cloud/instance_name 503 Service Unavailable: ServiceUnavailable: Service temporarily unavailable)

ari•2w ago

Got it, thanks. This looks related to the current incident here, affecting a subset of convex deployments: https://status.convex.dev/

Convex Status

Welcome to Convex's home for real-time and historical data on system performance.

ari•2w ago

The team is investigating now

PeteOP•2w ago

thank you, I should have checked that first

ari•2w ago

No worries, there should be an update on the status page when things are back to normal. It looks like the affected deployments on paid plans are back up and free ones should be back up shortly

Ivan•2w ago

Good afternoon, my project in “Development” status is not loading. I have been waiting for a while and it is not loading. This is not happening in the “Production” instance, where the project loads correctly.

Dev environment stuck in a timeout loop.

Did you find this page helpful?