🔴 Production down — finish_push fails with TooManyReads, all functions wiped
🪲Bug Report
Problem: After a successful deploy earlier today, all subsequent deploys fail on finish_push. The first failed deploy wiped all
functions — production shows "Could not find public function" for everything including auth:signIn. Users cannot log in.
Error:
Error fetching POST /api/deploy2/finish_push
400 Bad Request: TooManyReads: Hit an error while pushing:
Too many reads in a single function execution (limit: 4096).
Consider using smaller limits in your queries, paginating your queries,
or using indexed queries with a selective index range expressions.
What happens during deploy:
-
"No indexes are deleted by this push"
- Uploading functions — success
- TypeScript — success
- Pushing code — success
- Schema validation complete
-
Finalizing push — TooManyReads
Setup:
- 15 @convex-dev/aggregate components in convex.config.ts
- ~570 indexes across 22 schema files
- Convex CLI 1.34.0
- Dev deployment works fine (same code, less data)
What we tried:
- Multiple retry attempts over 3+ hours
- Updated CLI from 1.32.0 to 1.34.0
- schemaValidation: false — same error
- Debug logging — no additional info about which function fails
- One deploy DID succeed earlier, but all subsequent ones fail
Timeline:
1. Deployed successfully — some indexes were rebuilt
2. Made a small schema fix (removed duplicate cancelled literal)
3. Deployed successfully again — more indexes cleaned up
4. All subsequent deploys fail with TooManyReads
5. Functions are now completely gone from prod
Question: Can you help complete the push, or tell us which internal function is exceeding the read limit so we can fix it? We
can't see which function causes the TooManyReads — the error doesn't include a function name.
Impact: Production is fully down. No functions are serving. ~5 active workspaces affected
functions — production shows "Could not find public function" for everything including auth:signIn. Users cannot log in.
Error:
Error fetching POST /api/deploy2/finish_push
400 Bad Request: TooManyReads: Hit an error while pushing:
Too many reads in a single function execution (limit: 4096).
Consider using smaller limits in your queries, paginating your queries,
or using indexed queries with a selective index range expressions.
What happens during deploy:
-
"No indexes are deleted by this push"-
Uploading functions — success-
TypeScript — success-
Pushing code — success-
Schema validation complete-
Finalizing push — TooManyReadsSetup:
- 15 @convex-dev/aggregate components in convex.config.ts
- ~570 indexes across 22 schema files
- Convex CLI 1.34.0
- Dev deployment works fine (same code, less data)
What we tried:
- Multiple retry attempts over 3+ hours
- Updated CLI from 1.32.0 to 1.34.0
- schemaValidation: false — same error
- Debug logging — no additional info about which function fails
- One deploy DID succeed earlier, but all subsequent ones fail
Timeline:
1. Deployed successfully — some indexes were rebuilt
2. Made a small schema fix (removed duplicate cancelled literal)
3. Deployed successfully again — more indexes cleaned up
4. All subsequent deploys fail with TooManyReads
5. Functions are now completely gone from prod
Question: Can you help complete the push, or tell us which internal function is exceeding the read limit so we can fix it? We
can't see which function causes the TooManyReads — the error doesn't include a function name.
Impact: Production is fully down. No functions are serving. ~5 active workspaces affected
