High Data Egress for Airbytes exporter
🪲Bug Report📊Dashboard❔Advice
Hey all,
I've upgrade to the pro plan to take advantage of the data export features but I noticed very high egress data usage on a very small database. We only have a few mb of data in our database yet the export process has somehow used a few gbs. The airbytes timeline shows relatively small chunks of data being transferred. Granted, we are streaming data every 1 hour but even this isn't as fast as I would like (in prod we would move to 15m updates). Is this just a beta issue and is planned to be fixed? ~2GB of egress is fine for now, but again, this is on a very very small dataset so the moment we reach production scale I don't see how this would not grow rapidly out of hand.
I've upgrade to the pro plan to take advantage of the data export features but I noticed very high egress data usage on a very small database. We only have a few mb of data in our database yet the export process has somehow used a few gbs. The airbytes timeline shows relatively small chunks of data being transferred. Granted, we are streaming data every 1 hour but even this isn't as fast as I would like (in prod we would move to 15m updates). Is this just a beta issue and is planned to be fixed? ~2GB of egress is fine for now, but again, this is on a very very small dataset so the moment we reach production scale I don't see how this would not grow rapidly out of hand.
