Li got a question: how would I sync an
i got a question: how would I sync an external list to the convex DB?
I have a Substack newsletter that I'd like to keep track of their subscription status (mainly free vs paid) in my Convex app.
I have setup an automation where I'm able to download, every hour, an updated CSV with all my subscribers and their status. Now I'm thinking how I will keep that CSV in a Convex table or be able to reference its data.
It's ok that the data is not realtime, as the CSV is only updated every hour, thought not ideal.
Approaches I thought of:
- Create an cronjob action that will download the subscriptions CSV, and iterate over it every time to update a table called
- Create a cronjob action that will download the subscriptions CSV and upload it to Convex using file storage Then, I need to always download the file whenever I need to check subscription status
- Move off substack and use something more dev-friendly, with some sort of webhook to keep track of subscriptions
i'd love any thoughts on this!
I have a Substack newsletter that I'd like to keep track of their subscription status (mainly free vs paid) in my Convex app.
I have setup an automation where I'm able to download, every hour, an updated CSV with all my subscribers and their status. Now I'm thinking how I will keep that CSV in a Convex table or be able to reference its data.
It's ok that the data is not realtime, as the CSV is only updated every hour, thought not ideal.
Approaches I thought of:
- Create an cronjob action that will download the subscriptions CSV, and iterate over it every time to update a table called
subscriptions. What I don't like: seems to be I'll be updating 1k+ records every hour, most of the time without any changes- Create a cronjob action that will download the subscriptions CSV and upload it to Convex using file storage Then, I need to always download the file whenever I need to check subscription status
- Move off substack and use something more dev-friendly, with some sort of webhook to keep track of subscriptions
i'd love any thoughts on this!
