Unfortunately Convex does not directly
Unfortunately, Convex does not directly provide a SQL interface, so it's not possible to use it in this way. There is one solution now, and one we may ship down the road a bit: (1) today, you can use Airbyte or now Fivetran to create a streaming replica of your Convex project in a SQL-oriented system like snowflake, postgresql, bigtable, clickhouse, whatever. This tool can be hooked up to whatever 3rd party things (CMS, BI, etc) want a SQL interface; (2) some point down the road we are considering exposing a sql interface that will be a read-only slightly stale replica, possibly built on duckdb. That would make this possible without any set up, as long as you don't require the ability to mutate data and don't need the data to be fully consistent with transactions
6 Replies
Okay, I searched out Airbyte and Fivetran. Now I am not able to understand how the flow goes do these technologies provide connection string? One thing I understand is I need to replicate my data so, it is stored on Convex as well as on Fivetran. I asked perplexity AI and this is what I got Here are the steps to set up Fivetran to replicate a Convex project:
Sign up for Fivetran by going to https://fivetran.com/signup and entering your information. Verify your email to enter a guided setup process.
In the Fivetran dashboard, click on "Connectors" and search for "Convex". Select the Convex connector and follow the prompts to set up a connection between your Convex project and Fivetran.
In the connector setup form, enter your Convex project's deployment URL and the generated deploy key into the appropriate fields.
Choose your destination database and schema, and select the tables you want to replicate.
Review and test your setup, and then activate the connector to start replicating data from your Convex project to your destination.
Fivetran uses change data capture (CDC) to efficiently replicate large volumes of data from your databases to your destinations, and supports log-based CDC and log-free database replication with teleport sync. By faithfully replicating source data with as few transformations as necessary to make it useful, Fivetran automatically maps internal data structures to the destination schema, making it easy to use with third-party tools like ORMs and CMSs
Now, explain to me as I am a 5-year-old child what I do and what should be the path. Also, on Fivetran I can't find any connector for Convex https://www.fivetran.com/connectors?q=convex&noresults=true might be I am looking in the wrong place. Please elaborate on this as well, "Today, you can use Airbyte or Fivetran to create a streaming replica of your Convex project in a SQL-oriented system like Snowflake, PostgreSQL, BigTable, Clickhouse, or whatever. This tool can be hooked up to whatever 3rd party things (CMS, BI, etc.) want an SQL interface"
Data Sources | Connector Directory | Fivetran
What data sources and warehouses does Fivetran support? Visit our connector directory for updated lists of applications, databases, events, files, and more.
@Syed Sheharyar for now, airbyte is better supported than fivetran. this will probably change in a week or two. but for now, the best resource to get your data streaming from convex to postgres or anything else is to read through this: https://docs.convex.dev/database/import-export/airbyte
Using Convex with Airbyte | Convex Developer Hub
Analyze your Convex data by exporting via Airbyte.
but before you spend much time on it, is the CMS expecting to edit content in Convex as well?
Yes! Directus CMS https://directus.io markets itself as a data engine that sits on top of any SQL db and provides a clean CMS-like interface where we create tables edit content and do a lot more than this. Editing is a requirement for example editing a Post in Post table through CMS. It also provides HTTP and GraphQL APIs. Data can be mutatable through these autogenerated APIs as well.
Directus: The Modern Data Stack, Democratized
Directus is the world's first Open Data Platform for instantly turning any SQL database into an API and beautiful no-code app.
thanks for the clarification. then yes, I can unfortunately confirm that Convex will not work underneath directus