Integrations
Integrate with your BigQuery data warehouse.
Chalk has an integration with BigQuery that makes it easy to read queries and tables into your feature store.
To use BigQuery in your resolvers, you first need to add the Chalk GCP integration to the environments where you would like to use BigQuery.
When querying your BigQuery data source, Chalk will push down filters on top of your
queries to optimize the amount of data read from your tables. For larger queries, rather than
interpolating values directly in the SQL string for the query, which has length limits in
BigQuery, Chalk will use a table to temporarily hold the values against which to query.
As such, we require bigquery.tables.create and bigquery.jobs.create permissions to
create and use these temporary tables.
Chalk’s BigQuery integration can be used as a SQL source.
from chalk.sql import BigQuerySource
bq = BigQuerySource()
@online
def fn(...) -> ...:
return bq.query(...).first()