BigQuery
Google BigQuery enables companies to handle large amounts of data without having to manage infrastructure. Google’s documentation describes it as a « serverless architecture (that) lets you use SQL queries to answer your organization's biggest questions with zero infrastructure management. BigQuery's scalable, distributed analysis engine lets you query terabytes in seconds and petabytes in minutes. » Its client libraries allow the use of widely known languages such as Python, Java, JavaScript, and Go. Federated queries are also supported, making it flexible to read data from external sources.
📖 A highly rated canonical book on it is « Google BigQuery: The Definitive Guide », a comprehensive reference.
Another enriching read on the subject is the inside story told in the article by the founding product manager of BigQuery celebrating its 10th anniversary.
Here are 27 public repositories matching this topic...
Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.
- Updated
May 11, 2025 - Scala
Google BigQuery support for Spark, Structured , SQL, and DataFrames with easy Databricks integration.
- Updated
May 8, 2023 - Scala
Shapeless utilities for common data types
- Updated
May 6, 2025 - Scala
EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for running complex Auditable workflows which can interact with Google Cloud Platform, AWS, Kubernetes, Databases, SFTP servers, On-Prem Systems and more.
- Updated
Aug 26, 2024 - Scala
Export PostgreSQL tables to Google BigQuery
- Updated
Jun 14, 2021 - Scala
Google BigQuery data source for Apache Spark
- Updated
Oct 1, 2024 - Scala
A library to transform Scala product types and Schemes from different systems into other Schemes. Any implemented type automatically gets methods to convert it into the rest of the types and vice versa. E.g: a Spark Schema can be transformed into a BigQuery table.
- Updated
Apr 30, 2025 - Scala
Cross-platform JVM/JS Google Cloud Platform integrations for fs2 and friends
- Updated
Jan 10, 2024 - Scala
Spark BigQuery Parallel
- Updated
Jan 24, 2019 - Scala
- Updated
Oct 23, 2019 - Scala
Gateway server that provides an OData interface to BigQuery and Elasticsearch
- Updated
Oct 26, 2023 - Scala
(Script) Generates SQL query that selects all fields (recursively for nested fields) from the provided BigQuery schema file.
- Updated
Aug 31, 2024 - Scala
A sample demo to check latest spark, big query connector and scala 2.12
- Updated
May 26, 2021 - Scala
Released May 19, 2010
- Followers
- 60 followers
- Repository
- GoogleCloudPlatform/bigquery-utils
- Website
- cloud.google.com/bigquery
- Wikipedia
- Wikipedia