8000
Skip to content
#

BigQuery

Star
bigquery logo

Google BigQuery enables companies to handle large amounts of data without having to manage infrastructure. Google’s documentation describes it as a « serverless architecture (that) lets you use SQL queries to answer your organization’s biggest questions with zero infrastructure management. BigQuery’s scalable, distributed analysis engine lets you query terabytes in seconds and petabytes in minutes. » Its client libraries allow the use of widely known languages such as Python, Java, JavaScript, and Go. Federated queries are also supported, making it flexible to read data from external sources.

📖 A highly rated canonical book on it is « Google BigQuery: The Definitive Guide », a comprehensive reference.

Another enriching read on the subject is the inside story told in the article by the founding product manager of BigQuery celebrating its 10th anniversary.

Here are 71 public repositories matching this topic...

Language: HCL
Filter by language
All 3,900 Python 1,465 Jupyter Notebook 515 JavaScript 152 TypeScript 123 Go 118 HTML 89 Java 83 HCL 71 Shell 56 SQL 38
Sort: Most stars
Sort options
Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

ksmin23 / gcp-debezium-mysql-to-pubsub-bigquery

Star 5

A complete Terraform project for provisioning a real-time, Kafka-less Change Data Capture (CDC) pipeline on Google Cloud Platform. It captures data changes from a private Cloud SQL for MySQL instance using Debezium Server, streams them through Cloud Pub/Sub, and ingests them directly into BigQuery for real-time analytics.

bigquery google-cloud pubsub cdc data-pipeline debezium debezium-server kafka-less
  • Updated Mar 12, 2026
  • HCL

ksmin23 / gcp-datastream-dataflow-analytics

Star 3

This project provides a complete Terraform setup to automate the deployment of a real-time Change Data Capture (CDC) pipeline on Google Cloud. It streams data from a Cloud SQL for MySQL source to BigQuery, using Google Cloud Storage (GCS) as a staging area and a Dataflow streaming job for processing and enrichment.

bigquery terraform gcp google-cloud dataflow cdc data-pipeline real-time-analytics datastream
  • Updated Aug 27, 2025
  • HCL

Selim-Abouleila / Paris-Mobility-Pulse

Star 1

Real-time Paris mobility pipeline on GCP. Pub/Sub → Dataflow (Apache Beam) → BigQuery (raw/curated/marts) with DLQ & replay. dbt analytics engineering, Terraform IaC, CI quality gates (ruff/mypy/pytest), Looker Studio. Fully reproducible: make deploy from zero.

bigquery streaming terraform gcp google-cloud pubsub data-engineering iac dataflow apache-beam paris observability real-time-analytics velib cost-optimization cloud-scheduler cloud-run looker-studio
  • Updated Jul 14, 2026
  • HCL

Released May 19, 2010

Followers
88 followers
Repository
GoogleCloudPlatform/bigquery-utils
Website
github.com/topics/bigquery
Wikipedia
Wikipedia

Related topics

cloud-computing
0