Development Status
- 5 - Production/Stable
Intended Audience
- Developers
License
- OSI Approved :: Apache Software License
Programming Language
- Python
- Python :: 3
- Python :: 3.10
- Python :: 3.11
- Python :: 3.12
- Python :: 3.13
- Python :: 3.14
Operating System
- OS Independent
Topic
- Internet
BigQuery DataFrames (also known as BigFrames) provides a Pythonic DataFrame and machine learning (ML) API powered by the BigQuery engine. It provides modules for many use cases, including:
bigframes.pandas is a pandas API for analytics. Many workloads can be migrated from pandas to bigframes by just changing a few imports.
bigframes.ml is a scikit-learn-like API for ML.
bigframes.bigquery.ai are a collection of powerful AI methods, powered by Gemini.
BigQuery DataFrames is an open-source package.
Getting started with BigQuery DataFrames
The easiest way to get started is to try the BigFrames quickstart in a notebook in BigQuery Studio.
To use BigFrames in your local development environment,
Run pip install --upgrade bigframes to install the latest version.
Setup Application default credentials for your local development environment enviroment.
Use the bigframes package to query data.
import bigframes.pandas as bpd
bpd.options.bigquery.project = your_gcp_project_id # Optional in BQ Studio.
bpd.options.bigquery.ordering_mode = "partial" # Recommended for performance.
df = bpd.read_gbq("bigquery-public-data.usa_names.usa_1910_2013")
print(
df.groupby("name")
.agg({"number": "sum"})
.sort_values("number", ascending=False)
.head(10)
.to_pandas()
)Documentation
To learn more about BigQuery DataFrames, visit these pages
License
BigQuery DataFrames is distributed with the Apache-2.0 license.
It also contains code derived from the following third-party packages:
For details, see the third_party directory.
Contact Us
For further help and provide feedback, you can email us at bigframes-feedback@google.com.
Wheel compatibility matrix
Files in release
cloudpickle
(>=2.0.0)
fsspec
(>=2023.3.0)
gcsfs
(!=2025.5.0,!=2026.2.0,!=2026.3.0,>=2023.3.0)
geopandas
(>=0.12.2)
google-auth
(<3.0,>=2.15.0)
google-cloud-bigquery[pandas,bqstorage]
(>=3.36.0)
google-cloud-bigquery-storage
(<3.0.0,>=2.30.0)
google-cloud-functions
(>=1.12.0)
google-cloud-bigquery-connection
(>=1.12.0)
google-cloud-resource-manager
(>=1.10.3)
google-cloud-storage
(>=2.0.0)
google-crc32c
(<2.0.0,>=1.0.0)
grpc-google-iam-v1
(>=0.14.2)
numpy
(>=1.24.0)
pandas
(>=1.5.3)
pandas-gbq
(>=0.26.1)
pyarrow
(>=15.0.2)
pydata-google-auth
(>=1.8.2)
requests
(>=2.27.1)
shapely
(>=1.8.5)
tabulate
(>=0.9)
humanize
(>=4.6.0)
matplotlib
(>=3.7.1)
db-dtypes
(>=1.4.2)
pyiceberg
(>=0.7.1)
atpublic
(<6,>=2.3)
python-dateutil
(<3,>=2.8.2)
pytz
(>=2022.7)
toolz
(<2,>=0.11)
typing-extensions
(<5,>=4.5.0)
rich
(<14,>=12.4.4)