Load a DataFrame to BigQuery with pandas-gbq
Stay organized with collections
Save and categorize content based on your preferences.
Use the pandas-gbq package to load a DataFrame to BigQuery.
Code sample
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License
, and code samples are licensed under the Apache 2.0 License
. For details, see the Google Developers Site Policies
. Java is a registered trademark of Oracle and/or its affiliates.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],[],[[["\u003cp\u003eThis content demonstrates how to use the \u003ccode\u003epandas-gbq\u003c/code\u003e package to load a pandas DataFrame into a BigQuery table.\u003c/p\u003e\n"],["\u003cp\u003eYou must set up Application Default Credentials to authenticate with BigQuery before running the provided code.\u003c/p\u003e\n"],["\u003cp\u003eThe code sample requires you to set your Google Cloud Platform project ID and the destination table ID within BigQuery.\u003c/p\u003e\n"],["\u003cp\u003eThe example creates a sample DataFrame containing string, integer, float, boolean, and date data types before using the pandas_gbq library to push the data to a BigQuery table.\u003c/p\u003e\n"],["\u003cp\u003eFor additional usage of the google cloud libraries, you can explore the Google Cloud Sample Browser for more code.\u003c/p\u003e\n"]]],[],null,["# Load a DataFrame to BigQuery with pandas-gbq\n\nUse the pandas-gbq package to load a DataFrame to BigQuery.\n\nCode sample\n-----------\n\n### Python\n\n\nBefore trying this sample, follow the Python setup instructions in the\n[BigQuery quickstart using\nclient libraries](/bigquery/docs/quickstarts/quickstart-client-libraries).\n\n\nFor more information, see the\n[BigQuery Python API\nreference documentation](/python/docs/reference/bigquery/latest).\n\n\nTo authenticate to BigQuery, set up Application Default Credentials.\nFor more information, see\n\n[Set up authentication for client libraries](/bigquery/docs/authentication#client-libs).\n\n import pandas\n import pandas_gbq\n\n # TODO: Set project_id to your Google Cloud Platform project ID.\n # project_id = \"my-project\"\n # TODO: Set table_id to the full destination table ID (including the\n # dataset ID).\n # table_id = 'my_dataset.my_table'\n\n df = pandas.DataFrame(\n {\n \"my_string\": [\"a\", \"b\", \"c\"],\n \"my_int64\": [1, 2, 3],\n \"my_float64\": [4.0, 5.0, 6.0],\n \"my_bool1\": [True, False, True],\n \"my_bool2\": [False, True, False],\n \"my_dates\": pandas.date_range(\"now\", periods=3),\n }\n )\n\n pandas_gbq.to_gbq(df, table_id, project_id=project_id)\n\nWhat's next\n-----------\n\n\nTo search and filter code samples for other Google Cloud products, see the\n[Google Cloud sample browser](/docs/samples?product=bigquery)."]]
