Create a BigQuery DataFrame from a CSV file in GCS
Stay organized with collections
Save and categorize content based on your preferences.
Use the BigQuery DataFrames API to turn a CSV file in Google Cloud Storage into a BigQuery DataFrame.
Code sample
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License
, and code samples are licensed under the Apache 2.0 License
. For details, see the Google Developers Site Policies
. Java is a registered trademark of Oracle and/or its affiliates.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],[],[[["\u003cp\u003eThe BigQuery DataFrames API can be used to transform a CSV file stored in Google Cloud Storage into a BigQuery DataFrame.\u003c/p\u003e\n"],["\u003cp\u003eThe \u003ccode\u003ebpd.read_csv()\u003c/code\u003e function is used to read the CSV file from Google Cloud Storage, with the file path specified as a parameter.\u003c/p\u003e\n"],["\u003cp\u003eAuthentication to BigQuery can be achieved by setting up Application Default Credentials, following the provided guide for client libraries.\u003c/p\u003e\n"],["\u003cp\u003eThe code example uses the \u003ccode\u003ebigframes.pandas\u003c/code\u003e library and displays the first few rows of the created DataFrame with \u003ccode\u003edf_from_gcs.head()\u003c/code\u003e.\u003c/p\u003e\n"]]],[],null,["# Create a BigQuery DataFrame from a CSV file in GCS\n\nUse the BigQuery DataFrames API to turn a CSV file in Google Cloud Storage into a BigQuery DataFrame.\n\nCode sample\n-----------\n\n### Python\n\n\nBefore trying this sample, follow the Python setup instructions in the\n[BigQuery quickstart using\nclient libraries](/bigquery/docs/quickstarts/quickstart-client-libraries).\n\n\nFor more information, see the\n[BigQuery Python API\nreference documentation](/python/docs/reference/bigquery/latest).\n\n\nTo authenticate to BigQuery, set up Application Default Credentials.\nFor more information, see\n\n[Set up authentication for client libraries](/bigquery/docs/authentication#client-libs).\n\n import bigframes.pandas as bpd\n\n filepath_or_buffer = \"gs://cloud-samples-data/bigquery/us-states/us-states.csv\"\n df_from_gcs = bpd.read_csv(filepath_or_buffer)\n # Display the first few rows of the DataFrame:\n df_from_gcs.head()\n\nWhat's next\n-----------\n\n\nTo search and filter code samples for other Google Cloud products, see the\n[Google Cloud sample browser](/docs/samples?product=bigquery)."]]
