Stay organized with collectionsSave and categorize content based on your preferences.
Use third party transfers
Third party transfers for BigQuery Data Transfer Service allow you to automatically
schedule and manage recurring load jobs for external data sources such as
Salesforce CRM, Adobe Analytics, and Facebook Ads.
Ensure that the person creating the transfer has the following required
permissions in BigQuery:
bigquery.transfers.updatepermissions to create the transfer
Bothbigquery.datasets.getandbigquery.datasets.updatepermissions on
the target dataset
Thebigquery.adminpredefined IAM role
includesbigquery.transfers.update,bigquery.datasets.updateandbigquery.datasets.getpermissions. For more information on
IAM roles in BigQuery Data Transfer Service, seeAccess control.
Consult the documentation for your third party data source to ensure you have
configured any permissions necessary to enable the transfer.
If you intend to setup transfer run notifications for Pub/Sub, you
must havepubsub.topics.setIamPolicypermissions. Pub/Sub
permissions are not required if you just set up email notifications. For more
information, seeBigQuery Data Transfer Service run notifications.
Limitations
Third party transfers are subject to the following limitations:
You must create or update a third party transfer by using the
Google Cloud console.
Currently, you cannot configure or update a third party transfers by using the
bq command-line tool.
Set up a third party data transfer
To create a third party data transfer by using the Google Cloud console:
On the documentation page for the third party provider, clickEnroll. The enrollment process may take a moment.
After the enrollment is complete, clickConfigure Transfer.
On theCreate Transferpage:
ForSource, choose the appropriate third party data source. You can
clickExplore Data Sourcesto see the list of third party providers
in the Google Cloud Marketplace.
ForDisplay name, enter a name for the transfer such asMy Transfer.
The transfer name can be any value that allows you to easily identify the
transfer if you need to modify it later.
ForSchedule, leave the default value (Start now) or clickStart at a set time.
ForRepeats, choose an option for how often to run the transfer.
Options include:
Daily (default)
Weekly
Monthly
Custom
On-demand
If you choose an option other than Daily, additional options are
available. For example, if you choose Weekly, an option appears for
you to select the day of the week.
ForStart date and run time, enter the date and time to start the
transfer. If you chooseStart now, this option is disabled.
ForDestination dataset, choose the dataset you created to store your
data.
(Optional) In theNotification optionssection:
Click the toggle to enable email notifications. When you enable this
option, the transfer administrator receives an email notification when a
transfer run fails.
ForSelect a Pub/Sub topic, choose yourtopicname or clickCreate a topicto create one. This option configures
Pub/Sub runnotificationsfor your transfer.
ClickConnect Source.
When prompted, clickAcceptto give the BigQuery Data Transfer Service permission
to connect to the data source and to manage your data in
BigQuery.
Follow the instructions in the subsequent pages to configure the connection
to your external data source.
After you complete the configuration steps, clickSave.
Troubleshoot third party transfer setup
If you are having issues setting up your transfer, consult the appropriate third
party vendor. Contact information is available on the transfer's documentation
page in the Google Cloud Marketplace.
Query your data
When your data is transferred to BigQuery, the data is
written to ingestion-time partitioned tables. For more information, seeIntroduction to partitioned tables.
If you query your tables directly instead of using the auto-generated views, you
must use the_PARTITIONTIMEpseudocolumn in your query. For more information,
seeQuerying partitioned tables.
For information on using transfers including getting information about a
transfer configuration, listing transfer configurations, and viewing a
transfer's run history, seeWorking with transfers.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2025-09-04 UTC."],[[["\u003cp\u003eThird party transfers in BigQuery Data Transfer Service enable automated, recurring data loading from external sources like Salesforce CRM, Adobe Analytics, and Facebook Ads.\u003c/p\u003e\n"],["\u003cp\u003eBefore creating a third party transfer, you must have enabled BigQuery Data Transfer Service, created a BigQuery dataset, and ensured proper permissions like \u003ccode\u003ebigquery.transfers.update\u003c/code\u003e and \u003ccode\u003ebigquery.datasets.update\u003c/code\u003e on the dataset.\u003c/p\u003e\n"],["\u003cp\u003eThird party transfers must be created or updated through the Google Cloud console, as they are not currently supported by the bq command-line tool.\u003c/p\u003e\n"],["\u003cp\u003eSetting up a third party transfer involves navigating to the Google Cloud Marketplace, selecting a provider, enrolling, configuring the transfer settings, connecting to the data source, and saving.\u003c/p\u003e\n"],["\u003cp\u003eTransferred data is written to ingestion-time partitioned tables in BigQuery, which requires using the \u003ccode\u003e_PARTITIONTIME\u003c/code\u003e pseudocolumn when querying directly.\u003c/p\u003e\n"]]],[],null,["# Use third party transfers\n=========================\n\nThird party transfers for BigQuery Data Transfer Service allow you to automatically\nschedule and manage recurring load jobs for external data sources such as\nSalesforce CRM, Adobe Analytics, and Facebook Ads.\n\nBefore you begin\n----------------\n\nBefore you create a third party data transfer:\n\n- Verify that you have completed all actions required to [enable the BigQuery Data Transfer Service](/bigquery/docs/enable-transfer-service).\n- [Create a BigQuery dataset](/bigquery/docs/datasets) to store the data.\n- Ensure that the person creating the transfer has the following required\n permissions in BigQuery:\n\n - `bigquery.transfers.update` permissions to create the transfer\n - Both `bigquery.datasets.get` and `bigquery.datasets.update` permissions on the target dataset\n\n The `bigquery.admin` predefined IAM role\n includes `bigquery.transfers.update`, `bigquery.datasets.update` and\n `bigquery.datasets.get` permissions. For more information on\n IAM roles in BigQuery Data Transfer Service, see\n [Access control](/bigquery/docs/access-control).\n- Consult the documentation for your third party data source to ensure you have\n configured any permissions necessary to enable the transfer.\n\n- If you intend to setup transfer run notifications for Pub/Sub, you\n must have `pubsub.topics.setIamPolicy` permissions. Pub/Sub\n permissions are not required if you just set up email notifications. For more\n information, see\n [BigQuery Data Transfer Service run notifications](/bigquery/docs/transfer-run-notifications).\n\nLimitations\n-----------\n\nThird party transfers are subject to the following limitations:\n\n- You must create or update a third party transfer by using the Google Cloud console.\n- Currently, you cannot configure or update a third party transfers by using the bq command-line tool.\n\nSet up a third party data transfer\n----------------------------------\n\nTo create a third party data transfer by using the Google Cloud console:\n\n1. Go to the Google Cloud Marketplace.\n\n [Go to the Google Cloud Marketplace](https://console.cloud.google.com/marketplace/browse?filter=category:data-transfer-services)\n2. Click the appropriate third party provider.\n\n3. On the documentation page for the third party provider, click\n **Enroll**. The enrollment process may take a moment.\n\n4. After the enrollment is complete, click **Configure Transfer**.\n\n5. On the **Create Transfer** page:\n\n - For **Source** , choose the appropriate third party data source. You can\n click **Explore Data Sources** to see the list of third party providers\n in the Google Cloud Marketplace.\n\n - For **Display name** , enter a name for the transfer such as `My Transfer`.\n The transfer name can be any value that allows you to easily identify the\n transfer if you need to modify it later.\n\n - For **Schedule** , leave the default value (**Start now** ) or click\n **Start at a set time**.\n\n - For **Repeats**, choose an option for how often to run the transfer.\n Options include:\n\n - Daily (default)\n - Weekly\n - Monthly\n - Custom\n - On-demand\n\n If you choose an option other than Daily, additional options are\n available. For example, if you choose Weekly, an option appears for\n you to select the day of the week.\n - For **Start date and run time** , enter the date and time to start the\n transfer. If you choose **Start now**, this option is disabled.\n\n - For **Destination dataset**, choose the dataset you created to store your\n data.\n\n - (Optional) In the **Notification options** section:\n\n - Click the toggle to enable email notifications. When you enable this option, the transfer administrator receives an email notification when a transfer run fails.\n - For **Select a Pub/Sub topic** , choose your [topic](/pubsub/docs/overview#types) name or click **Create a topic** to create one. This option configures Pub/Sub run [notifications](/bigquery/docs/transfer-run-notifications) for your transfer.\n6. Click **Connect Source**.\n\n | **Note:** If you did not select a destination dataset, clicking **Connect\n | Source** produces the following error: `A selected destination dataset is\n | required before connecting to the source.`\n7. When prompted, click **Accept** to give the BigQuery Data Transfer Service permission\n to connect to the data source and to manage your data in\n BigQuery.\n\n8. Follow the instructions in the subsequent pages to configure the connection\n to your external data source.\n\n9. After you complete the configuration steps, click **Save**.\n\nTroubleshoot third party transfer setup\n---------------------------------------\n\nIf you are having issues setting up your transfer, consult the appropriate third\nparty vendor. Contact information is available on the transfer's documentation\npage in the Google Cloud Marketplace.\n\nQuery your data\n---------------\n\nWhen your data is transferred to BigQuery, the data is\nwritten to ingestion-time partitioned tables. For more information, see\n[Introduction to partitioned tables](/bigquery/docs/partitioned-tables).\n\nIf you query your tables directly instead of using the auto-generated views, you\nmust use the `_PARTITIONTIME` pseudocolumn in your query. For more information,\nsee [Querying partitioned tables](/bigquery/docs/querying-partitioned-tables).\n\nWhat's next\n-----------\n\n- For an overview of BigQuery Data Transfer Service, see [Introduction to BigQuery Data Transfer Service](/bigquery/docs/dts-introduction).\n- For information on using transfers including getting information about a transfer configuration, listing transfer configurations, and viewing a transfer's run history, see [Working with transfers](/bigquery/docs/working-with-transfers)."]]
