Python Client for Cloud Dataflow

Cloud Dataflow : Unified stream and batch data processing that’s serverless, fast, and cost-effective.

• Client Library Documentation

• Product Documentation

Quick Start

In order to use this library, you first need to go through the following steps:

1. Select or create a Cloud Platform project.

2. Enable billing for your project.

3. Enable the APIs.

4. Setup Authentication.

Installation

Install this library in a virtualenv using pip. virtualenv is a tool to create isolated Python environments. The basic problem it addresses is one of dependencies and versions, and indirectly permissions.

With virtualenv , it’s possible to install this library without needing system install permissions, and without clashing with the installed system dependencies.

Mac/Linux

 pip install virtualenv
virtualenv <your-env>
source <your-env>/bin/activate
<your-env>/bin/pip install google-cloud-dataflow-client 

Windows

 pip install virtualenv
virtualenv <your-env>
<your-env>\Scripts\activate
<your-env>\Scripts\pip.exe install google-cloud-dataflow-client 

Next Steps

• Read the Client Library Documentation for Cloud Dataflow to see other available methods on the client.

• Read the Cloud Dataflow Product documentation to learn more about the product and see How-to Guides.

• View this README to see the full list of Cloud APIs that we cover.