Requirements

Database Migration Service offers a variety of source database options and connectivity methods. Different sources work better with some connectivity methods than with others. In this quickstart, we assume that you're using a standalone PostgreSQL database in an environment where you can configure your network to add an inbound firewall rule. The source database can be on-premises or in a cloud provider. Because we can't know the specifics of your environment, we can't provide detailed steps when it comes to your networking configuration.

In this quickstart, you'll select PostgreSQLfor the Source database engineand IP allowlistas the networking method.

Create a source connection profile

1. Go to the Database Migration Service Connection profiles page in the Google Cloud console.

   Go to the Database Migration Service Connection Profiles Page

2. Click CREATE PROFILE.

3. On the Create a connection profilepage, from the Profile rolelist, select Source.

4. From the Database enginelist, select one of the following classification types of your source database:

   • A standalone PostgreSQL instance (PostgreSQL)
   • An existing Cloud SQL for PostgreSQL instance (Cloud SQL for PostgreSQL)
   • An Amazon RDS instance for PostgreSQL (Amazon RDS for PostgreSQL)

   For this quickstart, select PostgreSQL.

4. Supply the following information:
   • In the Connection profile name field, enter a name for the connection profile for your source database, such as My Connection Profile .
   • Keep the auto-generated Connection profile ID .
   • Enter Connectivity information :
     • If you're replicating from a self-hosted database, then enter the Hostname or IP address (domain or IP) and Port to access the host. (The default PostgreSQL port is 5432.)
     • If you're replicating from a Cloud SQL database, then select the Cloud SQL instance from the drop-down list.
   • Enter a Username and Password to authenticate to your source instance.
   • (Optional) If you plan to transfer sensitive information over a public network (by using IP allowlists), then we recommend using SSL/TLS encryption for the connection between the source and destination databases. Otherwise, keep the default value of None .

5. In the Connection profile region section of the page, select the region where you want to save the connection profile.

6. Click CREATE .

Create a migration job

Creating a migration job includes:

• Defining settings for the job
• Selecting the connection profile that you created for your source database (source connection profile)
• Defining settings for the destination Cloud SQL database instance
• Setting up connectivity between the source and destination database instances
• Testing the migration job to ensure that the connection information you provided for the job is valid

Define settings for the migration job

1. Go to the Database Migration Service Migration jobs page in the Google Cloud console.

   Go to the Database Migration Service Migration Jobs Page

2. Click CREATE MIGRATION JOB.

3. In the Migration job namefield, enter a name for the migration job, such as My Migration Job .

4. Keep the auto-generated Migration job ID.

5. Open the Source database enginedrop-down list and select the classification type of your source database.

6. Select the Destination regionwhere the destination instance is to be created.

7. Set the Migration job typeto "Continuous" because you want ongoing changes in your source database to be migrated to the destination Cloud SQL database instance.

8. Review the required prerequisites that are generated automatically to reflect how the environment must be prepared for a migration job. These prerequisites can include how to configure the source database and how to connect it to the destination Cloud SQL database instance. It's best to complete these prerequisites at this step, but you can complete them at any time before you test the migration job or start it. For more information about these prerequisites, see Configure your source.

9. Click SAVE & CONTINUE.

Specify information about the source connection profile

1. Open the Select source connection profiledrop-down list and select the connection profile that you created.

2. Click SAVE & CONTINUE.

Define settings for the destination Cloud SQL instance

1. Provide a Destination Instance IDfor the Cloud SQL instance. By default, the migration job ID is pre-populated in this field. You can keep this name or enter another name.

2. Provide an alphanumeric password for the destination Cloud SQL instance. This will be the password for the postgres administrator account in the instance.

   You can either enter the password manually or click GENERATEto have Database Migration Service create one for you automatically.

3. Choose the Database versionfor the destination instance from the list of supported Cloud SQL versions for the specified database engine.

4. Select the desired Google Cloud Zonefor the new Cloud SQL instance (or leave as "Any").

5. Select the Public IPcheck box because, for this quickstart, you're using IP allowlist as the networking method. This method works by configuring the source database server to accept connections from the outgoing IP address of the Cloud SQL instance.

6. Select the Machine typefor the Cloud SQL instance. The disk size must be equal to or greater than the source database size.

7. Define the Storage typeand Storage capacityfor the Cloud SQL instance.

8. Click CREATE & CONTINUEto create the new instance.

9. Click CREATE DESTINATION & CONTINUEin the subsequent dialog box. Creating the instance may take several minutes to complete.

Set up connectivity

1. Choose the networking method that you'd like to use to establish connectivity between the source and destination databases. For this quickstart, use the Connectivity method list to select IP allowlist as the networking method.
2. If the source IP address isn't pre-populated in this field, then copy the Cloud SQL instance's outgoing IP address from the console, and use it to configure the network firewall for the source database server to accept connections from this IP address.
   
   1. Update the pg_hba.conf file or Amazon RDS security groups to accept connections from this IP address.
   2. In your firewall rules, create an Inbound (or Ingress) rule to allow connections on port 5432 from the destination Cloud SQL instance's connectivity IP address.
3. Click CONFIGURE & CONTINUE to complete the connection profile configuration.

Configure migration databases

You can select the databases that you want to migrate.

1. From the Databases to migrate list, select All databases .

   All databases that exist on the source are selected for migration.

2. Click Save and continue .

Test and create the migration job

1. Review the settings you chose for the migration job.

2. Click TEST JOBto verify that the source has been configured correctly, that the source and destination instances are able to communicate with each other, and that the migration job is valid.

3. Verify that you see the "Tests passed successfully!" status.

   If the test fails, then you can address the problem in the appropriate part of the flow, and return to re-test.

4. Click CREATE & START JOBto create the migration job and start it immediately.

5. Click STARTin the subsequent dialog box.

6. In the Migration jobspage, verify that your migration job has a status of "Starting". After a few minutes, confirm that the status changes to "Running".

Verify the migration job

In this section, you confirm that Database Migration Service used the migration job to migrate data from your source database instance to the destination Cloud SQL database instance.

1. Go to the SQL Instances page in the Google Cloud console.
2. Click the read replica entry of your migration job.
3. Click the Activate Cloud Shell icon that appears in the upper-right region of the page.
4. At the Google Cloud Shell prompt, press Enter .
5. Optional: If an Authorize Cloud Shell dialog box appears, then click Authorize .
6. Connect to the destination Cloud SQL database instance.
7. At the Enter password prompt, enter the password that you either provided or that Database Migration Service generated for you in Define settings for the destination Cloud SQL instance .

8. At the postgres prompt, enter \list to list the databases and verify that you see your source database instance.
9. At the postgres prompt, enter \connect SOURCE_DB_NAME because you want to see the tables associated with this database instance. The name of the prompt changes from postgres to SOURCE_DB_NAME .
10. At the SOURCE_DB_NAME prompt, enter \dt to see the tables of this instance.
11. At the SOURCE_DB_NAME prompt, enter GRANT cloudsqlexternalsync to USER ; because you want to give this user permission to access the data in the tables of this instance.

    Replace USER with the name of the user you used to connect to the destination database instance.

12. At the SOURCE_DB_NAME prompt, enter SELECT * from TABLE_NAME ; to see the information that's replicated from a table in your source database instance.
13. Verify that you see the correct information in the table.

This confirms that Database Migration Service migrated the data.

Promote the migration job

You're ready to promote the migration job. As a result, the destination Cloud SQL database instance replaces the source database instance as the primary database.

1. Return to the Migration jobspage.

2. Click the migration job that you want to promote. The Migration job detailspage appears.

3. Wait for the replication delay to trend toward zero.

4. Stop all writes to the source database.

5. Wait until the replication delay is at zero.

6. Click the migration job that you want to promote. This job should have a status of "Running".

7. Click PROMOTEto promote the migration job.

8. Click PROMOTEagain in the subsequent dialog box.

9. Verify that the migration job has a status of "Promote in progress". After a few minutes, confirm that the status changes to "Completed".

Your new Cloud SQL database instance is ready to use.