Chirp: Universal speech model

Chirp is the next generation of Google's speech-to-text models. Representing the culmination of years of research, the first version of Chirp is now available for Speech-to-Text. We intend to improve and expand Chirp to more languages and domains. For details, see our paper, Google USM .

We trained Chirp models with a different architecture than our current speech models. A single model unifies data from multiple languages. However, users still specify the language in which the model should recognize speech. Chirp does not support some of the Google Speech features that other models have. See Feature support and limitations for a complete list.

Model identifiers

Chirp is available in the Speech-to-Text API v2. You can use it like any other model.

The model identifier for Chirp is: chirp .

You can specify this model in synchronous or batch recognition requests.

Available API methods

Chirp processes speech in much larger chunks than other models do. This means it might not be suitable for true, real-time use. Chirp is available through the following API methods:

• v2 Speech.Recognize (good for short audio < 1 min)
• v2 Speech.BatchRecognize (good for long audio 1 min to 8 hrs)

Chirp is notavailable on the following API methods:

• v2 Speech.StreamingRecognize
• v1 Speech.StreamingRecognize
• v1 Speech.Recognize
• v1 Speech.LongRunningRecognize
• v1p1beta1 Speech.StreamingRecognize
• v1p1beta1 Speech.Recognize
• v1p1beta1 Speech.LongRunningRecognize

Regions

Chirp is available in the following regions:

• us-central1
• europe-west4
• asia-southeast1

See the languages page for more information.

Languages

You can see the supported languages in the full language list .

Feature support and limitations

Chirp does not support some of the STT API features:

• Confidence scores: The API returns a value, but it isn't truly a confidence score.
• Speech adaptation: No adaptation features supported.
• Diarization: Automatic diarization isn't supported.
• Forced normalization: Not supported.
• Word level confidence: Not supported.
• Language detection: Not supported.

Chirp does support the following features:

• Automatic punctuation: The punctuation is predicted by the model. It can be disabled.
• Word timings: Optionally returned.
• Language-agnostic audio transcription: The model automatically infers the spoken language in your audio file and adds it to the results.

Before you begin

Sign in to your Google Cloud account. If you're new to Google Cloud, create an account to evaluate how our products perform in real-world scenarios. New customers also get $300 in free credits to run, test, and deploy workloads.

In the Google Cloud console, on the project selector page, select or create a Google Cloud project.

Go to project selector

Verify that billing is enabled for your Google Cloud project .

Enable the Speech-to-Text APIs.

Enable the APIs

Make sure that you have the following role or roles on the project: Cloud Speech Administrator

Check for the roles

1. In the Google Cloud console, go to the IAM page.

   Go to IAM
2. Select the project.

3. In the Principal column, find all rows that identify you or a group that you're included in. To learn which groups you're included in, contact your administrator.

4. For all rows that specify or include you, check the Role column to see whether the list of roles includes the required roles.

Grant the roles

1. In the Google Cloud console, go to the IAM page.

   Go to IAM
2. Select the project.
3. Click person_add Grant access .

4. In the New principals field, enter your user identifier. This is typically the email address for a Google Account.

5. In the Select a role list, select a role.
6. To grant additional roles, click add Add another role and add each additional role.
7. Click Save .

Install the Google Cloud CLI.

If you're using an external identity provider (IdP), you must first sign in to the gcloud CLI with your federated identity .

To initialize the gcloud CLI, run the following command:

gcloud  
init

In the Google Cloud console, on the project selector page, select or create a Google Cloud project.

Go to project selector

Verify that billing is enabled for your Google Cloud project .

Enable the Speech-to-Text APIs.

Enable the APIs

Make sure that you have the following role or roles on the project: Cloud Speech Administrator

Check for the roles

1. In the Google Cloud console, go to the IAM page.

   Go to IAM
2. Select the project.

3. In the Principal column, find all rows that identify you or a group that you're included in. To learn which groups you're included in, contact your administrator.

4. For all rows that specify or include you, check the Role column to see whether the list of roles includes the required roles.

Grant the roles

1. In the Google Cloud console, go to the IAM page.

   Go to IAM
2. Select the project.
3. Click person_add Grant access .

4. In the New principals field, enter your user identifier. This is typically the email address for a Google Account.

5. In the Select a role list, select a role.
6. To grant additional roles, click add Add another role and add each additional role.
7. Click Save .

Install the Google Cloud CLI.

If you're using an external identity provider (IdP), you must first sign in to the gcloud CLI with your federated identity .

To initialize the gcloud CLI, run the following command:

gcloud  
init

Client libraries can use Application Default Credentials to easily authenticate with Google APIs and send requests to those APIs. With Application Default Credentials, you can test your application locally and deploy it without changing the underlying code. For more information, see Authenticate for using client libraries .

1. If you're using a local shell, then create local authentication credentials for your user account:

   gcloud  
   auth  
   application-default  
   login

   You don't need to do this if you're using Cloud Shell.

   If an authentication error is returned, and you are using an external identity provider (IdP), confirm that you have signed in to the gcloud CLI with your federated identity .

Also ensure you have installed the client library .

Perform synchronous speech recognition with Chirp

Here is an example of performing synchronous speech recognition on a local audio file using Chirp:

  import 
  
 os 
 from 
  
 google.api_core.client_options 
  
 import 
 ClientOptions 
 from 
  
 google.cloud.speech_v2 
  
 import 
 SpeechClient 
 from 
  
 google.cloud.speech_v2.types 
  
 import 
 cloud_speech 
 PROJECT_ID 
 = 
 os 
 . 
 getenv 
 ( 
 "GOOGLE_CLOUD_PROJECT" 
 ) 
 def 
  
 transcribe_chirp 
 ( 
 audio_file 
 : 
 str 
 , 
 ) 
 - 
> cloud_speech 
 . 
 RecognizeResponse 
 : 
  
 """Transcribes an audio file using the Chirp model of Google Cloud Speech-to-Text API. 
 Args: 
 audio_file (str): Path to the local audio file to be transcribed. 
 Example: "resources/audio.wav" 
 Returns: 
 cloud_speech.RecognizeResponse: The response from the Speech-to-Text API containing 
 the transcription results. 
 """ 
 # Instantiates a client 
 client 
 = 
 SpeechClient 
 ( 
 client_options 
 = 
 ClientOptions 
 ( 
 api_endpoint 
 = 
 "us-central1-speech.googleapis.com" 
 , 
 ) 
 ) 
 # Reads a file as bytes 
 with 
 open 
 ( 
 audio_file 
 , 
 "rb" 
 ) 
 as 
 f 
 : 
 audio_content 
 = 
 f 
 . 
 read 
 () 
 config 
 = 
 cloud_speech 
 . 
 RecognitionConfig 
 ( 
 auto_decoding_config 
 = 
 cloud_speech 
 . 
 AutoDetectDecodingConfig 
 (), 
 language_codes 
 = 
 [ 
 "en-US" 
 ], 
 model 
 = 
 "chirp" 
 , 
 ) 
 request 
 = 
 cloud_speech 
 . 
 RecognizeRequest 
 ( 
 recognizer 
 = 
 f 
 "projects/ 
 { 
 PROJECT_ID 
 } 
 /locations/us-central1/recognizers/_" 
 , 
 config 
 = 
 config 
 , 
 content 
 = 
 audio_content 
 , 
 ) 
 # Transcribes the audio into text 
 response 
 = 
 client 
 . 
 recognize 
 ( 
 request 
 = 
 request 
 ) 
 for 
 result 
 in 
 response 
 . 
 results 
 : 
 print 
 ( 
 f 
 "Transcript: 
 { 
 result 
 . 
 alternatives 
 [ 
 0 
 ] 
 . 
 transcript 
 } 
 " 
 ) 
 return 
 response 
 

Make a request with language-agnostic transcription enabled

The following code samples demonstrate how to make a request with language-agnostic transcription enabled.

  import 
  
 os 
 from 
  
 google.api_core.client_options 
  
 import 
 ClientOptions 
 from 
  
 google.cloud.speech_v2 
  
 import 
 SpeechClient 
 from 
  
 google.cloud.speech_v2.types 
  
 import 
 cloud_speech 
 PROJECT_ID 
 = 
 os 
 . 
 getenv 
 ( 
 "GOOGLE_CLOUD_PROJECT" 
 ) 
 def 
  
 transcribe_chirp_auto_detect_language 
 ( 
 audio_file 
 : 
 str 
 , 
 region 
 : 
 str 
 = 
 "us-central1" 
 , 
 ) 
 - 
> cloud_speech 
 . 
 RecognizeResponse 
 : 
  
 """Transcribe an audio file and auto-detect spoken language using Chirp. 
 Please see https://cloud.google.com/speech-to-text/v2/docs/encoding for more 
 information on which audio encodings are supported. 
 Args: 
 audio_file (str): Path to the local audio file to be transcribed. 
 region (str): The region for the API endpoint. 
 Returns: 
 cloud_speech.RecognizeResponse: The response containing the transcription results. 
 """ 
 # Instantiates a client 
 client 
 = 
 SpeechClient 
 ( 
 client_options 
 = 
 ClientOptions 
 ( 
 api_endpoint 
 = 
 f 
 " 
 { 
 region 
 } 
 -speech.googleapis.com" 
 , 
 ) 
 ) 
 # Reads a file as bytes 
 with 
 open 
 ( 
 audio_file 
 , 
 "rb" 
 ) 
 as 
 f 
 : 
 audio_content 
 = 
 f 
 . 
 read 
 () 
 config 
 = 
 cloud_speech 
 . 
 RecognitionConfig 
 ( 
 auto_decoding_config 
 = 
 cloud_speech 
 . 
  AutoDetectDecodingConfig 
 
 (), 
 language_codes 
 = 
 [ 
 "auto" 
 ], 
 # Set language code to auto to detect language. 
 model 
 = 
 "chirp" 
 , 
 ) 
 request 
 = 
 cloud_speech 
 . 
 RecognizeRequest 
 ( 
 recognizer 
 = 
 f 
 "projects/ 
 { 
 PROJECT_ID 
 } 
 /locations/ 
 { 
 region 
 } 
 /recognizers/_" 
 , 
 config 
 = 
 config 
 , 
 content 
 = 
 audio_content 
 , 
 ) 
 # Transcribes the audio into text 
 response 
 = 
 client 
 . 
  recognize 
 
 ( 
 request 
 = 
 request 
 ) 
 for 
 result 
 in 
 response 
 . 
 results 
 : 
 print 
 ( 
 f 
 "Transcript: 
 { 
 result 
 . 
 alternatives 
 [ 
 0 
 ] 
 . 
 transcript 
 } 
 " 
 ) 
 print 
 ( 
 f 
 "Detected Language: 
 { 
 result 
 . 
 language_code 
 } 
 " 
 ) 
 return 
 response 
 

Get started with Chirp in the Google Cloud console

1. Ensure you have signed up for a Google Cloud account and created a project.
2. Go to Speech in Google Cloud console.
3. Enable the API if it's not already enabled.
4. Go to the Transcriptions subpage.
5. Click New Transcription

6. Make sure that you have an STT workspace. If you don't, create one.

   1. Open the Workspacedrop-down and click New Workspace.

   2. From the Create a new workspacenavigation sidebar, click Browse.

   3. Click to create a bucket.

   4. Enter a name for your bucket and click Continue.

   5. Click Create.

   6. After the bucket is created, click Selectto select your bucket.

   7. Click Createto finish creating your workspace for Speech-to-Text.

7. Perform a transcription on your audio.

   

   1. From the New Transcriptionpage, choose an option for selecting your audio file:
      • Upload by clicking Local upload.
      • Click Cloud storageto specify an existing Cloud Storage file.
   1. Click Continue.

   

   1. From the Transcription optionssection, select the Spoken languagethat you plan to use for recognition with Chirp from your previously created recognizer.

   2. At the Model* drop-down, select Chirp.

   3. At the Regiondrop-down, select a region, such as us-central1.

   4. Click Continue.

   5. To run your first recognition request using Chirp, in the main section, click Submit.

8. View your Chirp transcription result.

   1. From the Transcriptionspage, click the name of the transcription.

   2. On the Transcription detailspage, view your transcription result, and optionally playback the audio in the browser.

Clean up

To avoid incurring charges to your Google Cloud account for the resources used on this page, follow these steps.

1. Optional: Revoke the authentication credentials that you created, and delete the local credential file.

   gcloud  
   auth  
   application-default  
   revoke

2. Optional: Revoke credentials from the gcloud CLI.

   gcloud  
   auth  
   revoke

What's next

• Practice transcribing short audio files .
• Learn how to transcribe streaming audio .
• Learn how to transcribe long audio files .
• For best performance, accuracy, and other tips, see the best practices documentation.