Generate music with Lyria

You can use Lyria to generate novel music tracks from prompts. Supported interfaces include the Google Cloud console and the Gemini API in Vertex AI API.

Try Lyria on Vertex AI (Vertex AI Studio)

Before you begin

Sign in to your Google Cloud account. If you're new to Google Cloud, create an account to evaluate how our products perform in real-world scenarios. New customers also get $300 in free credits to run, test, and deploy workloads.

In the Google Cloud console, on the project selector page, select or create a Google Cloud project.

Roles required to select or create a project

• Select a project : Selecting a project doesn't require a specific IAM role—you can select any project that you've been granted a role on.
• Create a project : To create a project, you need the Project Creator role ( roles/resourcemanager.projectCreator ), which contains the resourcemanager.projects.create permission. Learn how to grant roles .

Go to project selector

Enable the Vertex AI API.

Roles required to enable APIs

To enable APIs, you need the Service Usage Admin IAM role ( roles/serviceusage.serviceUsageAdmin ), which contains the serviceusage.services.enable permission. Learn how to grant roles .

Enable the API

In the Google Cloud console, on the project selector page, select or create a Google Cloud project.

Roles required to select or create a project

• Select a project : Selecting a project doesn't require a specific IAM role—you can select any project that you've been granted a role on.
• Create a project : To create a project, you need the Project Creator role ( roles/resourcemanager.projectCreator ), which contains the resourcemanager.projects.create permission. Learn how to grant roles .

Go to project selector

Enable the Vertex AI API.

Roles required to enable APIs

To enable APIs, you need the Service Usage Admin IAM role ( roles/serviceusage.serviceUsageAdmin ), which contains the serviceusage.services.enable permission. Learn how to grant roles .

Enable the API

1. Set up authentication for your environment.

   Select the tab for how you plan to use the samples on this page:

   Console

   When you use the Google Cloud console to access Google Cloud services and APIs, you don't need to set up authentication.

   REST

   To use the REST API samples on this page in a local development environment, you use the credentials you provide to the gcloud CLI.

   Install the Google Cloud CLI.

   If you're using an external identity provider (IdP), you must first sign in to the gcloud CLI with your federated identity .

   For more information, see Authenticate for using REST in the Google Cloud authentication documentation.

POST https://aiplatform.googleapis.com/v1beta1/projects/ PROJECT_ID 
/locations/global/interactions

{
  "model": " MODEL_ID 
",
  "input": [
    {
      "type": "text",
      "text": " TEXT_PROMPT 
"
    },
    {
      "type": "image",
      "mime_type": "image/jpeg",
      "uri": " IMAGE_URI 
"
    },
    {
      "type": "image",
      "mime_type": "image/png",
      "data": " IMAGE_DATABYTES 
"
    },
  ]
}

curl -X POST \
-H "Authorization: Bearer $(gcloud auth print-access-token)" \
-H "Content-Type: application/json; charset=utf-8" \
-d @request.json \
"https://aiplatform.googleapis.com/v1beta1/projects/ PROJECT_ID 
/locations/global/interactions"

$cred = gcloud auth print-access-token
$headers = @{ "Authorization" = "Bearer $cred" }

Invoke-WebRequest `
-Method POST `
-Headers $headers `
-ContentType: "application/json; charset=utf-8" `
-InFile request.json `
-Uri "https://aiplatform.googleapis.com/v1beta1/projects/ PROJECT_ID 
/locations/global/interactions" | Select-Object -Expand Content

{
  "status": "completed",
  "outputs": [
    {
      "text": "LYRICS",
      "type": "text"
    },
    {
      "text": "DESCRIPTION",
      "type": "text"
    },
    {
      "mime_type": "audio/mpeg",
      "data": "GENERATED_SONG_DATABYTES",
      "type": "audio"
    },
    {}
  ],
  "role": "model",
  "created": "CREATED_TIME",
  "updated": "UPDATE_TIME",
  "object": "interaction",
  "model": "lyria-3-pro-preview"
}

 curl  
-X  
POST  
 \ 
  
-H  
 "Authorization: Bearer 
 $( 
gcloud  
auth  
print-access-token ) 
 " 
  
 \ 
  
-H  
 "Content-Type: application/json" 
  
 \ 
  
https:// LOCATION 
-aiplatform.googleapis.com/v1/projects/ PROJECT_ID 
/locations/ LOCATION 
/publishers/google/models/lyria-002:predict  
 \ 
  
-d  
 '{ 
 "instances": [ 
 { 
 "prompt": "An uplifting and hopeful orchestral piece with a soaring string melody and triumphant brass.", 
 "negative_prompt": " dissonant, minor key", 
 "seed": 12345 
 } 
 ], 
 "parameters": { 
 // "sample_count": 1 // Use either seed or sample_count 
 } 
 }' 
 

  { 
  
 "predictions" 
 : 
  
 [ 
  
 { 
  
 "audioContent" 
 : 
  
 "BASE64_ENCODED_WAV_STRING_SAMPLE_1" 
 , 
  
 "mimeType" 
 : 
  
 "audio/wav" 
  
 }, 
  
 { 
  
 "audioContent" 
 : 
  
 "BASE64_ENCODED_WAV_STRING_SAMPLE_2" 
 , 
  
 "mimeType" 
 : 
  
 "audio/wav" 
  
 } 
  
 ], 
  
 "deployedModelId" 
 : 
  
 "xxxxxxxxxxxxxxx" 
 , 
  
 "model" 
 : 
  
 "projects/ PROJECT_ID 
/locations/ LOCATION 
/publishers/google/models/lyria-002" 
 , 
  
 "modelDisplayName" 
 : 
  
 "Lyria 2" 
 } 
 

What's next

• Learn how to write effective prompts in the Lyria music generation prompt guide

• Explore the Lyria API reference

• Discover other Generative AI models on Vertex AI