Setting concurrency

Console

1. Go to Knative serving in the Google Cloud console:

   Go to Knative serving

2. Click Create Serviceif you are configuring a new service you are deploying to. If you are configuring an existing service, click on the service, then click Edit & Deploy New Revision.

3. Under Advanced settings , click Container.

4. Set the desired concurrency value in the text box Maximum requests per container .

5. Click Nextto continue to the next section.

6. In the Configure how this service is triggeredsection, select which connectivity you would like to use to invoke the service.

7. Click Createto deploy the image to Knative serving and wait for the deployment to finish.

Command line

• For existing services, set the maximum number of concurrent requests by running the gcloud run services update command with the --concurrency parameter:

  gcloud  
  run  
  services  
  update  
   SERVICE 
    
  --concurrency  
   CONCURRENCY 
  

  Replace:

  • SERVICE with the name of your service.
  • CONCURRENCY with the maximum number of concurrent requests per container instance. Specify default to clear any concurrency settings: --concurrency default .

• For new services, set the maximum number of concurrent requests by running the gcloud run deploy command with the --concurrency parameter:

  gcloud  
  run  
  deploy  
   SERVICE 
    
  --image = 
   IMAGE_URL 
    
  --concurrency  
   CONCURRENCY 
  

  Replace:

  • SERVICE with the name of your service.
  • IMAGE_URL with a reference to the container image, for example, gcr.io/cloudrun/hello .
  • CONCURRENCY with the maximum number of concurrent requests per container instance. Specify default to clear any concurrency settings: --concurrency default .

YAML

You can download the configuration of an existing service into a YAML file with the gcloud run services describe command by using the --format=export flag. You can then modify that YAML file and deploy those changes with the gcloud run services replace command. You must ensure that you modify only the specified attributes.

1. Download the configuration of your service into a file named service.yaml on local workspace:

   gcloud  
   run  
   services  
   describe  
    SERVICE 
     
   --format  
    export 
     
   >  
   service.yaml

   Replace SERVICE with the name of your Knative serving service.

2. In your local file, update the containerConcurrency attribute:

    apiVersion 
    : 
     
    serving.knative.dev/v1 
    kind 
    : 
     
    Service 
    metadata 
    : 
     
    name 
    : 
     
     SERVICE 
    
    spec 
    : 
     
    template 
    : 
     
    spec 
    : 
     
    containerConcurrency 
    : 
     
     CONCURRENCY 
    
   

   Replace:

   • SERVICE with the name of your Knative serving service
   • CONCURRENCY with the maximum number of concurrent requests per container instance. Specify default to clear the concurrency settings: --concurrency default .

3. Replace the service with its new configuration using the following command:

   gcloud  
   run  
   services  
   replace  
   service.yaml