Detect crop hints

Crop Hintssuggests vertices for a crop region on an image.

Image before crop
Image credit : Yasmin Dangor on Unsplash ( original and cropped image shown ).

Crop hint applied (2:1 ratio):

Image after crop

Crop hint detection requests

Set up your Google Cloud project and authentication

Detect crop hints on a local image

You can use the Vision API to perform feature detection on a local image file.

For REST requests, send the contents of the image file as a base64 encoded string in the body of your request.

For gcloud and client library requests, specify the path to a local image in your request.

REST

Before using any of the request data, make the following replacements:

  • BASE64_ENCODED_IMAGE : The base64 representation (ASCII string) of your binary image data. This string should look similar to the following string:
    • /9j/4QAYRXhpZgAA...9tAVx/zDQDlGxn//2Q==
    Visit the base64 encode topic for more information.
  • PROJECT_ID : Your Google Cloud project ID.

Field-specific considerations:

  • cropHintsParams.aspectRatios - A float that corresponds to your specified ratio(s) for your images (width:height). You can supply up to 16 crop ratios.

HTTP method and URL:

POST https://vision.googleapis.com/v1/images:annotate

Request JSON body:

{
  "requests": [
    {
      "image": {
        "content": " BASE64_ENCODED_IMAGE 
"
      },
      "features": [
        {
          "type": "CROP_HINTS"
        }
      ],
      "imageContext": {
        "cropHintsParams": {
          "aspectRatios": [
             2.0
          ]
        }
      }
    }
  ]
}

To send your request, choose one of these options:

curl

Save the request body in a file named request.json , and execute the following command:

curl -X POST \
-H "Authorization: Bearer $(gcloud auth print-access-token)" \
-H "x-goog-user-project: PROJECT_ID " \
-H "Content-Type: application/json; charset=utf-8" \
-d @request.json \
"https://vision.googleapis.com/v1/images:annotate"

PowerShell

Save the request body in a file named request.json , and execute the following command:

$cred = gcloud auth print-access-token
$headers = @{ "Authorization" = "Bearer $cred"; "x-goog-user-project" = " PROJECT_ID " }

Invoke-WebRequest `
-Method POST `
-Headers $headers `
-ContentType: "application/json; charset=utf-8" `
-InFile request.json `
-Uri "https://vision.googleapis.com/v1/images:annotate" | Select-Object -Expand Content

If the request is successful, the server returns a 200 OK HTTP status code and the response in JSON format.

Response:

{
  "responses": [
    {
      "cropHintsAnnotation": {
        "cropHints": [
          {
            "boundingPoly": {
              "vertices": [
                {
                  "y": 520
                },
                {
                  "x": 2369,
                  "y": 520
                },
                {
                  "x": 2369,
                  "y": 1729
                },
                {
                  "y": 1729
                }
              ]
            },
            "confidence": 0.79999995,
            "importanceFraction": 0.66999996
          }
        ]
      }
    }
  ]
}

Go

Before trying this sample, follow the Go setup instructions in the Vision quickstart using client libraries . For more information, see the Vision Go API reference documentation .

To authenticate to Vision, set up Application Default Credentials. For more information, see Set up authentication for a local development environment .

  // detectCropHints gets suggested croppings the Vision API for an image at the given file path. 
 func 
  
 detectCropHints 
 ( 
 w 
  
 io 
 . 
 Writer 
 , 
  
 file 
  
 string 
 ) 
  
 error 
  
 { 
  
 ctx 
  
 := 
  
 context 
 . 
 Background 
 () 
  
 client 
 , 
  
 err 
  
 := 
  
 vision 
 . 
 NewImageAnnotatorClient 
 ( 
 ctx 
 ) 
  
 if 
  
 err 
  
 != 
  
 nil 
  
 { 
  
 return 
  
 err 
  
 } 
  
 f 
 , 
  
 err 
  
 := 
  
 os 
 . 
 Open 
 ( 
 file 
 ) 
  
 if 
  
 err 
  
 != 
  
 nil 
  
 { 
  
 return 
  
 err 
  
 } 
  
 defer 
  
 f 
 . 
 Close 
 () 
  
 image 
 , 
  
 err 
  
 := 
  
 vision 
 . 
 NewImageFromReader 
 ( 
 f 
 ) 
  
 if 
  
 err 
  
 != 
  
 nil 
  
 { 
  
 return 
  
 err 
  
 } 
  
 res 
 , 
  
 err 
  
 := 
  
 client 
 . 
 CropHints 
 ( 
 ctx 
 , 
  
 image 
 , 
  
 nil 
 ) 
  
 if 
  
 err 
  
 != 
  
 nil 
  
 { 
  
 return 
  
 err 
  
 } 
  
 fmt 
 . 
 Fprintln 
 ( 
 w 
 , 
  
 "Crop hints:" 
 ) 
  
 for 
  
 _ 
 , 
  
 hint 
  
 := 
  
 range 
  
 res 
 . 
 CropHints 
  
 { 
  
 for 
  
 _ 
 , 
  
 v 
  
 := 
  
 range 
  
 hint 
 . 
 BoundingPoly 
 . 
 Vertices 
  
 { 
  
 fmt 
 . 
 Fprintf 
 ( 
 w 
 , 
  
 "(%d,%d)\n" 
 , 
  
 v 
 . 
 X 
 , 
  
 v 
 . 
 Y 
 ) 
  
 } 
  
 } 
  
 return 
  
 nil 
 } 
 

Java

Before trying this sample, follow the Java setup instructions in the Vision API Quickstart Using Client Libraries . For more information, see the Vision API Java reference documentation .

  import 
  
 com.google.cloud.vision.v1. AnnotateImageRequest 
 
 ; 
 import 
  
 com.google.cloud.vision.v1. AnnotateImageResponse 
 
 ; 
 import 
  
 com.google.cloud.vision.v1. BatchAnnotateImagesResponse 
 
 ; 
 import 
  
 com.google.cloud.vision.v1. CropHint 
 
 ; 
 import 
  
 com.google.cloud.vision.v1. CropHintsAnnotation 
 
 ; 
 import 
  
 com.google.cloud.vision.v1. Feature 
 
 ; 
 import 
  
 com.google.cloud.vision.v1. Image 
 
 ; 
 import 
  
 com.google.cloud.vision.v1. ImageAnnotatorClient 
 
 ; 
 import 
  
 com.google.protobuf. ByteString 
 
 ; 
 import 
  
 java.io.FileInputStream 
 ; 
 import 
  
 java.io.IOException 
 ; 
 import 
  
 java.util.ArrayList 
 ; 
 import 
  
 java.util.List 
 ; 
 public 
  
 class 
 DetectCropHints 
  
 { 
  
 public 
  
 static 
  
 void 
  
 detectCropHints 
 () 
  
 throws 
  
 IOException 
  
 { 
  
 // TODO(developer): Replace these variables before running the sample. 
  
 String 
  
 filePath 
  
 = 
  
 "path/to/your/image/file.jpg" 
 ; 
  
 detectCropHints 
 ( 
 filePath 
 ); 
  
 } 
  
 // Suggests a region to crop to for a local file. 
  
 public 
  
 static 
  
 void 
  
 detectCropHints 
 ( 
 String 
  
 filePath 
 ) 
  
 throws 
  
 IOException 
  
 { 
  
 List<AnnotateImageRequest> 
  
 requests 
  
 = 
  
 new 
  
 ArrayList 
<> (); 
  
  ByteString 
 
  
 imgBytes 
  
 = 
  
  ByteString 
 
 . 
  readFrom 
 
 ( 
 new 
  
 FileInputStream 
 ( 
 filePath 
 )); 
  
  Image 
 
  
 img 
  
 = 
  
  Image 
 
 . 
 newBuilder 
 (). 
 setContent 
 ( 
 imgBytes 
 ). 
 build 
 (); 
  
  Feature 
 
  
 feat 
  
 = 
  
  Feature 
 
 . 
 newBuilder 
 (). 
 setType 
 ( 
  Feature 
 
 . 
 Type 
 . 
 CROP_HINTS 
 ). 
 build 
 (); 
  
  AnnotateImageRequest 
 
  
 request 
  
 = 
  
  AnnotateImageRequest 
 
 . 
 newBuilder 
 (). 
 addFeatures 
 ( 
 feat 
 ). 
 setImage 
 ( 
 img 
 ). 
 build 
 (); 
  
 requests 
 . 
 add 
 ( 
 request 
 ); 
  
 // Initialize client that will be used to send requests. This client only needs to be created 
  
 // once, and can be reused for multiple requests. After completing all of your requests, call 
  
 // the "close" method on the client to safely clean up any remaining background resources. 
  
 try 
  
 ( 
  ImageAnnotatorClient 
 
  
 client 
  
 = 
  
  ImageAnnotatorClient 
 
 . 
 create 
 ()) 
  
 { 
  
  BatchAnnotateImagesResponse 
 
  
 response 
  
 = 
  
 client 
 . 
 batchAnnotateImages 
 ( 
 requests 
 ); 
  
 List<AnnotateImageResponse> 
  
 responses 
  
 = 
  
 response 
 . 
  getResponsesList 
 
 (); 
  
 for 
  
 ( 
  AnnotateImageResponse 
 
  
 res 
  
 : 
  
 responses 
 ) 
  
 { 
  
 if 
  
 ( 
 res 
 . 
 hasError 
 ()) 
  
 { 
  
 System 
 . 
 out 
 . 
 format 
 ( 
 "Error: %s%n" 
 , 
  
 res 
 . 
 getError 
 (). 
 getMessage 
 ()); 
  
 return 
 ; 
  
 } 
  
 // For full list of available annotations, see http://g.co/cloud/vision/docs 
  
  CropHintsAnnotation 
 
  
 annotation 
  
 = 
  
 res 
 . 
 getCropHintsAnnotation 
 (); 
  
 for 
  
 ( 
  CropHint 
 
  
 hint 
  
 : 
  
 annotation 
 . 
  getCropHintsList 
 
 ()) 
  
 { 
  
 System 
 . 
 out 
 . 
 println 
 ( 
 hint 
 . 
 getBoundingPoly 
 ()); 
  
 } 
  
 } 
  
 } 
  
 } 
 } 
 

Node.js

Before trying this sample, follow the Node.js setup instructions in the Vision quickstart using client libraries . For more information, see the Vision Node.js API reference documentation .

To authenticate to Vision, set up Application Default Credentials. For more information, see Set up authentication for a local development environment .

  // Imports the Google Cloud client library 
 const 
  
 vision 
  
 = 
  
 require 
 ( 
 ' @google-cloud/vision 
' 
 ); 
 // Creates a client 
 const 
  
 client 
  
 = 
  
 new 
  
 vision 
 . 
  ImageAnnotatorClient 
 
 (); 
 /** 
 * TODO(developer): Uncomment the following line before running the sample. 
 */ 
 // const fileName = 'Local image file, e.g. /path/to/image.png'; 
 // Find crop hints for the local file 
 const 
  
 [ 
 result 
 ] 
  
 = 
  
 await 
  
 client 
 . 
 cropHints 
 ( 
 fileName 
 ); 
 const 
  
 cropHints 
  
 = 
  
  result 
 
 . 
 cropHintsAnnotation 
 ; 
 cropHints 
 . 
 cropHints 
 . 
 forEach 
 (( 
 hintBounds 
 , 
  
 hintIdx 
 ) 
  
 = 
>  
 { 
  
 console 
 . 
 log 
 ( 
 `Crop Hint 
 ${ 
 hintIdx 
 } 
 :` 
 ); 
  
 hintBounds 
 . 
 boundingPoly 
 . 
 vertices 
 . 
 forEach 
 (( 
 bound 
 , 
  
 boundIdx 
 ) 
  
 = 
>  
 { 
  
 console 
 . 
 log 
 ( 
 `  Bound 
 ${ 
 boundIdx 
 } 
 : ( 
 ${ 
 bound 
 . 
 x 
 } 
 , 
 ${ 
 bound 
 . 
 y 
 } 
 )` 
 ); 
  
 }); 
 }); 
 

Python

Before trying this sample, follow the Python setup instructions in the Vision quickstart using client libraries . For more information, see the Vision Python API reference documentation .

To authenticate to Vision, set up Application Default Credentials. For more information, see Set up authentication for a local development environment .

  def 
  
 detect_crop_hints 
 ( 
 path 
 ): 
  
 """Detects crop hints in an image.""" 
 from 
  
 google.cloud 
  
 import 
 vision 
 client 
 = 
 vision 
 . 
  ImageAnnotatorClient 
 
 () 
 with 
 open 
 ( 
 path 
 , 
 "rb" 
 ) 
 as 
 image_file 
 : 
 content 
 = 
 image_file 
 . 
 read 
 () 
 image 
 = 
 vision 
 . 
  Image 
 
 ( 
 content 
 = 
 content 
 ) 
 crop_hints_params 
 = 
 vision 
 . 
  CropHintsParams 
 
 ( 
 aspect_ratios 
 = 
 [ 
 1.77 
 ]) 
 image_context 
 = 
 vision 
 . 
  ImageContext 
 
 ( 
 crop_hints_params 
 = 
 crop_hints_params 
 ) 
 response 
 = 
 client 
 . 
 crop_hints 
 ( 
 image 
 = 
 image 
 , 
 image_context 
 = 
 image_context 
 ) 
 hints 
 = 
 response 
 . 
 crop_hints_annotation 
 . 
 crop_hints 
 for 
 n 
 , 
 hint 
 in 
 enumerate 
 ( 
 hints 
 ): 
 print 
 ( 
 f 
 " 
 \n 
 Crop Hint: 
 { 
 n 
 } 
 " 
 ) 
 vertices 
 = 
 [ 
 f 
 "( 
 { 
 vertex 
 . 
 x 
 } 
 , 
 { 
 vertex 
 . 
 y 
 } 
 )" 
 for 
 vertex 
 in 
 hint 
 . 
 bounding_poly 
 . 
 vertices 
 ] 
 print 
 ( 
 "bounds: 
 {} 
 " 
 . 
 format 
 ( 
 "," 
 . 
 join 
 ( 
 vertices 
 ))) 
 if 
 response 
 . 
 error 
 . 
 message 
 : 
 raise 
 Exception 
 ( 
 " 
 {} 
 \n 
 For more info on error messages, check: " 
 "https://cloud.google.com/apis/design/errors" 
 . 
 format 
 ( 
 response 
 . 
 error 
 . 
 message 
 ) 
 ) 
 

Additional languages

C#: Please follow the C# setup instructions on the client libraries page and then visit the Vision reference documentation for .NET.

PHP: Please follow the PHP setup instructions on the client libraries page and then visit the Vision reference documentation for PHP.

Ruby: Please follow the Ruby setup instructions on the client libraries page and then visit the Vision reference documentation for Ruby.

Detect crop hints on a remote image

You can use the Vision API to perform feature detection on a remote image file that is located in Cloud Storage or on the Web. To send a remote file request, specify the file's Web URL or Cloud Storage URI in the request body.

REST

Before using any of the request data, make the following replacements:

  • CLOUD_STORAGE_IMAGE_URI : the path to a valid image file in a Cloud Storage bucket. You must at least have read privileges to the file. Example:
    • gs://cloud-samples-data/vision/crop_hints/bubble.jpeg
  • PROJECT_ID : Your Google Cloud project ID.

Field-specific considerations:

  • cropHintsParams.aspectRatios - A float that corresponds to your specified ratio(s) for your images (width:height). You can supply up to 16 crop ratios.

HTTP method and URL:

POST https://vision.googleapis.com/v1/images:annotate

Request JSON body:

{
  "requests": [
    {
      "image": {
        "source": {
          "gcsImageUri": " CLOUD_STORAGE_IMAGE_URI 
"
        }
      },
      "features": [
        {
          "type": "CROP_HINTS"
        }
      ],
      "imageContext": {
        "cropHintsParams": {
          "aspectRatios": [
             2.0
          ]
        }
      }
    }
  ]
}

To send your request, choose one of these options:

curl

Save the request body in a file named request.json , and execute the following command:

curl -X POST \
-H "Authorization: Bearer $(gcloud auth print-access-token)" \
-H "x-goog-user-project: PROJECT_ID " \
-H "Content-Type: application/json; charset=utf-8" \
-d @request.json \
"https://vision.googleapis.com/v1/images:annotate"

PowerShell

Save the request body in a file named request.json , and execute the following command:

$cred = gcloud auth print-access-token
$headers = @{ "Authorization" = "Bearer $cred"; "x-goog-user-project" = " PROJECT_ID " }

Invoke-WebRequest `
-Method POST `
-Headers $headers `
-ContentType: "application/json; charset=utf-8" `
-InFile request.json `
-Uri "https://vision.googleapis.com/v1/images:annotate" | Select-Object -Expand Content

If the request is successful, the server returns a 200 OK HTTP status code and the response in JSON format.

Response:

{
  "responses": [
    {
      "cropHintsAnnotation": {
        "cropHints": [
          {
            "boundingPoly": {
              "vertices": [
                {
                  "y": 520
                },
                {
                  "x": 2369,
                  "y": 520
                },
                {
                  "x": 2369,
                  "y": 1729
                },
                {
                  "y": 1729
                }
              ]
            },
            "confidence": 0.79999995,
            "importanceFraction": 0.66999996
          }
        ]
      }
    }
  ]
}

Java

Before trying this sample, follow the Java setup instructions in the Vision quickstart using client libraries . For more information, see the Vision Java API reference documentation .

To authenticate to Vision, set up Application Default Credentials. For more information, see Set up authentication for a local development environment .

  import 
  
 com.google.cloud.vision.v1. AnnotateImageRequest 
 
 ; 
 import 
  
 com.google.cloud.vision.v1. AnnotateImageResponse 
 
 ; 
 import 
  
 com.google.cloud.vision.v1. BatchAnnotateImagesResponse 
 
 ; 
 import 
  
 com.google.cloud.vision.v1. CropHint 
 
 ; 
 import 
  
 com.google.cloud.vision.v1. CropHintsAnnotation 
 
 ; 
 import 
  
 com.google.cloud.vision.v1. Feature 
 
 ; 
 import 
  
 com.google.cloud.vision.v1. Image 
 
 ; 
 import 
  
 com.google.cloud.vision.v1. ImageAnnotatorClient 
 
 ; 
 import 
  
 com.google.cloud.vision.v1. ImageSource 
 
 ; 
 import 
  
 java.io.IOException 
 ; 
 import 
  
 java.util.ArrayList 
 ; 
 import 
  
 java.util.List 
 ; 
 public 
  
 class 
 DetectCropHintsGcs 
  
 { 
  
 public 
  
 static 
  
 void 
  
 detectCropHintsGcs 
 () 
  
 throws 
  
 IOException 
  
 { 
  
 // TODO(developer): Replace these variables before running the sample. 
  
 String 
  
 filePath 
  
 = 
  
 "gs://your-gcs-bucket/path/to/image/file.jpg" 
 ; 
  
 detectCropHintsGcs 
 ( 
 filePath 
 ); 
  
 } 
  
 // Suggests a region to crop to for a remote file on Google Cloud Storage. 
  
 public 
  
 static 
  
 void 
  
 detectCropHintsGcs 
 ( 
 String 
  
 gcsPath 
 ) 
  
 throws 
  
 IOException 
  
 { 
  
 List<AnnotateImageRequest> 
  
 requests 
  
 = 
  
 new 
  
 ArrayList 
<> (); 
  
  ImageSource 
 
  
 imgSource 
  
 = 
  
  ImageSource 
 
 . 
 newBuilder 
 (). 
  setGcsImageUri 
 
 ( 
 gcsPath 
 ). 
 build 
 (); 
  
  Image 
 
  
 img 
  
 = 
  
  Image 
 
 . 
 newBuilder 
 (). 
  setSource 
 
 ( 
 imgSource 
 ). 
 build 
 (); 
  
  Feature 
 
  
 feat 
  
 = 
  
  Feature 
 
 . 
 newBuilder 
 (). 
 setType 
 ( 
  Feature 
 
 . 
 Type 
 . 
 CROP_HINTS 
 ). 
 build 
 (); 
  
  AnnotateImageRequest 
 
  
 request 
  
 = 
  
  AnnotateImageRequest 
 
 . 
 newBuilder 
 (). 
 addFeatures 
 ( 
 feat 
 ). 
 setImage 
 ( 
 img 
 ). 
 build 
 (); 
  
 requests 
 . 
 add 
 ( 
 request 
 ); 
  
 // Initialize client that will be used to send requests. This client only needs to be created 
  
 // once, and can be reused for multiple requests. After completing all of your requests, call 
  
 // the "close" method on the client to safely clean up any remaining background resources. 
  
 try 
  
 ( 
  ImageAnnotatorClient 
 
  
 client 
  
 = 
  
  ImageAnnotatorClient 
 
 . 
 create 
 ()) 
  
 { 
  
  BatchAnnotateImagesResponse 
 
  
 response 
  
 = 
  
 client 
 . 
 batchAnnotateImages 
 ( 
 requests 
 ); 
  
 List<AnnotateImageResponse> 
  
 responses 
  
 = 
  
 response 
 . 
  getResponsesList 
 
 (); 
  
 for 
  
 ( 
  AnnotateImageResponse 
 
  
 res 
  
 : 
  
 responses 
 ) 
  
 { 
  
 if 
  
 ( 
 res 
 . 
 hasError 
 ()) 
  
 { 
  
 System 
 . 
 out 
 . 
 format 
 ( 
 "Error: %s%n" 
 , 
  
 res 
 . 
 getError 
 (). 
 getMessage 
 ()); 
  
 return 
 ; 
  
 } 
  
 // For full list of available annotations, see http://g.co/cloud/vision/docs 
  
  CropHintsAnnotation 
 
  
 annotation 
  
 = 
  
 res 
 . 
 getCropHintsAnnotation 
 (); 
  
 for 
  
 ( 
  CropHint 
 
  
 hint 
  
 : 
  
 annotation 
 . 
  getCropHintsList 
 
 ()) 
  
 { 
  
 System 
 . 
 out 
 . 
 println 
 ( 
 hint 
 . 
 getBoundingPoly 
 ()); 
  
 } 
  
 } 
  
 } 
  
 } 
 } 
 

Go

Before trying this sample, follow the Go setup instructions in the Vision quickstart using client libraries . For more information, see the Vision Go API reference documentation .

To authenticate to Vision, set up Application Default Credentials. For more information, see Set up authentication for a local development environment .

  // detectCropHints gets suggested croppings the Vision API for an image at the given file path. 
 func 
  
 detectCropHintsURI 
 ( 
 w 
  
 io 
 . 
 Writer 
 , 
  
 file 
  
 string 
 ) 
  
 error 
  
 { 
  
 ctx 
  
 := 
  
 context 
 . 
 Background 
 () 
  
 client 
 , 
  
 err 
  
 := 
  
 vision 
 . 
 NewImageAnnotatorClient 
 ( 
 ctx 
 ) 
  
 if 
  
 err 
  
 != 
  
 nil 
  
 { 
  
 return 
  
 err 
  
 } 
  
 image 
  
 := 
  
 vision 
 . 
 NewImageFromURI 
 ( 
 file 
 ) 
  
 res 
 , 
  
 err 
  
 := 
  
 client 
 . 
 CropHints 
 ( 
 ctx 
 , 
  
 image 
 , 
  
 nil 
 ) 
  
 if 
  
 err 
  
 != 
  
 nil 
  
 { 
  
 return 
  
 err 
  
 } 
  
 fmt 
 . 
 Fprintln 
 ( 
 w 
 , 
  
 "Crop hints:" 
 ) 
  
 for 
  
 _ 
 , 
  
 hint 
  
 := 
  
 range 
  
 res 
 . 
 CropHints 
  
 { 
  
 for 
  
 _ 
 , 
  
 v 
  
 := 
  
 range 
  
 hint 
 . 
 BoundingPoly 
 . 
 Vertices 
  
 { 
  
 fmt 
 . 
 Fprintf 
 ( 
 w 
 , 
  
 "(%d,%d)\n" 
 , 
  
 v 
 . 
 X 
 , 
  
 v 
 . 
 Y 
 ) 
  
 } 
  
 } 
  
 return 
  
 nil 
 } 
 

Node.js

Before trying this sample, follow the Node.js setup instructions in the Vision quickstart using client libraries . For more information, see the Vision Node.js API reference documentation .

To authenticate to Vision, set up Application Default Credentials. For more information, see Set up authentication for a local development environment .

  // Imports the Google Cloud client libraries 
 const 
  
 vision 
  
 = 
  
 require 
 ( 
 ' @google-cloud/vision 
' 
 ); 
 // Creates a client 
 const 
  
 client 
  
 = 
  
 new 
  
 vision 
 . 
  ImageAnnotatorClient 
 
 (); 
 /** 
 * TODO(developer): Uncomment the following lines before running the sample. 
 */ 
 // const bucketName = 'Bucket where the file resides, e.g. my-bucket'; 
 // const fileName = 'Path to file within bucket, e.g. path/to/image.png'; 
 // Find crop hints for the remote file 
 const 
  
 [ 
 result 
 ] 
  
 = 
  
 await 
  
 client 
 . 
 cropHints 
 ( 
 `gs:// 
 ${ 
 bucketName 
 } 
 / 
 ${ 
 fileName 
 } 
 ` 
 ); 
 const 
  
 cropHints 
  
 = 
  
  result 
 
 . 
 cropHintsAnnotation 
 ; 
 cropHints 
 . 
 cropHints 
 . 
 forEach 
 (( 
 hintBounds 
 , 
  
 hintIdx 
 ) 
  
 = 
>  
 { 
  
 console 
 . 
 log 
 ( 
 `Crop Hint 
 ${ 
 hintIdx 
 } 
 :` 
 ); 
  
 hintBounds 
 . 
 boundingPoly 
 . 
 vertices 
 . 
 forEach 
 (( 
 bound 
 , 
  
 boundIdx 
 ) 
  
 = 
>  
 { 
  
 console 
 . 
 log 
 ( 
 `  Bound 
 ${ 
 boundIdx 
 } 
 : ( 
 ${ 
 bound 
 . 
 x 
 } 
 , 
 ${ 
 bound 
 . 
 y 
 } 
 )` 
 ); 
  
 }); 
 }); 
 

Python

Before trying this sample, follow the Python setup instructions in the Vision quickstart using client libraries . For more information, see the Vision Python API reference documentation .

To authenticate to Vision, set up Application Default Credentials. For more information, see Set up authentication for a local development environment .

  def 
  
 detect_crop_hints_uri 
 ( 
 uri 
 ): 
  
 """Detects crop hints in the file located in Google Cloud Storage.""" 
 from 
  
 google.cloud 
  
 import 
 vision 
 client 
 = 
 vision 
 . 
  ImageAnnotatorClient 
 
 () 
 image 
 = 
 vision 
 . 
  Image 
 
 () 
 image 
 . 
 source 
 . 
 image_uri 
 = 
 uri 
 crop_hints_params 
 = 
 vision 
 . 
  CropHintsParams 
 
 ( 
 aspect_ratios 
 = 
 [ 
 1.77 
 ]) 
 image_context 
 = 
 vision 
 . 
  ImageContext 
 
 ( 
 crop_hints_params 
 = 
 crop_hints_params 
 ) 
 response 
 = 
 client 
 . 
 crop_hints 
 ( 
 image 
 = 
 image 
 , 
 image_context 
 = 
 image_context 
 ) 
 hints 
 = 
 response 
 . 
 crop_hints_annotation 
 . 
 crop_hints 
 for 
 n 
 , 
 hint 
 in 
 enumerate 
 ( 
 hints 
 ): 
 print 
 ( 
 f 
 " 
 \n 
 Crop Hint: 
 { 
 n 
 } 
 " 
 ) 
 vertices 
 = 
 [ 
 f 
 "( 
 { 
 vertex 
 . 
 x 
 } 
 , 
 { 
 vertex 
 . 
 y 
 } 
 )" 
 for 
 vertex 
 in 
 hint 
 . 
 bounding_poly 
 . 
 vertices 
 ] 
 print 
 ( 
 "bounds: 
 {} 
 " 
 . 
 format 
 ( 
 "," 
 . 
 join 
 ( 
 vertices 
 ))) 
 if 
 response 
 . 
 error 
 . 
 message 
 : 
 raise 
 Exception 
 ( 
 " 
 {} 
 \n 
 For more info on error messages, check: " 
 "https://cloud.google.com/apis/design/errors" 
 . 
 format 
 ( 
 response 
 . 
 error 
 . 
 message 
 ) 
 ) 
 

gcloud

To perform text detection, use the gcloud ml vision suggest-crop command as shown in the following example:

gcloud  
ml  
vision  
suggest-crop  
 gs://cloud-samples-data/vision/crop_hints/bubble.jpeg 

Additional languages

C#: Please follow the C# setup instructions on the client libraries page and then visit the Vision reference documentation for .NET.

PHP: Please follow the PHP setup instructions on the client libraries page and then visit the Vision reference documentation for PHP.

Ruby: Please follow the Ruby setup instructions on the client libraries page and then visit the Vision reference documentation for Ruby.

Try it

Try crop hint detection below. You can use the image specified already ( gs://cloud-samples-data/vision/crop_hints/bubble.jpeg ) or specify your own image in its place. Send the request by selecting Execute.

Image before crop
Image credit : Yasmin Dangor on Unsplash .

Request body:

{
  "requests": [
    {
      "image": {
        "source": {
          "gcsImageUri": "gs://cloud-samples-data/vision/crop_hints/bubble.jpeg"
        }
      },
      "features": [
        {
          "type": "CROP_HINTS"
        }
      ],
      "imageContext": {
        "cropHintsParams": {
          "aspectRatios": [
            2
          ]
        }
      }
    }
  ]
}
Create a Mobile Website
View Site in Mobile | Classic
Share by: