GARFrame(Semantics)

Category adding Semantics functionality to GARFrame .

Summary

Properties

 semanticConfidenceImage

CVPixelBufferRef

The latest semantic confidence image for the

 GARFrame

as a CVPixelBuffer .

 semanticImage

CVPixelBufferRef

The latest semantic image for the

 GARFrame

as a CVPixelBuffer .

Public methods

 fractionForSemanticLabel:

float

Retrieves the fraction of the most recent semantics frame that are queryLabel .

Properties

semanticConfidenceImage

  @property 
 ( 
 nullable 
 , 
  
 readonly 
 ) 
  
 CVPixelBufferRef 
  
 semanticConfidenceImage 
  
 CF_RETURNS_NOT_RETAINED 
 ;

The latest semantic confidence image for the GARFrame as a CVPixelBuffer .

Each pixel is an 8-bit integer representing the confidence of the semantic label, with 0 representing the lowest confidence and 255 representing the highest confidence.

GARFrame retains the semantic CVPixelBuffer . Holding references to GARFrame s will eventually exhaust resources.

GARFrame.semanticConfidenceImage will be nil if GARSessionConfiguration does not have GARSemanticModeEnabled set. Use isSemanticModeSupported: (GARSession(Semantics)) to check for support for the Scene Semantics API.

GARFrame.semanticConfidenceImage may be nil for the first few frames after initializing semantics, or if memory is exhausted due to retaining old GARFrame s.

Extends class

 GARFrame

semanticImage

  @property 
 ( 
 nullable 
 , 
  
 readonly 
 ) 
  
 CVPixelBufferRef 
  
 semanticImage 
  
 CF_RETURNS_NOT_RETAINED 
 ;

The latest semantic image for the GARFrame as a CVPixelBuffer .

Each pixel in the image is an 8-bit integer representing a semantic class label: see GARSemanticLabel for a list of pixel labels and the Scene Semantics Developer Guide for more information.

GARFrame retains the semantic CVPixelBuffer . Holding references to GARFrame s will eventually exhaust resources.

GARFrame.semanticImage will be nil if GARSessionConfiguration does not have GARSemanticModeEnabled set. Use isSemanticModeSupported: (GARSession(Semantics)) to check for support for the Scene Semantics API.

GARFrame.semanticImage may be nil for the first few frames after initializing semantics, or if memory is exhausted due to retaining old GARFrame s.

Extends class

 GARFrame

Public methods

fractionForSemanticLabel:

   - (float)fractionForSemanticLabel: 
 ( GARSemanticLabel 
) queryLabel

Retrieves the fraction of the most recent semantics frame that are queryLabel .

Queries the semantic image provided by GARFrame.semanticImage for pixels labeled by queryLabel . This call is more efficient than retrieving the CVPixelBuffer and performing a pixel-wise search for the detected labels.

If GARFrame.semanticImage is nil, fractionForSemanticLabel: will return 0.0.

Details

Parameters

queryLabel

the label to search for in the semantic image. See

 GARSemanticLabel

for options.

Returns

The fraction of the semantic image with the given queryLabel .

Extends class

 GARFrame