from grid.model.perception.segmentation.owlsam import OWLSAM
car = AirGenCar()

# We will be capturing an image from the AirGen simulator 
# and run model inference on it.

img =  car.getImage("front_center", "rgb").data

model = OWLSAM(use_local = False)
result = model.run(rgbimage=img, prompt=<prompt>)
print(result.shape)

The OWLSAM class implements a wrapper for the OneFormer model, which performs image segmentation using the OneFormer architecture.

​
class OWLSAM()
​
use_local
boolean
default:
"False"

If True, inference call is run on the local VM, else offloaded onto GRID-Cortex. Defaults to False.

​
def run()
​
rgbimage
np.ndarray
required

The input RGB image of shape (M,N,3)(M, N, 3).

​
prompt
str
required

The text prompt to use for segmentation.

​
Returns
np.ndarray

The predicted segmentation mask of shape (M,N)(M, N).

from grid.model.perception.segmentation.owlsam import OWLSAM
car = AirGenCar()

# We will be capturing an image from the AirGen simulator 
# and run model inference on it.

img =  car.getImage("front_center", "rgb").data

model = OWLSAM(use_local = False)
result = model.run(rgbimage=img, prompt=<prompt>)
print(result.shape)

This code is licensed under the Apache 2.0 License.

Was this page helpful?

Previous
DPV-SLAM
Next