This article applies to these versions of LandingLens:
LandingLens
LandingLens on Snowflake
(see exceptions below)
Segmentation is used to identify objects with great precision. This is done by using a “brush” or to mark the exact location of an object you want your model to detect. This object type is commonly used for identifying irregular shapes.Let’s say you want to identify cracks in cement. You could use Object Detection; however, bounding boxes would include too much background (or space that you do not want to include in your label). During model training, the model will look at every labeled pixel. If you include extra, unimportant pixels, the model might think these pixels are also important. Instead, use Segmentation so that you can precisely label the relevant areas. Compare the labeling options in the following images:
is a labeling tool powered by the Segment Anything Model (SAM) that helps you label objects in Segmentation projects faster than using traditional methods.To use , simply select the tool (or press Q), hover over and click the object you want to select. automatically detects the shape of the object and adds a gray overlay to it. To confirm that detected the correct object, press Return (Mac) or Enter (Windows) to confirm.
Select the Class you want to label from the drop-down menu.
Hover over the object you want to select. Smart Labeling adds a gray overlay over the object it “thinks” you want to select.
Click the object. adds a green dot where you clicked. This, along with the gray overlay, help you track what regions you’ve selected. Clicking the object also adds a blue border to your frame, which indicates that you’re using .
If you want to add another region to the same object, hover over that region. The cursor turns into a + (plus).
Click the object. Smart Labeling adds a gray overlay to the object and adds a green dot where you clicked.
You can continue to add regions using this method.
Once you’ve labeled all regions of the object, either click Save Labels (Return), or press Return (Mac) or Enter (Windows).
Smart Labeling labels the object with the selected Class.
Let’s say a region gets accidentally added to your selection. While is selected, you can hover over that region until the cursor turns into a − (minus). Then click that region. removes the selection. When you’re done, press Return (Mac) or Enter (Windows).To remove a region from an object (assumes that is enabled, and you just labeled an object):
Hover over and click the labeled region. Smart Labeling removes the overlay and adds a red dot where you clicked, which helps you track what regions you’ve removed.
Continue to click selected regions until you’ve removed all the selections you want.
When you’re done removing regions, press Return (Mac) or Enter (Windows).
Let’s say you’re developing a model that detects tractors in construction sites. When using , we recommend that you label each tractor one at a time, instead of labeling them all at once. In other words, label one tractor, and then press Return (Mac) or Enter (Windows). Then label the second tractor, and so on.We don’t recommend labeling all tractors at once, and then clicking Enter/Return. Doing that makes think that these areas are the same object, and not the same type of object. If you do this, you might notice additional areas added to the object that aren’t actually part of that object.
The polygon tool lets you draw an outline of a shape. After the outline has been completed, the shape will be automatically filled. You can also use this tool to erase labeled regions.To label with polygons:
Open the Segmentation project you want to edit.
Open the image you want to label.
Click the Polygon icon. (You can also press W on your keyboard.)
Select a class from the drop-down menu.
Click where you want to start your shape. A blue circle displays, indicating the start of the shape.
Click to continue creating your shape.
Complete your shape by clicking the blue circle. The shape automatically fills with the color of the class.
You can also remove excess labels with Polygons. This process is similar to the procedure in this section. For more information on how to use the Polygon tool, go here.
To remove excess labels with a Brush:
Open the Segmentation project you want to edit.
Open the image you want to label.
Click the Brush icon. (You can also press B on your keyboard.)
Click the Erase icon. (You can also press E on your keyboard.)
Adjust the size of the eraser accordingly.
Click and drag your cursor over the area you want to remove.