Label Assist
This article applies to these versions of LandingLens:
| LandingLens | LandingLens on Snowflake |
|---|---|
The Label Assist tool suggests new labels or improvements to labels after training a model in an Object Detection project. Use Label Assist to speed up the labeling process and help make your labels (“ground truth” annotations) more accurate, so that the next model will have better performance.
Label Assist can spot missing labels and suggest label improvements. For example, if there’s a large space between an object and the original bounding box, Label Assist might suggest a tighter label.
Label Assist shows you its suggestions on the image details page as dashed bounding boxes. Click a suggestion to accept it, or click Accept All to accept all suggestions for an image. After reviewing and accepting suggestions, train the model again to include the newest labels in a model.
Label Assist Requirements
- Label Assist is only available for Object Detection projects.
- A model must be created for Label Assist to work. Label Assist offers suggestions based on the predictions of the selected model.
Use Label Assist
Follow the instruction below to turn on and use Label Assist. To see everything you can do with Label Assist, go to Actions Available in Label Assist.
- Open an Object Detection project that you’ve created a model for.
- Open the image you want to see suggestions for.
- If the Image Details panel isn’t open, click the i button to open it.
- Click Label Assist in the Predictions panel.
- Turning on Label Assist shows the suggestions and puts you in “label mode”, which means that you can add and edit labels.
- Each suggestion is marked with an animated dashed bounding box. Click a suggestion to accept it. This means that the suggestion turns into a label (“ground truth”). For example, in the screenshot below, clicking either of the purple dashed boxes will turn it into a “Hard Hat” label.
- You can also Click Accept All to turn all suggestions into ground truths.
- You can edit any labels when Label Assist is on. This means you can add, resize, and delete labels.
- When you’re done reviewing and accepting suggestions, click the toggle next to Label Assist.
- If you want to see Predictions again, click the Pan icon or press a to exit “label mode”.
Actions Available in Label Assist
You can perform the following actions when the Label Assist tool is on.
| Goal | Actions and More Information |
|---|---|
| Accept a suggestion | Click the suggestion (the animated dashed bounding box). |
| Accept all suggestions | Click Accept All. |
| See different suggestions | Move the Confidence Threshold slider to show more or fewer suggestions. Higher thresholds typically yield fewer suggestions. Changing the threshold here doesn’t change the model’s actual threshold. |
| Make suggestions more accurate | Suggestions might not be completely accurate. For example, there might be too much space between the bounding box and the object of interest. In this situation, click a suggestion to accept it. Then resize and move the label. You can resize and move all labels when Label Assist is on, including the labels that were added before the model trained. |
| Don’t accept wrong suggestions | If a suggestion is wrong, simply ignore it. |
| Turn off Label Assist | When you’re done reviewing and accepting suggestions, click the toggle next to Label Assist. |
Run Label Assist on Images Uploaded After Training a Model
If you upload an image to a project after a model was trained, the model won’t have any predictions for the image yet, which means that Label Assist won’t have any suggestions.
To get a suggestion on an image uploaded after a model was trained, turn on Label Assist and click Get Suggestion. This will cost 1 credit because the image makes a prediction on the image. (The credit cost is not applicable when using .)