Pre annotation Training templates
Updated at April 3rd, 2025
This document explains how to use pre-annotations in training templates for annotation projects. Training templates are designed to simulate a real-world scenario where annotators start with an existing set of annotations (pre-annotations) and are expected to improve or correct them.
In this setup, the pre-annotations are used as the default starting point for the task, while the gold answers—the corrected and finalized version of the annotations—are used as the reference for scoring and feedback.
📘 Note
Pre-annotations in training templates are only supported in object annotation projects (i.e. projects using the annotation store).
This feature is not supported for legacy or object-less projects.
Creating a Task with Pre-Annotations
Step 1: Creat a task
Go to your project and click the plus (+) icon to create a new task. This will open a panel where you can select a JSON file to upload.
Make sure the JSON file includes the pre-annotations you want to use for the task.
Step 2: Review the created task
Once the new task with pre-annotations is created, click Annotate to open the task.
From there, you can reposition the shape or make any necessary adjustments.
Create a training Template with pre-annotations
Step 1: Create a Template
Once the training task is submitted, its Task ID can be used to create a training template in a certification project.
- Go to the Training Templates page:
https://portal.sama.com/projects/<project_id>/trainingTemplates - In the creation panel, there’s a field for the Task ID. Enter the Task ID of the task you annotated in the delivery project.
3. After creating the template, make sure to enable it so it can be used in certification.
📘 Note
When you open the template, you’ll see only one shape—this is the gold answer (the correct version).
4. On the Certification page, click "Annotate", then click "Start".
5. This will open the certification project, where you can begin your training.
6. You’ll see an annotation that needs correction. After updating the shape, click "Calculate Score" to get your score.
7. If your score is not 100%, you’ll receive feedback, which you can view by clicking the flag icon
8. You can revise your annotation based on the feedback and recalculate your score until you reach 100%.
Step 2: Start training yourself
You’ll see an annotation that needs correction. After updating the shape, click "Calculate Score" to get your score.
If your score is not 100%, you’ll receive feedback, which you can view by clicking the flag icon
You can revise your annotation based on the feedback and recalculate your score until you reach 100%.