GUIDE NLP Autolabeling with Quality Assurance 🤖

Question Answering

If you want to train a question answering machine learning model, use this template to develop a dataset. This template prompts annotators to read a passage of text, then highlight the span of text that answers a specific question.

Interactive Template Preview

Labeling Configuration

<View>
  <Header value="Please read the passage" />
  <Text name="text" value="$text" granularity="word"/>
  <Header value="Select a text span answering the following question:"/>
  <Text name="question" value="$question"/>
  <Labels name="answer" toName="text">
    <Label value="Answer" maxUsage="1" background="red"/>
  </Labels>
</View>

About the labeling configuration

All labeling configurations must be wrapped in View tags.

You can add a header to provide instructions to the annotator:

<Header value="Please read the passage" />

Use the Text object tag to display a passage of text to the annotator:

<Text name="text" value="$text" granularity="word"/>

Use the granularity parameter to ensure that highlighted text spans include complete words.

You can add a header to provide instructions to the annotator:

<Header value="Select a text span answering the following question:"/>

Use another Text object tag to display a second text snippet, in this case, a question about the text, to the annotator:

<Text name="question" value="$question"/>

The name parameter must be different from the name used for the first text snippet, and the value is used to reference a column in a CSV file or a key in a JSON file with the text to display. You can also display static text with the value argument.

Use the Labels control tag to provide an Answer label for the annotator to use to highlight the answer to the question in the original text passage:

<Labels name="answer" toName="text">
    <Label value="Answer" maxUsage="1" background="red"/>
</Labels>