Providing Feedback on Annotations
- To provide feedback you will first need to select cells either on the embedding or in the Cell Labels side panel and then click the Provide feedback button to open the feedback window with three options: Agree, Disagree and Don't know.
- To agree with an annotation, select Agree and either press Send My Feedback or first enter optional comments to include with your agreement.
- To disagree with a annotation, select Disagree and then select from one of three options: whether the annotation should be split into two or more cell labels, merged with another annotation or general disagreement.
- To disagree with an annotation and suggest it be split in to two cell labels, select the cell label, click Disagree and then Disagree: Split. Then provide the optional cell label names and marker genes and the required explanation of why the cell label should be split.
- To disagree with an annotation and suggest it be merged with another cell label, select the cell label, click Disagree and then Disagree: Merge. You will then need to select the cell label to merge it with and then click Continue Providing Feedback. You will be prompted to provide an explaination of why the labels should be merged and then click Send My Feedback.
- To disagree and leave a comment, select the cell label, click Disagree and then Disagree with a comment. Provide the explanation of why you disagree with the annotation and click Send My Feedback.
- To agree with the annotation but disagree with the metadata, select the cell label, click Disagree and then send your metadata refinements. Click Refine Metadata, enter your suggestions and click Send Changes.
- If you are unsure about an annotation, select the cell label, click Provide Feedback and then select I Don't Know. You can optionally include an explanation or click Send My Feedback.
- A summary of the feedback provided by all users can be viewed in the Cell Label side panel.
- If needed, you can delete your feedback by clicking on the feedback you would like to delete in the side panel and click Delete Feedback in the pop-up window.
- An overview of the feedback by each feedback category can be viewed on the embedding by selecting the relevant feedback type in the Plot Feedback dropdown menu.
- Summary of feedback from all reviewers can be viewed by returning to the dataset page and clicking on Feedback Received. Additionally, you can download the feedback as a csv file by clicking on the Export CSV icon.
- To sort the feedback by the most agreements, disagreements or I don't know responses, click on Sorting and select how you would like the feedback sorted.
- To filter by the type of feedback or by the cell label click on the feedback type or cell label you would like to filter by.