Enhancing Labeling Result Insights Through Project Analytics
At Datasaur, we're constantly working to improve our data labeling platform and provide our users with valuable insights into their projects. We're excited to introduce some significant enhancements to our Project Analytics feature, designed to give you a clearer picture of your labeling efforts and results.
Instant Project Summary
Upon completing a project in Reviewer Mode, you'll now be greeted with a handy summary dialog. This snapshot provides key metrics about your project, including:
- Label/answer statistics
- Time spent on the project
- A convenient export option for your data
This immediate feedback allows users to quickly assess the project's outcome and take necessary actions without diving deep into the full analytics.
Comprehensive Project Report
For those who need more detailed information, we've added a new "Project Report" tab to our existing Project Analytics page which can easily be accessed from the summary dialog above. This report offers a more in-depth look at your project's performance. Here's what you'll find:
- Detailed Metrics: A thorough breakdown of the statistics you saw in the summary dialog.
- Inter-Annotator Agreement (IAA) Analysis: We now provide a focused IAA comparison between reviewers and individual labelers. This helps identify discrepancies and areas for improvement in your labeling process.
- Top Label Classes or Selected Answers: Depending on your project type, you'll see:
- For Span and Bounding Box projects: Most frequently used label classes
- For Row and Document Labeling: Most common selected answers
- For mixed labeling projects: A combination of both
This new report structure gives you a high-level overview of your labeling results, making it easier to spot trends, assess quality, and make informed decisions about your data labeling strategy.
We believe these enhancements will significantly improve your ability to analyze and understand your project outcomes. As always, we're keen to hear your feedback and continue improving our platform to meet your needs.
