Abstract

Shared tasks are a work format prevalent in the natural language processing and machine learning community. This special issue continues the reporting on the shared task SANTA (Systematic Analysis of Narrative levels Through Annotation), which has the development of annotation guidelines for narrative levels as its goal. Narrative levels, also known as embedded narrations, are omnipresent in many kinds of narrations, and one of the core concepts of narratology. In this introduction, we summarize the current state, report on the second annotation round in SANTA, draw some conclusions and, finally, derive some recommendations for future shared tasks in the digital humanities.

Highlights

  • Shared tasks are a work format prevalent in the natural language processing and machine learning community. This special issue continues the reporting on the shared task SANTA (Systematic Analysis of Narrative levels Through Annotation), which has the development of annotation guidelines for narrative levels as its goal

  • We summarize the current state, report on the second annotation round in SANTA, draw some conclusions and, derive some recommendations for future shared tasks in the digital humanities

  • We adopted the principle of shared tasks from natural language processing to digital humanities, bringing together two perspectives that typically are present in this interdisciplinary field: the information or computer science perspective and the humanities perspective

Read more

Summary

Journal of Cultural Analytics

On Organizing a Shared Task for the Digital Humanities – Conclusions and Future Paths.

JOURNAL O F CULTURA L ANALYTICS
Second shared task
Revisions of the Shared Task Process
Revision of the Submitted Guidelines
Revision of the Annotation Process
Revision of the Evaluation Process
Own approach x x
Focalisation xx
Evaluation Results
Text Mean Dev Min Max Best Guideline
About Guideline Creation
About Annotation
About the Evaluation

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.