Abstract
Within the natural language processing (NLP) community, shared tasks play an important role. They define common goals and allow the comparison of different methods on the shared problems and data. SemEval-2018 Task 7: Semantic Relation Extraction and Classification in Scientific Papers (SE18T7) involves the identification and classification of relations in abstracts from computational linguistics (CL) publications. In this paper we describe an attempt to reproduce the methods and results from the top performing system at for SE18T7. We describe challenges we encountered in the process, report on the results of our system, and discuss the ways that our attempt at reproduction can inform best practices