SyntNN at SemEval-2018 task 2: is syntax useful for emoji prediction? embedding syntactic trees in multi layer perceptrons

2018 · Proceedings of The 12th International Workshop on Semantic Evaluation

Authors: Andrea Santilli, Fabio Massimo Zanzotto

In this paper, we present SyntNN as a way to include traditional syntactic models in multilayer neural networks used in the task of Semeval Task 2 of emoji prediction. The model builds on the distributed tree embedder also known as distributed tree kernel. Initial results are extremely encouraging but additional analysis is needed to overcome the problem of overfitting.

Full paper