View on GitHub

Research Review Notes

Summaries of academic research papers

Natural Language Multitasking: Analyzing and Improving Syntactic Saliency of Hidden Representations


Idea

The authors make the claim that training autoencoded representation for multiple linguistics tasks, to improve the syntactic preservation in the representation.

The authors also claim that this leads to the ability to perform Word2Vec-style arithmetic that causes syntactic modifications to sentences.

Method

Architecture

architecture

Observations