7th PhD Day. Term Translation with Domain Adaptation and Lexical knowledge. Mihael Arcan UNLP, Galway

Transkript

1 7th PhD Day Term Translation with Domain Adaptation and Lexical knowledge Mihael Arcan UNLP, Galway Date:

2 Introduction Motivation Issues with Term Translation with Statistical Machine Translation (SMT) Improving Term Translation with Domain Adaptation and Lexical knowledge Enhancing Models with Lexical Knowledge Domain-Specific Translation Model generation Evaluation Future Work

3 Motivation Cross-Lingual Information Retrieval Cross-lingual Knowledge Access & Presentation (Monnet Project) Multilingual Web of Data

4 Issue 1 with Term Translation with SMT Source text: photochromism Reference text: Photochromie Target text (generic model) photochromism photochromism (1) Out-of-Vocabulary (OOV) Problem Target text (domain-specific model) photochromism (1) Google Translate, '14

5 Issue 2 with Term Translation with SMT Source text: Reference text: cash flow hedges Absicherungen von Zahlungsströmen Target text (generic model) Cashflow Hecken Cash-Flow-Sicherungsgeschäften ( ) Cashflow-Hedges ( ) (1) > Target text (domain-specific model 2 ) Absicherungen von Zahlungsströmen ( ) (1) Google Translate, '14 (2)

6 Domain-specific data selection from WWW reduces: Out-Of-Vocabulary Problem Semantic noise / ambiguity in translation model

7 Domain-specific data selection from WWW Source / Test Set = IFRS (financial) ontology BLEU Europarl JRC-Acquis ECB Domain-specific Model (20K sentences) reduces: Google Out-Of-Vocabulary Translate Problem Bing Semantic Translator noise / ambiguity in translation model

8 Domain-specific data selection from existing resources Subtitles Europarl 1.9M sent. JRC- Acquis Parallel sentence selection based on: perplexity (Moore and Lewis, 2010), tf-idf (Hildebrand et al., 2005) infreq. n-gram recovery (Gasco et al., 2012) n-gram overlap query expansion Word2Vec* n-k sentences n-gram + Word2Vec... *

9 Domain-specific data selection from existing resources Europarl ataxia and anemia could be viral Subtitles 1.9M sent. JRC Acquis infection ( ) encephalitis ( ) syndrome ( ) anaemia ( ) gastroenteritis ( )... intestinal infectious diseases* n-k sentences infection ( ) gastroenteritis ( ) disease ( ) autoimmune ( ) respiratory ( )... COSINE SIMILARITY *ICD (International Classification of Diseases) ontology

10 ICD ontology Domain-specific data selection from existing resources Subtitles Europarl 1.9M sent. n-k sentences JRC Acquis Method / Test Set = ICD BLEU generic Translation Model 6.6 EMEA TM (1M, medical) 7.0 perplexity 6.3 tf-idf 4.5 infreq. n-gram 8.1 Word2Vec similarity 6.6 n-gram overlap 7.1 n-gram + Word2Vec similarity 7.3 n-gram + Word2Vec + infreq. n-gram similarity (+...) 8.8 reduces: ambiguity in translation model

11 Avoiding OOV with Extracting lexical knowledge

12 Avoiding OOV with Extracting lexical knowledge

13 Avoiding OOV with Extracting lexical knowledge IATE* vs Wikipedia (Category WSD) vs Wikipedia (Abstract WSD) IATE (en->it) WIKI (en->it) IATE (it->en) WIKI (it->en) *Inter-Active Terminology for Europe

14 Domain-Specific Injection into SMT Domain-specific parallel data with concatenation Generic data FillUp Model (Bisazza et al., 2011) up to 13% improvement (Computerm'14)

15 Domain-Specific Injection into SMT Domain-specific lexical knowledge injection with XML Markup administered once every two weeks as a single intravenous <n translation="iniezione" prob="1">injection</n> in order to... Cache-Based Models (Bertoldi et al., 2013) improvements up to 15% BLEU over the baseline and 5-8% over the XML Markup (AMTA'14)

16 Extracting / aligning terminology from parallel data ( 3 ) ias 35 is replaced by ifrs 5 [ non-current assets held for sale and discontinued operations ] as set out in the annex to this regulation ; ias 35 wird durch ifrs 5 ( zur veräußerung gehaltene langfristige vermögenswerte und aufgegebene geschäftsbereiche ) wie im anhang zu dieser verordnung dargelegt ersetzt.... ifrs non-current assets sale regulation operations SMT Ifrs langfristige vermögenswerte geschäftsbereiche verordnung *BATMAN = BilinguAl TerM AligNer

17 Extracting / aligning terminology from parallel data ( 3 ) ias 35 is replaced by ifrs 5 [ non-current assets held for sale and discontinued operations ] as set out in the annex to this regulation ; ias 35 wird durch ifrs 5 ( zur veräußerung gehaltene langfristige vermögenswerte und aufgegebene geschäftsbereiche ) wie im anhang zu dieser verordnung dargelegt ersetzt.... ifrs non-current assets sale regulation operations IT Manual Dataset SMT Document level Ifrs langfristige vermögenswerte geschäftsbereiche 29.46* verordnung Baseline Cache-based TM/LM Realtime cdec 27.90* *BATMAN = BilinguAl TerM AligNer

18 Avoiding OOV with Extracting lexical knowledge (ongoing work, OOV of OOV) Multi Word Expressions Word alignments fatal familial insomnia tödliche familiäre schlaflosigkeit thrombocytopenic purpura

19 Future Work Lexical Resources comparing IATE and DBpedia with Babelfy (Babelnet) Data selection more features for the classifier Domain-Specific Injection into SMT concatenation / XML Markup / Cache-Based Approach / FillUp Model more evaluations

20 Thank You Term Translation with Domain Adaptation and Lexical knowledge