TY - GEN
T1 - Building an Italian-Chinese Parallel Corpus for Machine Translation from the Web
AU - Tse, Rita
AU - Mirri, Silvia
AU - Tang, Su Kit
AU - Pau, Giovanni
AU - Salomoni, Paola
N1 - Publisher Copyright:
© 2020 ACM.
PY - 2020/9/14
Y1 - 2020/9/14
N2 - In an increasingly globalized world, being able to understand texts in different languages (even more so in different alphabets and charsets) has become a necessity. This can be strategic even while moving and travelling across different countries, characterized by different languages. With this in mind, bilingual corpora become critical resources since they are the basis of every state-of-the-art automatic translation system; moreover, building a parallel corpus is usually a complex and very expensive operation. This paper describes an innovative approach we have defined and adopted to automatically build an Italian-Chinese parallel corpus, with the aim of using it for training an Italian-Chinese Neural Machine Translation. Our main idea is to scrape parallel texts from the Web: we defined a general pipeline, describing each specific step from the selection of the appropriate data sources to the sentence alignment method. A final evaluation was conducted to evaluate the goodness of our approach and its results show that 90% of the sentences were correctly aligned. The corpus we have obtained consists of more than 6,000 sentence pairs (Italian and Chinese), which are the basis for building a Machine Translation system.
AB - In an increasingly globalized world, being able to understand texts in different languages (even more so in different alphabets and charsets) has become a necessity. This can be strategic even while moving and travelling across different countries, characterized by different languages. With this in mind, bilingual corpora become critical resources since they are the basis of every state-of-the-art automatic translation system; moreover, building a parallel corpus is usually a complex and very expensive operation. This paper describes an innovative approach we have defined and adopted to automatically build an Italian-Chinese parallel corpus, with the aim of using it for training an Italian-Chinese Neural Machine Translation. Our main idea is to scrape parallel texts from the Web: we defined a general pipeline, describing each specific step from the selection of the appropriate data sources to the sentence alignment method. A final evaluation was conducted to evaluate the goodness of our approach and its results show that 90% of the sentences were correctly aligned. The corpus we have obtained consists of more than 6,000 sentence pairs (Italian and Chinese), which are the basis for building a Machine Translation system.
KW - Italian-Chinese corpus
KW - bilingual annotation
KW - machine translation
KW - sentence alignment
UR - http://www.scopus.com/inward/record.url?scp=85091316968&partnerID=8YFLogxK
U2 - 10.1145/3411170.3411258
DO - 10.1145/3411170.3411258
M3 - Conference contribution
AN - SCOPUS:85091316968
T3 - ACM International Conference Proceeding Series
SP - 265
EP - 268
BT - Proceedings of the 6th EAI International Conference on Smart Objects and Technologies for Social Good, GOODTECHS 2020
PB - Association for Computing Machinery
T2 - 6th EAI International Conference on Smart Objects and Technologies for Social Good, GOODTECHS 2020
Y2 - 14 September 2020 through 16 September 2020
ER -