OpenNMT: Open-Source Neural Machine Translation

in #utopian-io7 years ago (edited)

OpenNMT is a full-featured, open-source (MIT) neural machine translation system utilizing the Torch mathematical toolkit.
image.png

The system is designed to be simple to use and easy to extend, while maintaining efficiency and state-of-the-art translation accuracy. Features include:

Speed and memory optimizations for high-performance GPU training.
Simple general-purpose interface, only requires and source/target data files.
C++ implementation of the translator for easy deployment.
Extensions to allow other sequence generation tasks such as summarization and image captioning.
Installation
OpenNMT only requires a Torch installation with few dependencies.

Install Torch
Install additional packages:
luarocks install tds
luarocks install bit32 # if using LuaJIT
For other installation methods including Docker, visit the documentation.

Quickstart
OpenNMT consists of three commands:

Preprocess the data.
th preprocess.lua -train_src data/src-train.txt -train_tgt data/tgt-train.txt -valid_src data/src-val.txt -valid_tgt data/tgt-val.txt -save_data data/demo
Train the model.
th train.lua -data data/demo-train.t7 -save_model model
Translate sentences.
th translate.lua -model model_final.t7 -src data/src-test.txt -output pred.txt
For more details, visit the documentation.

Citation
A technical report on OpenNMT is available. If you use the system for academic work, please cite:


author = {{Klein}, G. and {Kim}, Y. and {Deng}, Y. and {Senellart}, J. and {Rush}, A.~M.},
title = "{OpenNMT: Open-Source Toolkit for Neural Machine Translation}",
journal = {ArXiv e-prints},
eprint = {1701.02810}
}
Acknowledgments
Our implementation utilizes code from the following:@ARTICLE{2017opennmt,

Andrej Karpathy's char-rnn repo
Wojciech Zaremba's lstm repo
Element rnn library
Additional resources
Documentation
Example models
Forum
Gitter channel
Live demo
Bibliography



Posted on Utopian.io - Rewarding Open Source Contributors

Sort:  


DO NOT FOLLOW any instruction and DO NOT CLICK on any link in the comment!

Please consider to upvote this warning if you find my work to protect you and the platform valuable. Your support is welcome!WARNING - The message you received from @adamson is a CONFIRMED SCAM! For more information, read this post: https://steemit.com/steemit/@arcange/phishing-site-reported-steemautobot-dot-ml


DO NOT FOLLOW any instruction and DO NOT CLICK on any link in the comment!

Please consider to upvote this warning if you find my work to protect you and the platform valuable. Your support is welcome!WARNING - The message you received from @adamson is a CONFIRMED SCAM! For more information, read this post: https://steemit.com/steemit/@arcange/phishing-site-reported-steemautobot-dot-ml