Evaluating your translations

From cdec Decoder

Jump to: navigation, search

For statistical reliability when reporting translation quality results, you are strongly encouraged to consider using this tool.

For other use cases (system development, optimizaton, etc.), cdec has a library that implements a variety of standard MT evaluation metrics, including

  • BLEU,
  • TER,
  • a linear combination of arbitrary metrics,
  • evaluation using an external tool that implements a simple text-based interface for communication with cdec.

Furthermore, you can implement your own translation metric by implementing the EvaluationMetric interface defined in mteval/ns.h. This will let you use it in optimization procedures support "loss functions".

Personal tools