Evaluating your translations

From cdec Decoder

For statistical reliability when reporting translation quality results, you are strongly encouraged to consider using this tool.

For other use cases (system development, optimizaton, etc.), cdec has a library that implements a variety of standard MT evaluation metrics, including

• BLEU,
• TER,
• a linear combination of arbitrary metrics,
• evaluation using an external tool that implements a simple text-based interface for communication with cdec.

Furthermore, you can implement your own translation metric by implementing the EvaluationMetric interface defined in mteval/ns.h. This will let you use it in optimization procedures support "loss functions".