Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> To better measure the performance of TransCoder and other code translation techniques, we’ve created a new metric called computational accuracy, which evaluates whether the hypothesis function generates the same outputs as the reference when given the same inputs. We are also releasing our test set and the scripts and unit tests we used to compute this metric.

It reads as if they used a test suite to confirm wether the translation represents the same function.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: