Eugen RochkoApr 18, 2017
Just gonna throw this out here - any Ruby gem for relatively quick & accurate language detection that you know of?
Show threadEugen RochkoApr 18, 2017

I didn't expect anyone to think I am asking for a General AI.

I just want semi-accurate heuristic to spare users having to tag language manually.

Proprietary APIs like Google Translate are out of the question. Already using WhatLanguage, it's not working well. If I can't find anything, welp, there's that. Not a big deal.

Show threadCS
@Gargron Have you looked at the implementation of WhatLanguage? If this #Python library looks like it is sufficiently different/better, we could port it to #Ruby: https://github.com/Mimino666/langdetect
Apr 18, 2017 at 5:14pmWeb
Show threadCSApr 18, 2017

@Gargron I tried out this library on a couple Japanese toots from the federated timeline and it detected they were Japanese every time.

The algorithm used looks pretty solid as well. Would you use a #Ruby port?