@oss @lanodan more like it was created before wide...

Haelwenn /элвэн/ :triskell: 's posts Post Back to profile

@oss @lanodan

more like it was created before wide adoption of Unicode, so all characters messed up.

It doesn't help that some programmers mindlessly open such old files in Windows, which will probably interpret unknown symbols as CP1251, then save it as KOI, then open it in different editor that detects it as Unicode, which then saves it back to CP1251, and... it may never stop, just more and more information getting lost forever, since it also predates wide spread of VCS.

Like 13 Apr 2022 at 20:24 | Wall-to-wall | Open on expired.mentality.rip

5 comments

Haelwenn /элвэн/ :triskell:

@a1ba @oss Makes me glad unicode exists, it would be such a nightmare to test support of multiple alphabets in testsuites otherwise.

Also probably helps on translations.

13 Apr 2022 at 20:27 | Open on queer.hacktivis.me

:umu: :umu:

@lanodan @oss not to say, the detection is a rocket science.

Bush hid the facts!

13 Apr 2022 at 20:28 | Open on expired.mentality.rip

Haelwenn /элвэн/ :triskell:

@a1ba @oss It's sort of doable on normal large pieces of text but most encoding detection libraries (and there is a ton of them) are completely stupid, like "Ã©" instead of "é" should just never happen.

And I think I'd rather have that kind of stuff and iconv being forever banned into a corner for just historical purposes of taking old text files and transforming them to utf-8.

13 Apr 2022 at 20:33 | Open on queer.hacktivis.me

:umu: :umu:

@lanodan @oss thanks Unicode exists.

Also. UTF-16 > UTF-8.

13 Apr 2022 at 20:35 | Open on expired.mentality.rip

tailful oss :senkofluffytail:

@a1ba @lanodan :ablobfoxdundundun: :ablobfoxdundundunowo: holywar has been started

13 Apr 2022 at 20:36 | Open on udongein.xyz