Email or username:

Password:

Forgot your password?
mcc

Fascinating both for what it says about dev & what it says about statistics:

A gamedev realized Linux users were just 5.8% of their sales, but represented 38% of bug reports.

Then they looked at those numbers closer, and realized. Linux users were not experiencing more bugs. Almost none of the Linux-user bugs were Linux-related. Linux users were simply *more likely to file bugs*.

Their conclusion: A linux port pays for itself bc it nerdsnipes ppl into giving u free QA

techhub.social/@ozone89/111337

117 comments
mcc

This is the "what if lab rats just get cancer a lot" joke except real

Do you have a correlation in your data? Or is one of your sample groups simply more likely to generate *statistics*?

modulux

@mcc Sometimes I wonder if Firefox isn't heavily under-measured as a browser because it's run by privacy nerds who set up no telemetry, no js, or other forms of blocking that obscure it, for example.

phii (local floofgirl cutie)

@mcc i might be wrong about this but isn't it actually even the other way round, with rats that were bred to be cute and pet-like having a higher cancer risk than lab rats due to being over-bread?

bc when me and my relatives had rats that were bread to be kept as pets they all died rlly quickly, but then we got lab rats instead (as pets, i mean) and they lived for wayy longer

kinyutaka

@phseiff @mcc

There's still a lot of factors that have to be accounted for.

For example, the lab rats are bred and designed to be as healthy as possible, while the pet rats are bred to simply survive long enough for a child to grow bored of them.

And then fed to the pet snake.

Irenes (many)

@mcc Linux users are immersed in a culture that explicitly views software as a communal effort, working towards common purpose. Maybe that idea isn't explicit for everyone, but when people are steeped in it, of course they contribute bug reports! A bug report is an attempt to help the project! It may also feel like a complaint, but the material effect of it is helpful.

Emma Builds πŸš€

@irenes @mcc brushing the oxidation off my Bugzilla search skils confirms that Linux is responsible for disproportionately more bug reports to the size of the user base as a whole.

Windows is 85% of Firefox users on desktop, see data.firefox.com/dashboard/har.

I can write this up as a blog post if folks are interested.

Irenes (many)

@emma @mcc also can we just say that it took us a moment to realize you weren't trying to say anything about rust the programming language there :)

mcc

@irenes Or they value their time less "lol"

Janne Moren

@irenes @mcc
It's probably more simple than that. A much higher proportion of Linux users work in jobs related to software development or deployment, or have that as a hobby. That background is likely what attracted them (us) to the OS in the first place.

And so a much higher proportion know that filing bug reports is important, and a much higher proportion is familiar and comfortable with the process.

Siderea, Sibylla Bostoniensis

@jannem

The Golden Rule in action: "Well, I'd certainly hope somebody would file a bug report to let me know about an issue in *my* project!"

@irenes @mcc

Irenes (many)

@siderea @jannem @mcc that's honestly a good point. we think it's still compatible with what we said, but yeah that does deserve to be mentioned

Klara Binon

@irenes @mcc if you might be able to look at which windows users file bugs, maybe many are involved in open source as well

Irenes (many)

@Klara @mcc interesting thought. seems a little invasive to go digging that up about people, though we don't doubt it's possible these days. cool speculation though

Klara Binon

@irenes @mcc
Taking care of the commons is something we do, and it spills over to things that are technically owned but that we use together.

mcc

"A recent study performed on the University of Toronto campus with participants selected by responding to a flier offering $5 for participation, revealed that 92% of all Canadians are students at University of Toronto…"

(This is a joke; I suspect sociologists have some way of correcting for this already)

(EDIT: Note I am not saying I believe the way sociologists have of correcting for it *works*.)

Jason Petersen

@mcc uh IIRC this is a β€œjoke but not really” in psychology and social sciences.

The joke is β€œadd β€˜among mostly 18–22yos with the social status to be in college’ to every psychology paper”

keithzg
@mcc The important thing is to try a number of different "corrections" until you find it creates a statistically significant result you can publish
Sven :8bit_mario2:

@mcc 98% of people say that they enjoy responding to surveys. πŸ˜‰

πŸ†˜Bill Cole πŸ‡ΊπŸ‡¦

@mcc #RandomPedantry
Lab rats in fact DO get cancer more than normal. There are tightly-inbred strains of mouse and rat bred for higher cancer susceptibility. For exactly the reason the Linux users are valued...

Siderea, Sibylla Bostoniensis

@mcc This is a huge, huge, huge problem in personality science. If you want to get any sort of demographic information, about the distribution of traits through a population, you can't actually do it through voluntary testing, because the selection indexes of so many interesting things on "who is voluntarily willing to take a personality test" are kind of astronomical.

Andy Wootton

@mcc It also seems related to the famous case of the analytical error of deciding where WW2 aircraft needed better armour, based on statistics about the location of holes in returning planes. Windows users learn to expect to be shot down because they have no say in what gets armoured.

Elissa

@mcc Yes. I've found this. You get more nuanced, useful, interesting bug reports and genuine desire to help you sort obscure problems out - almost always without the PRESUMPTION that you can or will.

It's part of why I intend to release all my future games on Linux, ideally on as broad a set of hardware as possible.

mcc

@vampiress Yeah, the linked dev noticed the same effect

Elissa

@mcc Tbh my next little game uses ncurses to making it work on windows will be a waking nightmare. So I am tempted to just... not.

I am NOT trying to make money with these games. I am doing them for fun. If I just release it on linux and mac... I get dedicated players, technically savvy, interested in niche games... and I don't have to support Windows users.

grawity

@vampiress probably depends on which versions you intend to target; Win7 would still be hell (or Cygwin which is its own hell), but for Windows 10 (with its built-in VT support) I kind of expect ncurses stuff would Mostly Work? they've been moving towards VT pretty hard recently

(I guess it helps that they've been working on it on GitHub where people don't shy away from reporting bugs, too)

Sven/Sarah

@vampiress @mcc but shouldn't current Windows versions be fine here due to improved terminal support? πŸ€” Just require Windows 10 with the 1511 update and you should be good to go πŸ˜…

Elissa

@pascaldragon @mcc So I read. Then I tried to get it working and it was a nightmare. So no, not quite that simple.

Elissa

@pascaldragon @mcc TBH I plan to do an SDL based version anyway so I might just wait until that’s done before doing a Windows version.

Elissa

@pascaldragon @mcc Also just... you make a text mode game, you get linux and mac people interested. My last one HAS a windows version but from what limited telemetry I have almost nobody uses the windows version.

Christopher Biggs

@vampiress @mcc Id so be there for releasing it as a self booting ISO on 75mm CD and novelty-shaped usb stick.

StenPett

@vampiress @mcc well now you've made me curious! What is this ncurses based game you're talking about, and where/when can I get a hold of a copy?

Elissa

@stenpett Thanks! It's been a blast to work on, and learn more about roguelikes in the process.

Howard Chu @ Symas

@vampiress @mcc I used to work with ncurses on Windows; had to load ansi.sys in config.sys back then. It was easier to start with the Atari ST port of ncurses than to try to get the plain Unix version working.

Dana Fried

@mcc devil's advocate: adding a Linux version not only incurs the cost of developing and supporting a new platform, but also a massive amount of QA and dev time processing low-severity bug reports for issues that probably don't affect the average user's experience enough for them to care *and* all you get is about a 5% bump in sales. So it's almost certainly not worth it.*

* Or at the very least, only worth supporting SteamDeck hardware.

ToxinVX

@tess @mcc You don't need to go through the entire portinh process to get your game on Linux. With Proton you don't even need to compile a separate Linux binary, so you just get a free 5% more sales, and if there are any issues, they take it up with Wine/Proton devs instead of you. Just make sure your anticheat is configured to support Proton

Oblomov

@tess @mcc counter: and that's why most corporate software is crap that only works β€œif you hold it right”.
(The reason why FLOSS is crap is different.)

Sylwia πŸ³οΈβ€βš§οΈ
@tess @mcc bruh did you even read the thing? The bugs affected everyone. And the cost of porting to Linux is worth it.
David Todd McCarty

@mcc @skry And that’s the difference between glossing over data and actually deciphering what it means. How often do companies never get past the first part?

aerique

@davidtoddmccarty @mcc @skry The ones that decide to stop supporting Linux.

the clownward spiral

@mcc This tracks for me. I assume most open-source stuff is run by accessible people who care about the software, otherwise why the heck would they bother with any of this? But most corporate bug reports are shouting into the void.

One exception is when I filed a Radar ticket for some wacky behavior in, I think, an Apple AirPort WiFi base station. And I *got a call* from someone at Apple, who gave me a special diagnostic tool to collect more data. Never had anything like that happen before.

πŸ’¬

@ieure @mcc congrats! every radar I file gets closed as a forward dupe*, which I guess means someone intends to work on it but Apple doesn’t want any of that to be visible to a member of the unwashed public?

* β€œclosed as duplicate” of a higher-numbered radar

Berkubernetus

@mcc can support. I used a music player for a while that had a linux port. Desipte their being like a few dozen Linux users, we filed over half of all bug reports, and most of those were UX/server issues.

Smythe

@mcc automatic +1 for coining the term β€œnerdsnipe”! πŸ‘πŸΌ

Willow "Wolveric" Catkin

@mcc Ah yes... the age old story from the PA:T devs... 😹

Korruptor

@mcc yup. That’s been my experience. They’re also more likely to suggest a fix, as well. I’ve had three or four serious bug reports come with a probable solution and logs.

Quinn9282βœŒοΈπŸ‘‹

@mcc It's always been my experience that most open source/Linux software devs tend to care more about bug reports than most corporations do. Like you'll submit a bug report and it might actually get fixed.

...Unlike most corporate software, where you'll submit a bug report, and it NEVER gets fixed, even if a lot of people are having the same problem. The only time they might actually care about bug reports is if it prevents you from properly using/opening the software at all...

penny
@mcc wait i just noticed i got that game from a steam coupon lmao nice
Kevin Granade

@mcc "Open source is weaponized Cunningha'sm law." -me

Al

@mcc
i'll bet that holds, in general, for people on fediverse stuff. Its not so much nerd and people who care and want to help others.

Team Idgara

@mcc @sadmac356

At work, I have a bit of a reputation as the best person to report bugs on our internal tools.

I put #Linux on my desktop when IBM threw in the OS/2 towel.

One of my other oddities is that my first #Windows was 7 because I needed it for the required tech apps class when I went back to college as a non-traditional student.

And here I thought I wrote good reports because I used to do tech support for a dial-up ISP.

"The thing is borken. Here is how you can prove to yourself that I am observing a real issue. You can follow along using the attached screenshots."

@mcc @sadmac356

At work, I have a bit of a reputation as the best person to report bugs on our internal tools.

I put #Linux on my desktop when IBM threw in the OS/2 towel.

One of my other oddities is that my first #Windows was 7 because I needed it for the required tech apps class when I went back to college as a non-traditional student.

AlgoCompSynth by znmeb

@mcc Except I'm tired of doing free QA (looking at you, Microsoft `usbipd` πŸ˜‰

Josh Triplett
The sad thing is, I've seen people talk about this as a bad thing, not just a good thing. I agree with the perspective of "it's good that you get more bug reports", but some folks view this as "ugh, Linux users complain more".

And there's a small grain of truth to that. Linux users are much more likely to file bugs, and as this developer noted the bugs are generally high-quality, but one or two experiences of That One Kind Of Linux User (why aren't you prioritizing *my obscure use case*) can really spoil a developer's view of Linux users in general.
The sad thing is, I've seen people talk about this as a bad thing, not just a good thing. I agree with the perspective of "it's good that you get more bug reports", but some folks view this as "ugh, Linux users complain more".

Jubei

@mcc it really depends on the effort required to port to Linux. If your game is written for DX12 and you need to write a whole Vulkan renderer for the Linux port then perhaps not.

Victor Zambrano

@mcc @lisamelton
My dev colleagues file more bugs than my designer colleagues, due to the nature of their work. Wonder if peeling one more layer would show that Linux users file more bugs because there are more devs using Linux, which would then rewrite the maxim to β€œport to Linux to get free qa dev work”.

Raptor :gamedev:

@mcc guilty, lol, definitely submitted my share, generally with a patch and debug info. Also i found long ago when reporting bugs in games to often lie about os (gen by omission) as most devs wouldnt take it seriously otherwise, even with it being a known complained about issue with actual windows users and absolute proof. Windows players in general are so used to bugs with no path to get them fixed they complain, but never report!

Tom Forsyth

@mcc I guess when you've filed 26 bugs against device drivers just last week, filing 3 bugs against a game is how you kick back and unwind.

Maria

@TomF @mcc the real relaxation is finding existing bug reports with patches stuck in limbo that fix your issue. I'm sure those missing Xbox controller Bluetooth device IDs will get merged in any year now /s

calvin πŸ›‹οΈ

@mcc What an interesting outcome! I remember hearing the computer game Planetary Annihilation have a problem with bug reports being mostly in regards to their Linux port. I guess if this result can be shown to be true for lots of software, then it will be a good problem to have!

Patrick

@mcc it's definitely a culture aspect.

Mark

@mcc This is similar to the effect that makes Swiss trains so good.

Martin Owens :inkscape:

@mcc

I can confirm in #inkscape we get most bug reports from linux users.

But.

Part of the job of the project has to be education. How to use the tool, how to understand free software and yes, how to report bugs.

Which is just a subsection of the broader "you are invited to be a contributor, no small task is too small" and extend that to our windows and mac users.

Momo

@mcc
I was interested until I noticed that this is the guy behind βˆ†v Rings of Saturn. Now I'm on fire because he is awesome.
@vaurora

Maverynthia🌱

@mcc

I don't like the "nersnipes people into giving you free QA"
QA people should be paid.
If it's FOSS then that's fine. But this sounds like corporate that CAN pay people but don't so you pay $60 to be a beta tester.

Caio Faustino

@mcc I've seen a similar situation where the game studio just dropped support for Linux because it wasn't worth the effort. I'm not sure if in that case the reports were indeed Linux specific or if they just failed to see the bigger picture like in your case.

Mx Autumn :blobcatpumpkin:

@mcc there’s visceral joy in helping a developer debug an issue; the more I want it fixed, the more helpful I become.

Benjamin Egon

@mcc Time to release game on linux first ? Nice 😁

Β·J Mopp

@mcc I do think that every self-described "data-driven" entity needs this as mandatory reading. The numbers don't tell you everything.

Habrok

@mcc Also, I found the detail about the different quality of the bug reports quite interesting, that the reports from Linux users more often contained possibly relevant info like software versions, crash dumps, logs, steps to reproduce the bug etc. instead of "after some hours of playing, the game crashes"

Tak!

@mcc This was also my experience when I was maintaining linux support for unity

Jan Ciger

@mcc I have seen it used also the other way around - "Tiny minority with little/no impact on revenue but causing disproportionate amount of support noise/complaints, so we can't economically justify maintaining Linux support for our sw ..." 🀷

spyke

@mcc As a Linux user I cannot relate "none of the bugs were Linux-related".

Androcat

@mcc It also says something about Linux that many Linux advocates would deny: Linux requires a more expert user than other OSes.

Of course, having a higher bar for entry is the opposite of inclusiveness.

That is something Linux developers should take seriously.

PSiReN-X :verified_paw:​

@mcc

That is #QuiteInteresting; is there any #Data on the #Quality of those #BugReports; i.e. what #Proportion of those #Reports were #JustGarbage...? Or, is the #Statement below merely #Experiential... #Otherwise, we're not #Comparing #LikeWithLike for a #MeaningfulInterpretation.

πŸ§™βš”οΈπŸ€–πŸΊπŸ€–βš”οΈπŸ§™ | β˜•πŸŽ πŸ¦ΉπŸ¦„πŸ¦ΉπŸŽ β˜•

Hugo Devillers

@mcc Too bad gamedev twitter's actual takeaway was "Linux ports are a waste of effort" and circlejerk ensued.

Kevin Trainor

@mcc Great post. I have long believed that most software problems go unreported. I am not surprised that Linux users might have the determination and grit to buck that trend.

skyeye

@mcc
I always thought this was the case cause no windows user would take the time to figure out how to submit a bug report to a dev. Its also a stupid complaint cause any other developer would be happy to have someone submit a bug report rather than vaguely complain about an issue on Reddit or Twitter. But game devs don't want to fix their games I guess

MatΔ›j Cepl πŸ‡ͺπŸ‡Ί πŸ‡¨πŸ‡Ώ πŸ‡ΊπŸ‡¦

@mcc IIRC, the same was long time ago conclusion by #Mozilla with bugs for #Firefox. Which is the reason why they happily build #Linux binaries and do a lot to support Linux users even though they are tiny minority of their users. But they do file bugs and more often than others even reasonable and actionable bug reports.

Shockola!

@mcc we CANNOT let anyone in management hear the phrase "free QA"

StarkRG

@mcc I've seen several cases where game developers have dropped Linux support because they completely misunderstood this concept.

Leonard Ritter

@mcc while this is nice to hear, and not unexpected, i must object to calling this "nerdsniping" as if linux users were somehow bamboozled into doing free work here.

the linux community operates under an unwritten cooperative social contract: users co-own the software & in return go the extra mile to improve it. even when the game provided is closed and for-sale, users still hold up their end of the deal; mostly out of habit, but it also renders the developer indebted to the community.

n3wjack

@mcc isn't that because a lot of Linux users work in IT and are themselves developers?
I'm a dev myself and I frequently report bugs I encounter in any software I use.

Zlendy

@mcc@mastodon.social That's a really good example of the FOSS spirit, even if the game itself isn't Free Software.

Go Up