Email or username:

Password:

Forgot your password?
Eniko | Kitsune Tails out now!

seeing pushback against procedural generation as a result of alleged "AI" and that's really fucking sad

good procedural generation is hard. good procedural generation is bespoke and intentional. good procedural generation is artistic and creative. please don't lump it in with the slop generated through machine learning 😞

EDIT: procgen is not AI, it's a 40+ year old game design technique, see: peoplemaking.games/@eniko/1131

120 comments
Xandra Granade 🏳️‍⚧️

@eniko The AI con artists have succeeded in part by absorbing shit that already existed and was really cool. It fucking sucks and really saddens me that procgen is yet another thing caught in the crossfire.

Abbie

@xgranade

Wouldn't surprise me if pro-ai/llm people started that idea intentionally.

Like calling LLM AI, and shoving it into everything, and declaring it's in stuff it's not in. It makes it hard to tell sort out the field. It's makes it feel inevitable, like it's already won, cause people to just accept it, etc.

@eniko

Frank Hightower

@antijingoist @xgranade @eniko
To be fair, LLMs are AI... in the same way that private jets are transport. But what we're doing is treating bicycles as private jets because a charter private jet service filed as "transport"

Gustavo

@antijingoist @xgranade @eniko AI is just a overused buzzword! My 2010 piano has AI features: Casio could have named it "Automatic Chord Prediction", but they decided to call it "AI Fingered" mode. :char_Well:

janet_catcus

@eniko egh... saw that one coming...

i loved this talk: youtube.com/watch?v=kFLZiak5gy

back then this was mind blowing stuff... now some peeps would say in a bored tone "that all it can do? you have to make stuff that it combines then? not even a prompt??" argl...

Gabriele Svelto

@eniko this! Also these two things couldn't be more different: procedural generation might take milliseconds on your machine and require nothing more than an algorithm and a random seed, not a datacenter and a bazillion gigabytes of data scraped without consent

LisPi
@gabrielesvelto @dalias @eniko Demoscene has more than amply demonstrated that procedural generation can be the more resource-efficient option, even.
Cogito ergo mecagoendios

@eniko even boring procedural generation is better than AI, because no matter how shallow a spore-like character creator is, at least the hand3 asset will have the same number of fingers every time the character is on screen.

Lars Marowsky-Brée 😷

@eniko I concur. It's the same with the pushback against "algorithms" on fedi - I wish there were better tools *under my control*, but it all gets ban-hammered because of the exploitative practices pursued by big tech 😕

(And, y'know, it's not like "sort by most recent while applying this list of filters" *isn't* an algorithm already)

Kim ✌️

@eniko just to emphasize this point:
good procedural generation IS really really hard. takes a strong mind to get everything as close to the target as possible.

Remença

@eniko

You know how complicated is to train a pile of matrix multiplications to make it output what you want? The amount of choices you have available? Data augmentation, saddle points and optimizers, residual connections and architectural modifications, losses, normalization schemes, etc...

I understand you are mad at AI grifters like Sam Altman because they are fucking up everything and making people unemployed, but please, that does not mean that training AI systems is trivial.

Eduardo Pinho

@remenca @eniko No one here is calling the latest generations of AI "trivial", but whether the models and algorithms made using any kind of AI contribute to fairness and sustainability is something each and everyone working with them needs to reflect upon seriously. It is substantially harder for an LLM to be fair and sustainable than a crafted procedure-based generation algorithm, so the latter seemingly receiving backlash as of late is unreasonable.

Remença

@E_net4 @eniko

I wish I could reproduce the original toot but it seems I have been blocked. If I'm not wrong it did insinuated that procedural art is more complex than training AI system. So my reply arguing otherwise was appropriate.

Remença

@E_net4

Now, if we move into whether LLMs can be fair or not compared to procedural algorithms I must concede. But again, this was not the original topic. And ofc there is people working in AI reflect a lot on that and that is why there is a lot of people working in fairness and efficiency. Others only care about money, but that also happens in other fields.

Remença

@E_net4

Finally, I'd like extend this concern for fairness and the consequences of automation to other fields, such as yours for instance. I see you hold a PhD in computer science. Have you wondered if the impact of all automatization carried thanks to computers? Did anyone gave a fuck about all the people who lost their jobs because an industrial robot replaced them in a factory? Probably not.

Remença

@E_net4

The only difference is that instead of a poor fucker being the one to lose their job, now it is the turn of intellectual workers who (mistakenly) thought that they were free from being threatened by automatization. And the sheer scale of the problem. But that's all.

Simon Lucy

@remenca @E_net4 @eniko

Rather more that it's an entirely different class, if they were on a Venn diagram they'd be separate circles. Individuals not understanding either getting hung up on the term generative.

You don't have to jump to the defence of LLMs.

Remença

@eniko

Lol, blocking me won't solve the problem.

Remença

@glowl @eniko

Sadly, I cannot check it because I have been blocked. If it is not I'll apologize, but my interpretation is that "oh, procedural art is much harder than throwing heaps of data to a GPU".

Frank Hightower

@remenca @glowl
The original post:

"seeing pushback against procedural generation as a result of alleged 'AI' and that's really fucking sad
"good procedural generation is hard. good procedural generation is bespoke and intentional. good procedural generation is artistic and creative. please don't lump it in with the slop generated through machine learning 😞"

Frank Hightower

@remenca @glowl
So, to translate, tuning the alpha, threshold, number of generations, etc. is so far divorced from tuning the number of [game object X] appearing next to [game object Y], they are no longer comparable

Remença

@FrankHghTwr @glowl

I think that it gets a little more complicated that this, but ok.

Eniko | Kitsune Tails out now!

coming into my mentions going "but training machine learning algorithms is hard too weehhhh!" is grounds for a block. do not fucking do it

Efi (nap pet) 🦊💤

@eniko harder than procgen and gives worse results? 🤔
I think we have a name for that... the walkway curb effect

stella vantechelgibbity

@eniko it may be hard, but its not a creative process. thats the important difference

ɗ𐐩ʃƕρʋ

@eniko As a roguelike game developer and player, I have mixed feelings about this. Yes, procedural generation is an incredibly deep topic, and you can use it in your game with intention and skill to make it do what you want. But that's not what happens most of the time. Seeing all the lazy games with random elements in them labeled as "roguelike" gets tiring very fast. At this point Poker qualifies as roguelike.

Rosco

@deshipu @eniko Well that's more of a game design issue, yeah you can make an amazing procedural generation algorithm and create complex and beautiful worlds, but if the player has nothing to do in it, then it's a bad game.
It's kind of the same for physics engines, Cortex Command is amazing on that front, but the campaign mode is boring and doesn't work at all.

13 barn owls in a trench coat

@eniko omg they have "AI reply guy" in their bio. Points for self-awareness, I guess.

Reid
@eniko but training machine learning algorithms is hard too! I have to drink my coffee and watch youtube on my phone while the computer is running at 100% CPU and GPU usage! (sorry, I couldn't help myself)
Eniko | Kitsune Tails out now!

this post has rapidly breached containment so im muting this thread for my sanity

Frank Hightower

@eniko all it took was for the sun to rise on the east coast SMH

Eniko | Kitsune Tails out now!

in case it's not clear: procedural generation is a term used in game design whereby a human-authored algorithm takes a random seed value (a big random number like 123908516 for example) and deterministically generates game content from that. this does not involve training a neural network, these algorithms are painstakingly crafted by hand to create the desired output, do not require anyone else's content to make, and this technique is over 40 years old

it's used in games like nethack (1987) en.wikipedia.org/wiki/NetHack, elite (1984) en.wikipedia.org/wiki/Elite_(v, minecraft (2011), dwarf fortress (2006) en.wikipedia.org/wiki/Dwarf_Fo, rimworld (2018) en.wikipedia.org/wiki/RimWorld and many, many more

the fact that people are conflating procedural generation in game design which has a long and treasured history with "AI" slop is fucking tragic

in case it's not clear: procedural generation is a term used in game design whereby a human-authored algorithm takes a random seed value (a big random number like 123908516 for example) and deterministically generates game content from that. this does not involve training a neural network, these algorithms are painstakingly crafted by hand to create the desired output, do not require anyone else's content to make, and this technique is over 40 years old

Tenacious B (twoot.site edition)

@eniko The Deep Rock Galactic people recently posted an explanation of their cave generation which goes reasonably deep and shows pretty nicely how much human input is needed there.

In short: They do hand-made rooms and modify them, and take into account the mission type, biome and a bunch of other stuff.

(edit: link directly to post)

Sin Vega

@eniko using a random number generator twice and multiplying the result vs flying a private jet to thousands of people who've generated a number, one by one, then copying the most common two and multiplying them

BogusMeatFactory

@eniko I can not stress enough how AI as a term has completely disrupted the industry entirely. What used to be how we defined npc and enemy behavior in a game is now used in a completely different way. Now anything generated by a computer is considered "AI", even though, as you said, it's something very specifically crafted. We defined it's rules and behaviors. We made the equations.

Lars Marowsky-Brée 😷

@eniko Going back to the theme of games, the first games I lost literally thousands of hours in were NetHack (<3) and eventually Elite (Frontier) - which counted as a milestone for procedural generation (actually still does) because of how much game play and graphics it allowed them to cram onto a single floppy (yes, me old) disk. Freaking amazing.
Dwarf Fortress. Procedural generation for the win.

Ariaflame

@larsmb @eniko Heh, I played Elite off a cassette tape.

Cal Alaera

@larsmb @eniko Yes! Frontier especially, it blew my mind when I was growing up that an entire universe could fit inside my Amiga, let alone on one single doppy flisk!

Quantum System ☯⚛ :theythem:/:any:

@eniko In the same vein, let's also not lump in machine learning as a whole into the bunch that is LLMs and """AI art""" 😅 Good examples of machine learning in gaming and gamedev include autonomous TAS, enemy AI, and ML-assisted procedural generation. Other good examples of ML include the development of revolutionary life-saving medicine.

Ethical uses of ML being lumped in with unethical uses of ML harms genuine scientific research. 😅

Andreas Grois

@jay @eniko Tell that to the loud and annoying minority of gamers.

You know, the kind of people that start screaming "AI" if an artist makes the slightest mistake while drawing a hand.

j

@soulsource I'm a AAA game developer, I get yelled at enough already, lol.

Frank Hightower

@soulsource @jay @eniko
Aww you mean they no longer scream AI if an NPC doesn't do what they want? We're losing our traditions!

Frank Hightower

@jay @eniko I'm going to argue Procedural Generation is literally in the AI text book and the specific algorithms presented there were what was used to make Cities XL

Though to be fair, I'd also blame that textbook for this meme

Rosco

@eniko I've never heard this talking point before, it's quite stupid and nonsensical.
That being said, I feel the same frustration when people compare the vast field that is AI, to what crappy, unethical, greedy companies like OpenAI produce. Generative AI is but a tiny subset, I personally work on real-time hand gesture recognition which has a lot of applications, and doesn't use illegaly obtained data for training. I do understand the anger coming off artists and writers though!

LovesTha🥧

@rosco @eniko yeah, LLMs and giant generative AI models are tainting a lot of fields that are only similar because many people don't understand any of the technologies being talked about.

Rosco

@LovesTha @eniko Yeah, it's exactly like when people were comparing "cryptography" and "cryptocurrency"..

MaxTheFox

@rosco @eniko @mynameistillian Ye. Meanwhile I study materials science and we use AI models to make new prototypes of composites. The thing is, they're not quite the same things as the corpos are doing (and while they benefited from the boom they were around since like 2013). We don't ask ChatGPT to give us formulas or anything.

Rosco

@maxthefox @eniko @mynameistillian I think the issue is not the generative models per se, it's the insatiable greed of corpos that collect data without consent (yet they have no issues crushing anyone who dare infringe on their copyrights), and hype it up to be the solution to every problem because they can afford to pay for huge datacenters (and waste a hell lot of energy in the process). It's an issue that far predates the "AI craze".

Rosco

@maxthefox @eniko @mynameistillian Of course the tech itself (generative models) should be heavily regulated as it can obviously be used with ill-intent (inpersonation, fake news, etc..).

Frank Hightower

@eniko Rule of thumb: if it existed before the panemic, it's not what you're mad about

RejZoR

@eniko Problem is that most games that use procedural generation are soulless generic and repetitive. I rather have Outer Worlds size of universe with few hand crafted planets than Starfields seemingly endless universe that is full of generic forgettable planets with same outposts and labs everywhere. There is no way Bethesda hand made all the planets. They were all procedurally generated and then they plopped some unique cities or structures on key planets and that's it.

Eniko | Kitsune Tails out now!

@rejzor there are loads of games with excellent procgen like caves of qud and dwarf fortress

Glitchy Pixel

@eniko The only potential silver lining here is that we can call it PROC-GEN or something like that to avoid the misery that is has been the AI moniker being coopted.

We could also differentiate the "bad ai" with something like "GEN AI", LLM AI or something similar.

My master's thesis was on PROC-GEN, and people keep mixing it up. also, was making a PROC-GEN course, and it's been put on hold because most will confuse it with the GEN AI or LLM AI crap. I hope it all burns and never comes back.

sarah 🦦

@eniko people saying procedural generation is easy when they learn about minecraft's world generation

CurtAdams

@eniko As somebody who does procedural generation for game mods, it didn't even occur to me that people would mix it up with the current plagiarism engine "AI"s. But I guess if you don't do it, the difference isn't so clear.

Felix Urbasik

@eniko I recommend the book "Procedural Generation in Game Design" by Tanya Short and Tarn Adams.

Especially Tarn Adams' Dwarf Fortress has demonstrated what procedural generation can do for a game.

MrAptronym

@eniko I feel like procedural generation (which, as a tool can be fantastic) is often used as a buzzword. For a while in the late '00s everyone was bragging about it in games. Now it mostly comes up mostly when people dislike something. No one talks about the procedural generation in the looter-shooters or roguelikes they enjoy: that is just RNG. Starfield? That is some bad procedural generation.

That is just my annecdotal experience though.

Miranda Thomas

@eniko we really need to figure out a better language when discussing/criticizing these things.

I have no faith in the LLM’s strictly due to the types of people and organizations running them.
But we have lived in a world with digital heuristic engines for at least two decades.

‘AI’ is frankly a poor descriptor, and I strongly believe it will continue to gain boogeyman status.

arclight

@eniko About the only place I can see generative AI being useful is in filler text and dialogue and similar areas where adding detail is prohibitively expensive especially for a small team. I wouldn't completely write off ML as an element of procedural generation - ML is a just a type of procedure - but for now at least, you'd likely spend as much time training the system as you would writing a traditional generator. I'd be interested in what kind of terrain, conversation, maps, etc. a hybrid system could produce, what sort of 7-fingered artifacts you'd end up with from ML, and how to detect, prevent, and patch over them. I'm not convinced the heavily promoted GPT systems would help (too many techbros involved) but someone more interested in the result than in not paying for writers and artists and programmers might do something interesting.

@eniko About the only place I can see generative AI being useful is in filler text and dialogue and similar areas where adding detail is prohibitively expensive especially for a small team. I wouldn't completely write off ML as an element of procedural generation - ML is a just a type of procedure - but for now at least, you'd likely spend as much time training the system as you would writing a traditional generator. I'd be interested in what kind of terrain, conversation, maps, etc. a hybrid system...

Neo-Luddite Gregly

@arclight @eniko The only place I’ve truly found some local LLMs to be useful have been to describe ideas to one and have it ask follow-up questions… because then it isn’t doing any sort of “creation”, it’s instead acting as a prompt for me to think about certain aspects of an idea that I may not have considered, and flesh them out.

arclight

@gregly @eniko I can't resist: "In Soviet Russia, AI prompts _you_"

Seriously though, an Eliza-like tool isn't a bad idea; it's a tool not a surrogate.

MaxTheFox

@gregly @arclight As a writer that's basically how I use it... a wall to toss ideas at. Sometimes it makes me think about a different angle or points out a logical error.

But I ain't gonna have it write passages for me.

Gary Bunker

@eniko I attempted to explain recently that what computer scientists think of as "artificial intelligence" and what the marketing guys have relabeled "machine learning" are vastly different things. I am not sure I made an impression.

Marty Fouts

@AndySocial @eniko machine learning has been a sub field of AI since the 1950s when a computer learned to play checkers by trial and error. LLMs are the result of one of the many ways to implement machine learning. AI researchers have always called the things that they develop “AI”, to indicate what field of research produced the things. The problem is that “AI” stands for both the research and the intended result and people are intentionally confusing the two.

Albert Hickey

@eniko
Exhibit A. Elite on the BBC Micro.
The whole world was procedurally generated. I expect many really enjoyed it and it's sequels.

Paperisiili

@eniko I will stash this toot and link to it if I ever run into this monstrosity of ignorance.

uoou

@eniko Understood. I'll be boycotting anything with a random number generator in it.

No more packs of cards for me.

JW Prince of CPH

@eniko Very good point. Minecraft is an example of brilliant procedural generation, did you catch Corridor Crew's video the other day: youtube.com/watch?v=juQASG4Jy-

Rafael - Yakultjapa

@eniko Okay, who is the dipshit telling Procedure Generation is AI? This idiot probably was born late 2000s to believe in this stupid sentence.

Procedural Generate is absolute hard to make something that doesn't seen like something copy from Stackflow and work very well on working project. That what happen when "games journalism" or "games magazine" didn't show the backstage or give some small tutorial of "How everything work", soon people will thing you can just crap and a game is made.

This really piss me off.

@eniko Okay, who is the dipshit telling Procedure Generation is AI? This idiot probably was born late 2000s to believe in this stupid sentence.

Procedural Generate is absolute hard to make something that doesn't seen like something copy from Stackflow and work very well on working project. That what happen when "games journalism" or "games magazine" didn't show the backstage or give some small tutorial of "How everything work", soon people will thing you can just crap and a game is made.

Marty Fouts

@eniko This is an excellent example of a term that historically originated in AI research but that has a modern use that is not the same. Harold Cohen conceived of a procedural image generator in the 60s. In the 70s he started developing AARON, an AI procedural image generator and continued until his death.

AARON is why procedural generation is associated with AI but most game procgen does not use AI techniques. /1

en.m.wikipedia.org/wiki/AARON

Deadly Headshot

@eniko It can also be used deterministically for compression: see Exile on the Acorn Electron, which somehow used it to have a map the size of a city and still fit the whole game (which had synthesised speech too, as if the map wasn't enough of a flex) in under 32kB!

VOLTUR (with the good hair)

@eniko I created a game that is heavily procgen years ago and have had so many people talking to me about it as AI. It's really obnoxious.

Rune Skovbo Johansen

@eniko Sad to hear about this; where did you see this pushback against proc-gen?

I recently made a chart to also try to push to not have proc-gen and gen-AI lumped together:
mastodon.gamedev.place/@runevi

Noel Kelly

@eniko
@3TomatoesShort

Not just gaming, I think it's emergent behaviour of computing generally. We were doing it 40 years ago to generate bulk test data for systems because using production data was out of the question, that security/privacy thing.

Riedler, fedi maid

@eniko the starting cards in solitaire are procedurally generated :meowmlem:

Go Up