From 8 cores to 36 cores processing power, let's see how the new database server holds up. Hopefully everything will be much faster from now on, but it should also give me a bit more room to scale horizontally.
From 8 cores to 36 cores processing power, let's see how the new database server holds up. Hopefully everything will be much faster from now on, but it should also give me a bit more room to scale horizontally. 159 comments
12
@Gargron Working great, thank you SO much for all the hard work of the last week! Get some rest! β€οΈ @Gargron Thank you for all you've been doing and for being so transparent with everything. All of that is just one more reason why it's nice being here. Things have certainly improved speed wise for me over the past hour or so alone. Quick question if you don't mind me asking, do you have any time frame you're hoping for account creation to be enabled again? @Gargron You're doing exceptionality well dealing with an induced Blue bird avalanche. Chill out, everything will be ok :) @Gargron but is it #webscale π? https://www.youtube.com/watch?v=b2F-DItXtZs (Apologies if jokes are not etiquette, though it must be eternal September now) @Gargron thank you for all the work youβve done to handle the influx. π @Gargron nice, works like a charm! Question: is instance-moving switched off for this instance because of the server troubles? I can't migrate, this server says βxyz is not an alias of this accountβ although I have done that and checked and re-done it several times. @Gargron You did an amazing job there! It's a night and day difference. The last days, Mastodon was actually unusable. Such a big improvement now.πͺπ @Gargron Muy buen trabajo, seguirΓ© utilizando la plataforma, es muy entretenida. π @Gargron keep up the awesome work, also let us know where we can send you some donations. Infrastructure isn't cheap @Gargron I wonder if it wouldnβt be better if we try to replace PostgreSQL with a high available distributed and compatible implementation such as Yugabytes (cc @FranckPachot ), maybe weβll be able to horizontally scale on the cloud :) https://www.yugabyte.com @Gargron Somebody asked a good question in terms of time-series data with mastodon and if there'd be a use where #TimescaleDb could help simplify / speed things up. Happy to investigate / help with the integration. @Gargron Great to hear! For future horizontal scaling: How about balancing load across some read-only db mirrors? I guess eventual consistency doesn't hurt this kind of application and most load comes from read requests. Keep your main db for writes only.
[DATA EXPUNGED]
[DATA EXPUNGED]
@Gargron π Nice to know what might be just ahead of ourselves mid- to long-term. And since mastodon.social keeps lagging occasionally: if the DB server turns out to be the culprit, have you considered or even tried using a CockroachDB cluster as a drop-in replacement for PostgreSQL? Can you think of any obstacles? @Gargron I see you're using Hetzner servers. When ordering new ones please take a look at their RX series (with ARM64 processors). These are real, 80 cores, beasts with outstanding performance. |
@Gargron Thanks. First impression: looks good.
Some help for questions like "should we go or should we stay".