Email or username:

Password:

Forgot your password?
Eugen Rochko

Hey! Spent all day (technically night) fixing delayed feeds on mastodon.social and mastodon.online, both are back to normal now, I had to add more capacity. There's just so much more activity during peak hours, even with closed registrations! #devops

447 comments
InfiniteOne

@Gargron I’ll have as much patience as needed, if we destroy the “Death Star.” ✌🏼

Sean

@Gargron thanks for all you do :BlobhajHeart:

Pete

@Gargron managing these huge traffic spikes as well as you are really speaks to the quality of what you've built here.

mew 🏳️‍🌈

@Gargron Hope you're ok! It would be nice to hear your findings regarding scaling the system. Especially about the sidekiq workers.

fuomag9

@mew @Gargron absolutely. Another thing I’d be curious about is if the same issues would have happened if we were using something like pleroma instead of mastodon for example

Glyph

@Gargron congratulations, and condolences, on the enormity of your success

David or Dave (he/him)

@Gargron awesome work, can already see the difference!

Wolfgang Böhl

@Gargron thank you so much. These last few days must have been pretty taxing.

Michael Meese 🇪🇺

@Gargron Then off to bed now and a good nights (days) sleep now!

Ruth Dupré

@Gargron That's so great. Thank you!
(also please take care of yourself -
sleep is important and the internet will still be there tomorrow)

Kai

@Gargron thank you! how long is the queue for moving accounts out? I initiated my move from gnarly_parker@mastodon.social to gnarly_parker@chaos.social on saturday and a chunk of followers still has not made it until now.

Blake Reilly | Ekyllier

@Gargron Is there any plan or perhaps worry with the current storm towards Mastodon? I imagine most servers for Mont instances are exploding rn

daveloping :verified:

@Gargron Hey Eugen! What are the best relays to use for new servers?

Mal

@Gargron Awesome problem to have! Stay strong.

Steve Riggins

@Gargron I hope you get the financial support you need to keep this growing. People are confused about where their account should be so we pick the easy one.

Till Sawala

@Mrfunkedude @Gargron Since I signed up (when it was just under €10k / month), I don't seem to be able to see the current funding level. I imagine it's more now(?), but it's quite amazing that this can run on so little funds!

Sar

@Mrfunkedude @Gargron

Absolutely this! I got mine sorted yesterday, and may increase my pledge soon too! 😄👍

Scott Williams 🐧

@Gargron Thank you! I'm grateful for your work and for #MastodonOnline being up and mostly functional again. It's a "good problem to have" because it means your stuff is popular and getting used in big ways. Thanks again for working to keep the main sites afloat through all of this.

Scott Williams 🐧

@HarryMBarham
Negative, but my home feed and notifications are caught up now.

Harry Barham

@vwbusguy ah ok thanks, I’m the same - was just checking it wasn’t just me

Francesco Gabaglio

@HarryMBarham @vwbusguy Came here to ask the same. I haven't been able to see the Local and the Federated feed for a few days now.

Sébastien Deleuze

@Gargron Thanks, much better now. I have started sponsoring Mastodon via Patreon.

kaffando

@Gargron Thank you!! Please, get some rest. Things will be like this for some time and people will wait. Those of us in here & on the bird site still are letting people know it's because you're inundated! Take care.

William Smith

@Gargron Appreciate all the hard work! Thank you.

Möchte lernen

@Gargron

Thank you so much ❣️
Let's put it this way: You are the hero of this night ❣️

Admiral Craymen 🏳️‍⚧️

@Gargron Thanks! Federated and local timelines don't work, but I'm glad that everything else seems to be working.

Kyle Murphy

@Admiral_Craymen @Gargron Yeah, I'm also not seeing Local or Federated feeds working on mastodon.online via mobile app or web app. Wondering if it's just a matter of waiting for things to catch up or a cache to expire.

GM Raphi

@Gargron You are doing excellent work. I can't imagine how stressful the last days must've been.

Thomas

@Gargron "Betrieb" ist harte Arbeit - und DevOps funktioniert nur so weit, wie man das Problem schon kennt. Überarbeite Dich nicht.

Jeff

@Gargron I would love to see a write up on how you handled capacity scaling after you have had a chance to catch up on sleep and catch your breath.

AJ

@jeff @Gargron That would be really helpful for newbies like me who’ve joined by making an instance to know where we should plan to be if our instances grow so we can be good hosts to our users.

gigatexal (he/him)

@Gargron I will spin up my own instance and move off of mastodon.social to free up space for folks. The plan is to do this this week.

Teemu Leinonen

@Gargron thank you. Take care on yourself. Simple rule for good life :
8 (+/-2) h work
8 (+/-2) h fun
8 (+/-2) h sleep

Fabian Bull :neovim: :nixos:

@Gargron Thanks for all the hard work you are putting into this.

Sooraj Sathyanarayanan

@Gargron Thanks very much for all your contributions, Eugen! Appreciate it 👏

Take care of your self too :)

Parents For Future :verified:

Thanks, @Gargron. Expect more load, since @gretathunberg :fff: joined the #Fediverse yesterday and announced it on the bird site 😉

Sean of Londinium ⚠️

@Gargron Seems to me that no-one expected a sudden #Twitaspora influx of Twitter migrants! (Myself being one of them!)

Cat

@Gargron thank you! you’re doing such a great job, i appreciate you very much.

SR_Toliver

@Gargron thank you for doing such an amazing job, especially considering the LARGE influx of people who’ve joined in the past week alone (including me). I appreciate it so so much!

yammering

@gargron I can't contribute to the project code but I'm a DevOps engineer. If the project needs occasional DevOps support I would be happy to lend a hand.

Kath1213

@Gargron - Thanks for all the hard work! This is my Day 1 on Mastodon - super impressive so far!
#introduction

Colliding Waves

@Gargron yes last few hours much much better using mastodon.online #mastodon

Chris Pirillo

@Gargron ...I just wanted to say "thank you." This will be my first toot, and I can't think of anything more fitting. Appreciate your time, expertise.

Ezab

@Gargron bring username change feature pls

nadezhda

@Gargron you are a prince to accommodate so many of us migrants with such a warm welcome on such short notice. I think now’s a good time to pass the hat and remind folks that all the new hardware isn’t free. https;//www.patreon.com/mastodon

Steve Washington

@nadezhda04 @Gargron@mastodon.social Thanks for providing the Patreon link! Just signed up. And thanks, @Gargron, for all the hard work to accommodate all of us newcomers.

Vicente Perez

@Gargron thank you for the incredible dedication!

Lutz Schowalter

@Gargron wie können wir Deine Ausgaben und Mühen finanziell unterstützen?

Sar

@Gargron Thank you for all your hard work man, everything's flying this morning 😄👍

Arwen_27

@Gargron twitter migration is still going on...

Go Up