Gregory's ServerOur search index over here got out of sync a few weeks ago. It was the first time I've needed to re-import data into it in a long time. The command estimated a runtime of over 30 days to complete. So I've been working on optimizing the command.
 16 comments
  @bengo It's a part of Mastodon's command line utility that has to iterate over all data in the database and submit it to Elasticsearch.   @Gargron nice. Always a good feeling when code is made more performant, but an improvement as big as this is cloud nine territory.  *Keeps posting a bunch of crazy to lengthen the process.* Seriously though, awesome job! @Gargron I think I’ve heard that switching to bulk ES operations from single-item operations can provide a dramatic speedup, is that part of what you did? |
@Gargron thank you for all of the work you put in