#(darthlukan [dev])

[thatskynews]

Happy Timezones Sky kids! It’s been a while since I last got so send you all a quick dev update.

As you’re all well aware, there has been an uptick in server errors which accompanied our latest release. Multiple teams have been investigating and we’ve found what we think is the source of this specific batch of server errors. As a result, we’ve updated our tests and are verifying that our proposed fixes result in the tests passing and that the behavior is therefore addressed.

You should expect a message from our wonderful Community Team once we’ve confirmed the fixes and scheduled the rollout. Nothing will be required from you all, the fixes will be automatic.

Thank you all for your constructive feedback and bug reports, they’ve been a great help to us and we appreciate you!

[thatskynews]

A letter from a dev!

Good timezones Sky kids!

We have an update on the status of the server issues that have been plaguing you all for the better part of three days.

Firstly, we want to assure you that your game progress, purchases, and other account data are safe despite what appears to veteran players as being "returned to moth status." We have identified a problem with a new feature which puts added pressure on multiple backend services, including a very important database.

Second, in the course of testing potential fixes we found some behavior in the database itself which warrants working directly with a partner who is actively assisting us in resolving that particular issue as soon as possible.

After we resolve these server issues, our teams will hold a retrospective to examine the factors that led to this situation, and we'll share a summary of that retrospective with the community.

We will continue to update the community at least every 24 hours until this issue is resolved. Thank you again for your patience in the meantime—it means a lot to us!

[thatskynews]

Happy timezones Sky kids!

Some of you may have experienced a problem where you appeared to be missing progress, unlocked outfits, and certain doors would not open. You may also remember that earlier today we performed some maintenance on our backend.

Your data is safe. That maintenance was specifically on one of many databases as part of our efforts to address problems which contributed to server errors last week. Unfortunately, that resulted in the database and its replicas doing so much work to accommodate the changes, that our backend services could not always get a response from them which is why you appear to have lost progress. The situation is improving, albeit much more slowly than we would prefer.

We are continuing our investigation into all of the root conditions to the original crop of server errors from last week, and we will continue to monitor for any changes in the current situation.

Thank you for your bug reports and for being so awesome while we work to address these issues!

[thatskynews]

A new letter from a dev! -ymir

Good timezones Sky kids! This is Brian, your newly hired friendly neighborhood Live Tech Lead at TGC.

My new role here is focused on bugs that affect live services—for example, the server issues that a lot of you have been experiencing since yesterday.

As you're undoubtedly well aware, for the last two days there has been a server issue that has caused players to not be able to load into the game, or if they do load, they appear to be missing progress. The team has been hard at work figuring things out and we have some fixes in progress.

As soon we have tests confirming the proposed fixes resolve the issues, we will let you know when you can expect the fixes to be released.

Thank you so much for your patience and understanding during this very frustrating bug, you are all very much appreciated!

[thatskynews]

A Letter from a Dev!

Good timezones Sky kids!

Players should now be able to complete Daily Quests without issues and experience fewer server errors when loading into Sky!

The team spent yesterday testing fixes before deploying them to the live game last night. We also adjusted our backend services to better handle peak loads at reset. These should have addressed the issues that were affecting so many of you the past few days.

However, we have seen that there can still be errors—unrelated to Daily Quests or reset—which may cause the dreaded server error message to appear at other times. We’re investigating that as part of our standard bug triage and fix process. Please keep reporting bugs and other odd game behavior in the bug report channels here on Discord!

We’re still working on improvements for the future, and as I mentioned yesterday, the team will hold a retrospective session to better understand this week’s incident and how it impacted you all. Once that’s completed, we’ll share a summary as well.

Thank you all for your empathy and feedback while we worked to address these issues. You are very much appreciated, and we look forward to sharing more improvements to Sky in the near future!

[thatskynews]

Happy Timezones everyone!

After some additional investigation and testing, we think we know why our previous attempt at a fix for the server errors failed. I'm in the process of deploying a new fix and will be monitoring this channel and some monitoring dashboards to ensure this is actually an improvement and doesn't inadvertently cause any additional problems. If any new server errors crop up as a result, I'll revert and continue working with the team in the morning to refine the proposed fix so you can see an improvement sooner rather than later.

Thanks again for all of your feedback, you all rock!

Happy Timezones Sky kids! It’s been a while since I last got so send you all a quick dev update.

As you’re all well aware, there has been an uptick in server errors which accompanied our latest release. Multiple teams have been investigating and we’ve found what we think is the source of this specific batch of server errors. As a result, we’ve updated our tests and are verifying that our proposed fixes result in the tests passing and that the behavior is therefore addressed.

You should expect a message from our wonderful Community Team once we’ve confirmed the fixes and scheduled the rollout. Nothing will be required from you all, the fixes will be automatic.

Thank you all for your constructive feedback and bug reports, they’ve been a great help to us and we appreciate you!