Important Notice: Session Issues + Postmortem
Thank you for your patience while we investigated issues early this morning with regards to the session affinity problems that users were experiencing.
We have identified the root of the issue and will be putting a fix into production at approximately 1:00 PM CST (6:00 PM UTC). **Please take note of this time as you may be logged out of your existing session while we deploy the changes. **
Please use the save/load buttons liberally so as to restore your charts upon logging back in. Per usual, you may click the “Restore from last autosave” button that pops up in the lower left-hand side of the chart once you’re back in. Again, we apologize for the inconvenience and thank you for your patience.
At approximately 6:45AM UTC a libc security upgrade was processed and the subsequent changes affected session affinity and garbage collection. This was causing garbage collection to match on improper records and as a result, causing users’ sessions to be force-terminated prematurely. As a result of our internal investigation into the root of the issue, we have omitted libc from future automatic updates across our servers, daemons, and load balancers in lieu of manual updates.
Many users reported via twitter, support and Coinigy slack, and unfortunately at the time, our intl infrastructure team member was travelling with family and did not have access to the server to process a fix. We’re working towards adding more international staff to immediately alert and handle these types of issues and sincerely apologize for any inconvenience this has caused. As many of you know, we are a small team and are doing our best to rework our internal processes to prevent an issue like this from occurring again in the future.
Just one more reminder that we will be deploying a fix to session affinity at approximately 1pm CST (6pm UTC) that may cause your session to be logged out one last time. Please prepare accordingly, and per usual, should you have any further issues please feel free to reach out to us via support e-mail, twitter, and Coinigy slack (http://slack.coinigy.com).
Best,
The Coinigy Team