On May 11, 2021 it was observed that there were issues with our Social Ingestion service. The service was having problems connecting to its datastore.
It was determined that a code change had pulled an upstream breaking change from a library that disabled database connections on older versions of TLS.
This was segregated to only users of the Social-Ingestion service and resulted in a one day downtime on the service during which time twitter feeds would not have updated.
The code change was reverted and the service’s connection method was upgraded to a newer TLS method, which ultimately provides a higher level of security while simultaneously meeting SOC2 compliance standards. Additionally, the code change was rolled back.
We are actively upgrading our TLS connection methods for any services that could encounter this change, this was the last remaining service to be changed. The code change will be retested to ensure no future outages.