Site performance issue
Incident Report for Sellbrite

We have identified a couple of troubling queries that span all shards of our distributed Citus database, causing our database to max out at 100 MB/s EBS I/O cap. Optimization of these queries will take time and will be launched after the Holiday Season code freeze. In the meantime we have put in a few patches such as reshuffling job queue prioritization, chunking out feed item to smaller bites, and dedupe-ing identical jobs, to prevent the proliferation of database I/O churn.

Posted 5 months ago. Dec 20, 2017 - 16:10 PST

System has self-stabilized. Application should be normal now. Team is working to diagnose root cause.
Posted 5 months ago. Dec 20, 2017 - 10:45 PST
We notice a database spike at 10am PT, then 10:08 and 10:15.
Posted 5 months ago. Dec 20, 2017 - 10:44 PST