2023-10-04

How to keep the community running smoothly when AI moderation fails at midnight and human moderators are off duty?

Moderators might not be around, but users are. If users see something unpleasant, they’re likely to report or block.

From a technical perspective, you could create a metric based on user report volume.

Assume Gcores uses Prometheus and Alertmanager for metric monitoring and alerting. Then this metric would be called:

jibo_user_spam_report_total

Alright, first you have a dashboard showing the number of user reports per hour. You can write a PromQL to measure this:

rate(jibo_user_spam_report_total[5m]) * 60 * 60

Once measured, you can set up an alert. The alert threshold should be based on the measurement result. Let’s say 100:

rate(jibo_user_spam_report_total[5m]) * 60 * 60 > 100

This means if 100 users click “report” within an hour, it indicates something annoying might have appeared in the community.

Then configure Alertmanager with a bunch of notify hooks so that when the alert triggers, it frantically calls, say, Simon. This way Simon can handle it quickly. After dealing with the on-call, Simon can work from home the next day, sleep in a little more—ah, sleep in a little more. Anyway, you must grant some privileges to the heroes who respond to alerts.

• ✨ Life Hacks for a Daily Human