Set up notification alerts for your Web and Feature experiments or for individual feature flags. There are two ways to receive notifications for different types of events:
- Email / Slack direct messages: Sends notifications for Experiments (Web and Feature) about to start or end, when Amplitude detects a sample-ratio mismatch (SRM), or when your experiment's recommendation metric reaches statsig.
- Slack channel notifications / webhooks / Email: Sends notifications for any changes to an active flag configuration that generates a new history version or when flags are activated or deactivated.
This page covers setting up and maintaining notification alerts through Slack channels, webhooks, and email. Amplitude sends only notifications created through the Experiment Alerts function this way.
Amplitude sends all other experiment alerts through email or Slack direct message. For more information on these other types of notification, go to Account Settings Notifications or Integrate Slack to know how to manage your Slack workspace integration.
If you use Microsoft Teams, send an email to your teams channel or a webhook.
If you use Google Chat, send an email or webhook.
To integrate your Amplitude flags and experiments with Sentry, refer to Sentry's documentation.
Note
You must have
Member permissions to create, edit, or delete any notification alerts. You don't need any permissions to receive notifications if you're also a member of the dedicated Slack channel or webhook. However, you must have Viewer permissions to open the notification for more details. Contact your Admin if you need different permissions.
Connect a Slack workspace to your experiment notifications
- Go to Experiment and then click Experiments.
You can also access alerts by going to Settings > Organization settings > Experiment and then clicking Add alert.
- Click Alerts in the top right.
- Click Connect To Slack.
- Click Allow to confirm that you want to connect Amplitude to Slack.
Note
If a Slack channel ID instead of a Slack channel name appears, ensure you have connected Amplitude to your Slack workspace. If you have already done that, ensure you're a member of the Slack channel. You can reach out to the person who created the alert (displayed in the Created column of the table) to add you to the Slack channel.
Change alerts
Change alerts notify you when flag or experiment configuration changes. Amplitude generates an alert any time a change creates a new history version or when you activate or deactivate flags.
Experiment activities that generate alerts
Specify whether you want to receive alerts for the following experiment activities:
- Flags created, updated, or deleted
- Targeting rule changes (for example, updates to target segments or bucketing settings)
- Variant changes
- Flag activation or deactivation
Scoping options
When you set up a change alert, you can scope it to:
- All in the project: Receive notifications for all experiments and flags in the project.
- By deployment: Receive notifications for all experiments and flags in a specific deployment.
- By tag: Receive notifications only for experiments and flags tagged with specific labels.
Notification channels
You can deliver change alerts through:
- Slack channel: Select a channel from your connected Slack workspace.
- Webhook: Provide a URL and a valid signing key.
- Email: Enter an email address.
Set up an alert
After you connect your Slack organization to Amplitude, you can create notifications for your experiments.
If you want to send notifications through webhooks, you must provide the URL and a valid signing key. You can specify your webhook at the same time that you create the alert.
Webhook schema:
{
"flagId": number
"flagName": string (This is the flag key and not the flag name. If you want the flag name, use `flag.name`)
"scope": "exp_deployment" | "project" | "exp_tags"
"scopeParam": number | undefined
"scopeParamName": string | undefined
"action": "created" | "deleted" | "updated"
"modifiedBy": string
"flag": JSON
"oldFlag": JSON
}
Create an alert
- From the Amplitude home page go to the Experiment section and then click Experiments.
You can also access alerts by going to Settings > Organization settings > Experiment and then clicking Add alert.
- Click Alerts in the top right.
- Specify the project you want.
- Set the scope. Select one of:
- All In the Project: Receive notifications for all experiments and flags in the project.
- By Deployment: Receive notifications for all experiments and flags in your entire deployment.
If you're receiving alerts by deployment, you must specify the deployment by the label. Go to Deployments for more information. Remember that Web Experiments and Guides & Surveys experiments have the Project API Key deployment.
- By Tag: Receive notifications only for experiments and flags tagged with specific labels.
- Choose how you want to receive your notifications:
- If you're using Slack, click the dropdown to choose the channel for your alerts.
- If you're using a Webhook, enter the URL and your signing key.
- If you're using email, enter an email address.
- Name your alert.
- Click Create Alert.