Blueshift: Reporting & Analytics

Overview: Blueshift includes multiple types of near-real-time reporting that make it easier for marketers to understand and optimize their campaigns. Metrics are available on campaigns and templates.

Blueshift's Responses to Questions on Reporting & Analytics

Testing

1. Describe your A/B/n testing capabilities across channels (i.e. email, mobile, app, web, etc.).

Blueshift offers powerful and granular testing capabilities, including A/B/n tests with unlimited variations that can be performed across different channels and platforms including email, push, SMS, and website. During campaign setup, marketers simply add the templates that are part of the A/B test and assign the distribution percentage that should be sent to each. In addition, there is no limitation to the number of templates that can be tested. Furthermore, you can test any combination of subject lines, message body, templates, content, send times, recommendation types, as well the entire lifecycle journey sequence.

Blueshift collects and reports all campaign statistics for each variant providing the ability for marketers to understand the results of A/B tests by calculating statistically relevant rankings based on a number of metrics. Once the campaign is live, campaign statistics for all template variants can be viewed and analyzed within the campaign reporting. For each template variant, we provide a number of standard engagement metrics as well as any custom goals that are defined by the customer.

In addition, for one time send campaigns, you can enable automatic winner selection on messaging triggers that have multiple templates. Using this feature, you can let the campaign automatically select the best template based on the metric you are trying to optimize for.

2. Does your solution have the ability to automatically pick the winner of A/B tests and continue a campaign based on this winner?

Yes, for one time sends marketers can enable automatic winner selection allowing the system to automatically route messaging to the highest-ranking variant of A/B tests and continue a campaign based on the winner.

Additional information can be found in Blueshift's documentation at https://help.blueshift.com under the topic: Automatic Winner Selection

3. Does your solution have the ability to test multiple template and campaign components simultaneously within a workflow?

Yes, Blueshift's visual campaign builder allows you to test unlimited variations across different channels within the same campaign workflow. More specifically, Blueshift allows you to pick variants, show variant stats, and preview templates visually within the campaign workflow and provides the capability to understand which template variant performs best.

4. Describe how A/B tests are analyzed. Do you calculate statistical significance?

Once the campaign is live, you can see the campaign stats for all A/B test templates under the campaign’s reports. For each template, you will see the number of users and their engagement. This helps you measure template changes and their effect on downstream conversions. Blueshift collects and reports all campaign statistics for each variant including the confidence level and statistical signifcance of the test

Additional information can be found in Blueshift's documentation at https://help.blueshift.com under the topic: A/B test report

5. Does your solution provide the ability to create holdout groups?

Yes, Blueshift allows marketers to easily assign X% of all users into a holdout group and suppress the holdout group from receiving any channel messages. Marketers can also have global holdouts to make sure those users are not part of any campaigns, thus separating high-value customers from the rest. Furthermore, we can feed holdout stats downstream so that marketers can measure the lift between users receiving campaign channel messages vs holdout users that are suppressed from channel messages.

Additional information can be found in Blueshift's documentation at https://help.blueshift.com under the topic: Campaign holdout testing

6. Can your solution send test emails and mobile messages to specific people or groups of people before a live send?

Yes, Blueshift allows marketers to send individual test messages or send to a seed list for QA and review before a live send. The email will reflect the content sent to the first user in the campaign.

Additional information can be found in Blueshift's documentation at https://help.blueshift.com under the topic: Seed Lists

Reporting

7. Describe your ability to measure campaign performance across all channels (i.e. email, mobile, app, web, etc.) in a central location.

Blueshift provides a flexible and robust Insights reporting module that allows marketers to easily create reports, tables, graphical charts, and visual dashboards to view key campaign performance data and identify optimization opportunities. Using Blueshift's reporting capabilities, marketers can easily slice and dice data and dig deep into campaign performance by creating reports that achieve the following:

• Monitor how campaigns managed through Blueshift impact user engagement on your site
• Analyze how campaign performance varies by parameters such as devices, segments, templates, browsers, and email service providers • Measure the impact of different features (such as multi-channel vs single-channel, recommendations, and campaign time optimizations) on the performance of your campaigns • Analyze campaign effectiveness across channels

Additional information can be found in Blueshift's documentation at https://help.blueshift.com under the topic: Campaign insights

8. Does your solution provide a set of preconfigured, out-of-the-box reports and dashboards appropriate for marketing and executive users? Does it allow for customization of reporting dashboards?

Yes, Blueshift provides a robust set of default, out-of-the-box best-practice reports and dashboards for user-specific roles. Marketers can also easily edit, copy/clone, and customize to their specific business and reporting requirements to focus on the metrics and KPIs that matter for their business.

9. Does your solution have the ability to show results of each individual step in a workflow?

Yes, Blueshift provides both the user counts along with the engagement and custom goal metrics at each step of the campaign workflow/journey. Within the journey builder you can select the desired metrics and instantly see the results at each step.

10. Does your solution support customer journey analytics across channels over time?

Yes, Blueshift's channel performance dashboard provides the depth and breadth of data for marketers to understand customer journey analytics across channels over time. Marketers can understand the channel performance by engagement metrics and any other custom goal events that are critical to their business. These insights can be compared to different time periods for a time over time analysis.

11. Does your solution offer a heatmap?

Yes, Blueshift's offers a click heat map as well as color coded insights into which regions of the template a customer most interacted to gain insight into how users engage with the messages that you sent. You can export the heat map to be shared with other users as a CSV or an HTML file.

Additional information can be found in Blueshift's documentation at https://help.blueshift.com under the topic: Click Heat Map

12. Does your solution have the ability to export reports? Can the reports be scheduled?

Yes, all reports can be downloaded in CSV format and all raw campaign activity data is automatically exported every 5 minutes to an S3 folder for ingestion into your existing analytics platforms. For Snowflake and DataBricks customers, this data is exported daily to either a Snowflake or DataBricks share for easy ingesting into those platforms. Additionally, campaign activity data can be configured to be sent to an external webhook.

13. Describe your audience reporting capabilities

Blueshift's Audience Insight Reports offer insights into your customers based on your customer and event data. You can see a breakdown of your customer base by any customer attribute. Additionally, these reports can help you understand how different customer cohorts (based on any customer attribute of your choice) are contributing to your top line and bottom line metrics like revenue, orders and other goal metrics.
Additional information can be found in Blueshift's documentation at https://help.blueshift.com under the topic: Audience Insights