Blueshift: Reporting & Analytics

Overview: Blueshift includes multiple types of near-real-time reporting that make it easier for marketers to understand and optimize their campaigns. Metrics are available on campaigns and templates.

Blueshift's Responses to Questions on Reporting & Analytics

Testing

1. Describe your A/B/n testing capabilities across channels (i.e. email, mobile, app, web, etc.).

Blueshift offers powerful and granular testing capabilities, including A/B/n tests with unlimited variations that can be performed across different channels and platforms including email, push, SMS, and website. For example, Blueshift provides the capability to understand which template variant performs better by testing several templates that may have different subject lines, send alias, time of day, day of week, different forms of personalization, or entirely different content. During campaign setup, marketers simply add the templates that are part of the A/B test and assign the distribution percentage that should be sent to each. In addition, there is no limitation to the number of templates that can be tested. Furthermore, you can test any combination of subject lines, message body, templates, content, send times, recommendation types, as well the entire lifecycle journey sequence.

Blueshift collects and reports all campaign statistics for each variant including sends, impressions, clicks, unsubscribes, orders, revenue or custom goals and, thus, provides the ability for marketers to understand the results of A/B tests by calculating statistically relevant rankings based on a number of metrics, such as clicks, visits, page loads, etc. Current testing capabilities provide the rankings for marketers to view from the campaign dashboard. Moreover, our visual campaign builder allows you to pick variants, show variant stats, and preview templates visually. Once the campaign is live, campaign statistics for all template variants can be viewed and analyzed within the campaign reporting. For each template variant, we provide a number of metrics including number of users, impressions, clicks, as well as conversion events like orders and revenue, as well as any custom goals that are defined by the customer.

In addition, users can also enable an auto-winning feature for the system to automatically route messaging the highest-ranking variant.

[Additional information on our automatic winner selection capability] (https://help.blueshift.com/hc/en-us/articles/4408758865811-Automatic-Winner-Selection)

2. Does your solution have the ability to automatically pick the winner of A/B tests and continue a campaign based on this winner?

Yes, marketers can enable an auto-winning feature for the system to automatically route messaging to the highest-ranking variant of A/B tests and continue a campaign based on the winner.

[Additional information on our automatic winner selection capability] (https://help.blueshift.com/hc/en-us/articles/4408758865811-Automatic-Winner-Selection)

3. Does your solution have the ability to test multiple template and campaign components simultaneously within a workflow?

Yes, Blueshift's visual campaign builder allows you to test unlimited variations across different channels, including email, push, in-app, SMS, and website. More specifically, Blueshift allows you to pick variants, show variant stats, and preview templates visually within the campaign workflow and provides the capability to understand which template variant performs better by testing several templates that may have different subject lines, send alias, time of day, day of week, different forms of personalization, or entirely different content.

Once the campaign is live, campaign statistics for all template variants can be viewed and analyzed within the campaign reporting. Moreover, for each template variant, we provide a number of metrics including number of users, impressions, clicks, as well as conversion events like orders and revenue, as well as any custom goals that are defined by the customer.

4. Describe how A/B tests are analyzed. Do you calculate statistical significance?

Once the campaign is live, you can see the campaign stats for all A/B test templates under the campaign’s reports. For each template, you will see the number of users, impressions, clicks as well as orders/revenue and custom goals data. This helps you measure template changes and their effect on downstream conversions. Blueshift collects and reports all campaign statistics for each variant including sends, impressions, clicks, unsubscribes, orders, revenue or custom goals and, thus, provides the ability for marketers to understand the results of A/B tests by calculating statistically relevant rankings based on a number of metrics, such as clicks, visits, page loads, etc.

5. Does your solution provide the ability to create holdout groups?

Yes, Blueshift allows marketers to easily assign X% of all users into a holdout group and suppress the holdout group from receiving any channel messages. Marketers can also have global holdouts to make sure those users are not part of any campaigns, thus separating high-value customers from the rest. Furthermore, we can feed holdout stats downstream so that marketers can measure the lift between users receiving campaign channel messages vs holdout users that are suppressed from channel messages.

[Additional information on campaign holdout testing] (https://help.blueshift.com/hc/en-us/articles/1500002733522-Campaign-holdout-testing)
[Additional Information on campaign holdout reporting] (https://help.blueshift.com/hc/en-us/articles/4403073703059-Campaign-holdout-reporting)

Reporting

**_6. Describe your ability to measure campaign performance across all channels (i.e. email, mobile, app, web, etc.) in a central location.

Blueshift provides a flexible and robust Insights reporting module that allows marketers to easily create reports, tables, graphical charts, and visual dashboards to view key campaign performance data and identify optimization opportunities. Using Blueshift's reporting capabilities, marketers can easily slice and dice data and dig deep into campaign performance by creating reports that achieve the following:

• Monitor how campaigns managed through Blueshift impact user engagement on your site
• Analyze how campaign performance varies by parameters such as devices, segments, templates, browsers, and email service providers
• Measure the impact of different features (such as multi-channel vs single-channel, recommendations, and campaign time optimizations) on the performance of your campaigns
• Analyze campaign effectiveness across channels, including email, SMS, push, in-app, website via Live Content, and other activation channels via Cloud App

[Additional information on our Insight Reports capability] (https://help.blueshift.com/hc/en-us/articles/360044884553-Insights-Reports)

7. Does your solution provide a set of preconfigured, out-of-the-box reports and dashboards appropriate for marketing and executive users? Does it allow for customization of reporting dashboards?

Yes, Blueshift provides a robust set of default, out-of-the-box best-practice reports and dashboards for user-specific roles i.e. marketing and executive users. Marketers can also easily edit, copy/clone, and customize to their specific business and reporting requirements to focus on the metrics and KPIs that matter for their business.

8. Does your solution have the ability to show results of each individual step in a workflow?

Yes, Blueshift provides both the user counts along with the performance metrics (i.e., revenue, click, open, open rate, click rate, and other key metrics) at each step of the campaign workflow/journey. Within the journey builder you can select the desired metric and instantly see the results at each step.

9. Does your solution support customer journey analytics across channels over time?

Yes, Blueshift's channel performance dashboard provides the depth and breadth of data for marketers to understand customer journey analytics across channels over time. Marketers can understand the channel performance by revenue, purchases, opens, clicks and any other custom KPIs that are critical to their business. You can use this data to boost your business and optimize campaigns across channels that are generating revenue, and rework on campaigns for other channels.

10. Does your solution offer a heatmap?

Yes, Blueshift's offers a click heat map as well as color coded insights into which regions of the template a customer most interacted with such as, link clicks, region clicks, and product clicks. You can use these statistics to gain insight into how users engage with the messages that you send them using Blueshift. Also, you can export the heat map to be shared with other users as a CSV or an HTML file.

[Additional information on our click heatmap] (https://help.blueshift.com/hc/en-us/articles/360058693794-Click-heat-map)

11. Does your solution have the ability to export reports? Can the reports be scheduled?

Yes, all reports can be downloaded in CSV format or set up to run as scheduled exports on a recurring basis to AWS S3. We can also export the reporting data to your Snowflake instance, which can then be easily imported into your existing analytics platforms, BI, or data warehouse, such as Power BI, Tableau, Looker and BigQuery, so that your data science and analytics teams can then perform deeper analysis.