OVERVIEW HOW IT WORKS

 

Overview

Use Split to measure the statistically significant impact of new features and experiments on your KPIs. Send Split feature data to FullStory to validate your results with customer experience data and see exactly how customers are engaging with each feature flag treatment. With both FullStory and Split in place, you can mark recorded sessions with the Split treatments a user saw and create FullStory segments of sessions by treatment. For example, if you have an “onboarding_enhancements” split with three treatments “v1”, “v2”, and “v3”, the integration allows you to identify all recorded sessions where users saw the treatment “v2” of your split for playback and analysis in FullStory.

 

 

Get the most out of FullStory + Split

 

How it Works

Once you’ve added the Split and FullStory JavaScript snippet to your product, you can configure Split to send feature data as custom events to FullStory to mark and segment user sessions with the feature flag treatment users received. From here, you can dig deeper into the customer experience with each feature in FullStory.

 

 

Instructions

To connect FullStory with Split, you will need:

  • FullStory API recording Javascript installed
  • Split Javascript SDK 10.12.1 or later installed


Send Split impressions as FullStory custom events

The Split + FullStory integration uses out-of-the-box features of both products.


First, associate the FullStory recording with the same key used for Split getTreatment evaluations by calling FS.identify. In the listing above, the user_id is shared by the FS.identify API call and the Split SDK configuration key (shown in blue).

Then, add a custom impression listener to report Split impressions to FullStory’s custom events API. As highlighted in red above, the FullStory custom event API is called for a “split_evaluation” event, passing the entire impression data as properties for that event. The impression data includes the name of the split evaluated and the treatment the user received.

If you’re not familiar with the Split Javascript SDK configuration, visit Split's Javascript documentation for more details.


Verify split_evaluation Events are Arriving in FullStory

On the session playback screen, look for the split_evaluation event.


If you have many events, try searching for split_evaluation with the “Filter events” function.


Create a Segment Based on Treatment Received

Once you have split_evaluation events, you can create a new FullStory segment that will contain all the users who received a particular treatment from a given split.

From the FullStory home page, click to create a new segment.


Under API Events, click split_evaluation.


Now build an Event Filter for any split and treatment you’ve integrated.


In this example, the segment will show sessions where there was a getTreatment call to “multivariant_demo” and the user received “v3” as their treatment.


You can now playback and review specific customer experiences!

Every session in this playlist showed v3 of the multivariant_demo split.

Knowing which treatment a user saw for a particular split is crucial data for evaluating their experience with FullStory. This simple integration makes that data available to analyze a single user’s session and to create segments for overall comparison of behavior between treatment groups.

If you have questions or comments, contact the contributor David Martin.


 

 

Built by: Split

Setup: Manual 

Support: support@split.io 

Version: 1.0 

This is a community-supported integration. We do our best to ensure that we share only high-quality community integrations and solutions, but we do not work on these projects directly, nor can we guarantee that they’re consistently maintained.

Contact