Skip to content

Analytics

JustAI provides analytics at two levels: template-level dashboards that show experiment performance and variant metrics, and an org-wide usage page that tracks API consumption.

Each template has an Overview tab that serves as its performance dashboard. This is the first thing you see when you open a template.

The top of the dashboard shows aggregate performance for the template’s key metric:

  • Overall lift — How much the experiment variants outperform the control, expressed as a percentage
  • Sends — Total number of API requests served
  • Key metric rate — The current rate for your optimization metric (e.g. open rate, click rate)

Lift is calculated by comparing the weighted average performance of experiment variants against the control group. A positive lift means your variants are outperforming the original content.

Below the topline metrics, a table breaks down performance by individual variant:

ColumnDescription
VariantName and theme tags
SendsNumber of times the variant was served
Key metricPerformance on the template’s optimization metric
Lift vs. controlPercentage improvement over the control
SignificanceWhether the result is statistically significant

Use this table to identify your top performers and spot variants that should be archived.

If your template uses attributes, the dashboard shows how variants perform across different audience segments. This reveals which content resonates with which users — for example, a “social proof” variant might outperform for enterprise users while an “urgency” variant wins for startups.

The Learnings section surfaces key takeaways from the experiment, including which themes and messaging strategies are working best. These insights carry forward when you generate new variants in the Studio.

The Analytics tab provides more detailed performance data beyond the Overview dashboard. Use it for deeper analysis, including:

  • Performance trends over time
  • Metric breakdowns across multiple dimensions
  • Detailed statistical analysis of variant comparisons

JustAI supports two ways to count events:

ModeDescriptionBest for
UniqueCounts each user once, regardless of how many times they trigger the eventOpen rates, click rates — avoids inflated counts from repeat actions
All eventsCounts every event occurrence, including repeats from the same userRevenue, total engagement volume

Toggle between these modes in the analytics view to see both perspectives.

Analytics data is governed by two parameters:

  • lookback_days (default: 14) — How many days of historical data to include in the analytics window
  • offset_days (default: 3) — How many recent days to exclude, allowing time for delayed events (like conversions that happen days after an email open) to be fully recorded

Together, these create an analytics window that shows the period from (today - lookback_days - offset_days) to (today - offset_days). This ensures your analytics reflect complete data rather than partial results from recent days.

For experiments that haven’t yet reached statistical significance, JustAI shows projected results — an estimate of where metrics are trending based on current data. Projected results are clearly labeled and should be treated as directional rather than conclusive.

When reading lift percentages:

  • Positive lift means the variant outperforms the control on your key metric
  • Negative lift means the variant underperforms the control
  • Lift with significance (marked with a confidence indicator) means there’s enough data to trust the result
  • Lift without significance means more data is needed — the result could change as traffic accumulates

A variant showing +20% lift without statistical significance is not necessarily a winner. Wait until the minimum sample size and p-value thresholds are met before making shipping decisions.

The Analytics page in the main navigation shows organization-level API usage:

  • Monthly usage — Total API requests across all templates for the selected month
  • Usage cap — Your plan’s monthly API request limit
  • Month selector — View usage for any previous month

This page helps you monitor consumption and plan for capacity.