Measurement
Part of Newsletter measurement that keeps permission, attention, customers and cash apart
Paid newsletter attribution methods compared as analytical designs, no universal winner
Newsletter attribution methods compared as analytical designs, covering event definitions, assumptions, privacy limits and why there is no universal winner.
Attribution allocates an observed event. Causal evaluation asks whether an intervention changed what happened. These questions need different methods, and no approach is a universal winner.
What to take away
- Attribution allocates an observed event, while causal evaluation asks whether an intervention changed what happened.
- No single method wins; choose first or last interaction for transparent operational allocation when its blindness is acceptable.
- Multi-touch splits rest on analyst weights, so precision in the output does not validate the causal story.
- A credible counterfactual is needed before claiming causal effect, and contribution analysis needs alternatives examined.
- Never relabel an attributed entitlement as profit, incremental return or England-wide performance.
Comparison case and date
This desk comparison was completed on 6 September 2026. The common case is an adult-facing paid newsletter operated from England. The outcome unit is one verified first paid-access entitlement, not a click, checkout start, gross receipt or renewal. The reporting period, England billing-address rule, eligible channels, identity rule and lookback window must be fixed before calculation.
No accounts or transaction records were accessed. The criteria are data needed, allocation output, main assumption, causal strength, privacy burden and useful decision. Methods are compared as analytical designs, not software products.
Like-for-like options
Output and assumption
- Last eligible interaction
- Assigns the entitlement to the final recorded eligible interaction inside the declared window. Assumes that rule is useful for the decision.
- First eligible interaction
- Assigns the same event to the earliest qualifying touch. Assumes the first recorded exposure is the useful owner.
- Declared multi-touch split
- Divides one entitlement across eligible touches using a published weighting formula whose total equals one event.
- Randomised or credible quasi-experimental comparison
- Estimates the difference between intervention and comparable counterfactual outcomes in the same unit and period.
- Contribution analysis
- Tests a stated causal pathway against several sources and credible alternative explanations.
Boundary
- Last eligible interaction
- Simple to reproduce, but earlier exposure and unobserved routes disappear. It is allocation, not causation.
- First eligible interaction
- Highlights discovery under the rule, while later influences and missing history remain unresolved.
- Declared multi-touch split
- The weights are analyst choices unless supported by evidence. Precision in the output does not validate the causal story.
- Randomised or credible quasi-experimental comparison
- Can support a causal estimate if design assumptions hold, but feasibility, consent, contamination, sample size and implementation need expert review.
- Contribution analysis
- Produces an evidenced contribution argument rather than a mechanically allocated conversion or definitive effect size.
HM Treasury's current Quality in Policy Impact Evaluation explains that monitoring a change does not show that an intervention caused it and that a strong counterfactual supports causal attribution. Its scope is UK government evaluation, so this article borrows the reasoning rather than claiming a private-newsletter standard.
The 2026 Magenta Book analytical annex describes contribution analysis as an evidenced line of reasoning whose strength depends on the theory and evidence, not definitive proof. Use that label only when alternatives have actually been examined.
Shared data and permission limits
All five approaches need stable event definitions. A supplier-defined delivered state is not human attention. An open is also technically fragile: Apple's UK Mail guide states that remote content may download in the background under Mail Privacy Protection. Click identifiers can be incomplete or affected by automated activity.
Identity linking increases privacy risk. The ICO's data-minimisation guidance says personal information should be limited to what is necessary. A privacy reviewer should challenge whether person-level joining is needed, define access and deletion, and keep direct-marketing permission separate from measurement purpose.
Select by the decision
Use a first- or last-interaction rule for transparent operational allocation when known blindness is acceptable. Use a multi-touch split only if stakeholders understand weights are conventions.
Plan a proportionate counterfactual design before launch when the decision truly needs causal effect. If that design is not credible, report observed entitlements and an allocation view, or run a properly scoped contribution analysis.
Money follows another lane. Reconcile entitlements with gross receipts, completed refunds, disputes, settled cash and ledger entries, then send tax and VAT treatment to qualified advisers. Never relabel an attributed entitlement as profit, incremental return or England-wide performance.
Before you act
Before you act
- Fix reporting period, billing rule, channels, lookback
- Define outcome as verified first paid-access entitlement
- Check if person-level identity linking is necessary
- Keep direct-marketing permission separate from measurement
- Reconcile entitlements with receipts, refunds, disputes
- Send tax and VAT treatment to qualified advisers
Common questions
What is the difference between attribution and causal evaluation?
Attribution allocates an observed event, such as a paid-access entitlement, to a touch under a declared rule. Causal evaluation asks whether an intervention changed what happened, which needs a comparable counterfactual. The article says these questions need different methods and no approach is a universal winner.
Why can an email open be a weak signal?
Apple's UK Mail guide states that remote content may download in the background under Mail Privacy Protection, so an open does not prove human attention. A supplier-defined delivered state is also not attention, and click identifiers can be incomplete or affected by automated activity.
When should a multi-touch split be used?
Use a declared multi-touch split only if stakeholders understand that the published weights are conventions rather than evidence. The formula divides one entitlement across eligible touches and totals one event, but precision in the output does not validate the causal story behind it.
