Issue Summary

Marketplace has a reporting API which reports to the partners the number of evaluations that started during a time period (depending on the date range selected in the date filter). For example, a partner can use filters and find out the number of evaluations they had during 1 Jan 2024 to 31 Jan 2024.

This data is provided for all the hosting types but for cloud. For cloud products, a customer starts the evaluation, an entitlement is created for that evaluation and that same entitlement gets converted to a paid license after the customer starts paying. [For server and DC there are two separate licenses for evaluation and paid].

For cloud products, we are currently not showing the number evaluations as point in time. What this means is that as soon as customer starts paying and the license moves from an evaluation to a paid license, we stop showing that license in the evaluation count of the past months (when it was actually in evaluation phase). This leads to partners seeing the count of the evaluation decreasing over time (as the licenses convert to paid) when they look at the data again for the same period.

This is reproducible on Data Center: (no)

Steps to Reproduce

1. Go to https://marketplace.atlassian.com/manage/vendors/<vendor-id>/reporting/evaluations
2. Select date range as a period in past and note down the number of cloud evaluations.
3. Come back after few days and open the evaluations report for same date range, and observe the number of cloud evaluations. 
4. If few of the evaluations from the selected date range have been converted as paid license then the count of cloud evaluations would have reduced as compared to Step 2. 

Expected Results

Historical evaluations count should not change over a period of time. 

Actual Results

Historical evaluations count changes over a period of time and becomes lower as few of the evaluations convert to paid.

Workaround

Currently there is no known workaround for this behavior.