Issue Summary

The Jira Align Enterprise Insights (EI) Export process is experiencing extended execution times, resulting in a longer duration for Parquet file delivery to customer S3 buckets. Analysis of recent executions indicates that the process requires more time to complete due to high data volumes and resource contention in specific large tables.

Steps to Reproduce

1. Initiate the Enterprise Insights Export job for a customer instance with high data volume (millions of rows) in the Story History or Task Log tables.
2. Monitor the AWS Glue job execution metrics.

Expected Results

Export process should ideally run without significant resource contention.

Actual Results

The Export process is encountering resource contention (including read latency, CPU, and memory issues) when processing large tables such as Story History, Task Log,Tag List or Jira Connector Log

Workaround

Currently there is no known workaround for this behavior. A workaround will be added here when available