• Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Low Low
    • None
    • 10.6.0, 10.3.5
    • Assets - Import

      Issue Summary

      In the Insight import log the import summary, after the import is finished does not record all objects with similar type of error. It use to work before in JSM version 5 and it was a useful feature for users.

      In the Insight import log the import summary after the import is finished, it does not record all objects if they have similar type of error. It use to log all object names with error until JSM version 5 and it was a useful feature for users.

      Ex: In case there are 5 objects in the import CSV with NULL value for a mandatory object, it will show total 5 errors, However in the insight import log summary it will document only one object for each unique error.

      Steps to Reproduce

      1. Create a default schema with Employee object-Type that has attributes Name, Employment Start-date, Phone, created and updated attributes
      2. Define cardinality that "Employment start-date" and "phone" should have 1 value at least.
      3. Prepare a CSV with 5 users. 4 of them should have Null in Phone Coloumn and one should have Null in start-date example. You can use the attached CSV attached Employee-import_2025-05-16T11:17:46.306Z.csv
      4. Create import configuration and Map the fields.
      5. Run the import and check the insight-import.log.
      6. The Process result records unique errors displaying only one impacted object.

      Expected Results

      Tess Aguila(null), Anton Dry  (null),Fred Astair(null),"Sara Peen(null),Wes Shults(null) all objects with error should be printed in the summary after the import is finished in insight-import.log.

      Below is the example with previous version (5.12.12) behaviour.

      [insight-InsightThreadGroup-worker-thread-8] {Id=4, Name=user, Type=rlabs-import-type-csv, jira.username=admin} | Finished import at time 2025-05-16T15:34:09.527253. Import took 9 ms
      
      2025-05-16 16:11:29,392 [insight-InsightThreadGroup-worker-thread-13] {Id=1, Name=test1, Type=rlabs-import-type-csv, jira.username=admin} | {"type":"IMPORT","id":null,"started":1747392089353,"ended":1747392089379,"executedType":"MANUAL","executedAsUserKey":"JIRAUSER10000","objectSchemaId":2,"numberOfWorkers":12,"result":"OBJECT_TYPE_ERRORS","status":"FINISHED","infoMessage":null,"importSourceId":1,"moduleKey":"rlabs-import-type-csv","moduleVersion":1,"onlyExecutedForObjectTypes":[],"objectTypeResultMap":{"37":{"id":null,"objectTypeName":"Employees","objectTypeId":37,"objectsUpdated":0,"objectsCreated":0,"objectsIdentical":0,"objectsMissingUpdated":0,"objectsMissingDeleted":0,"entriesInSource":5,"duplicateEntries":0,"emptyLabelEntries":0,"emptyExternalIdEntries":0,"objectsFilteredWithIQL":0,"errorMessages":["Tess Aguila(null): At least one value must be set; At least one value must be set","Wes Shults(null): At least one value must be set; At least one value must be set","Anton Dry  (null): At least one value must be set; At least one value must be set","Fred Astair(null): At least one value must be set; At least one value must be set","Sara Peen(null): At least one value must be set"],"readExternalDataTimeInMs":2,"mapExternalDataTimeInMs":0,"iqlFilteringTimeInMs":0,"decidingActionsTimeInMs":0,"writeInsightDataTimeInMs":0,"postFunctionTimeInMs":0,"executionTimeInMs":2,"objectsWithUpdatedReferences":0}},"errorMessages":["Employees"],"updateReferencesTimeInMs":0,"ok":false,"inProgress":false}  

      Actual Results

      Only two objects are printed in summary. Tess Aguila(null) (Phone is NULL), 

      Sara Peen(null) (Employemnt start date is NULL)[insight-InsightThreadGroup-worker-thread-8] {Id=4, Name=user, Type=rlabs-import-type-csv, jira.username=admin} | Finished import at time 2025-05-16T15:34:09.527253. Import took 9 ms
      
      2025-05-16 15:34:09,534 [insight-InsightThreadGroup-worker-thread-8] {Id=4, Name=user, Type=rlabs-import-type-csv, jira.username=admin} | {"type":"IMPORT","id":null,"typeIdentifier":null,"started":1747389849517,"ended":1747389849527,"executedType":"MANUAL","executedAsUserKey":"JIRAUSER10000","objectSchemaId":1,"numberOfWorkers":12,"result":"OBJECT_TYPE_ERRORS","status":"FINISHED","infoMessage":null,"importSourceId":4,"moduleKey":"rlabs-import-type-csv","moduleVersion":1,"onlyExecutedForObjectTypes":[],"objectTypeResultMap":{"16":{"id":null,"objectTypeName":"Employees","objectTypeId":16,"objectsUpdated":0,"objectsCreated":0,"objectsIdentical":0,"entriesInSource":5,"duplicateEntries":0,"emptyLabelEntries":0,"emptyExternalIdEntries":0,"objectsFilteredWithIQL":0,"errorMessages":["{\"objectTypeName\":\"Employees\",\"errorMessage\":\"Sara Peen(null): At least one value must be set\",\"count\":1}","{\"objectTypeName\":\"Employees\",\"errorMessage\":\"Tess Aguila(null): At least one value must be set; At least one value must be set\",\"count\":4}"],"errorCount":5,"readExternalDataTimeInMs":1,"mapExternalDataTimeInMs":0,"iqlFilteringTimeInMs":0,"decidingActionsTimeInMs":0,"writeInsightDataTimeInMs":0,"postFunctionTimeInMs":0,"executionTimeInMs":1,"objectsWithUpdatedReferences":0,"objectsMissingArchived":0,"objectsMissingDeleted":0,"objectsMissingUpdated":0}},"errorMessages":["Employees"],"updateReferencesTimeInMs":0,"inProgress":false,"ok":false}  

      Workaround

      Currently users will have to utilise log entry created during import to identify all the objects that has error.

      6 15:34:09,522 [insight-InsightThreadGroup-worker-thread-8] {Id=4, Name=user, Type=rlabs-import-type-csv, jira.username=admin} | Decided actions for all objects in 0 ms
      2025-05-16 15:34:09,522 [insight-InsightThreadGroup-worker-thread-8] {Id=4, Name=user, Type=rlabs-import-type-csv, jira.username=admin} | Objects to import 5
      2025-05-16 15:34:09,526 [insight-InsightImportThreadGroup-4-worker-thread-30] {jira.username=admin} | Failed to create new object: Wes Shults (null), ObjectTypeId: 16, Attributes: (AttributeTypeId: 50, value(s):[null(Wes Shults)],AttributeTypeId: 133, value(s):[null(false)],AttributeTypeId: 120, value(s):[null(Fri May 16 23:19:00 IST 2025)],AttributeTypeId: 121, value(s):,AttributeTypeId: 128, value(s):), avatar: false with actions: [CREATE] due to rlabs-insight-attribute-121: At least one value must be set; rlabs-insight-attribute-128: At least one value must be set;
      2025-05-16 15:34:09,526 [insight-InsightImportThreadGroup-4-worker-thread-29] {jira.username=admin} | Failed to create new object: Tess Aguila (null), ObjectTypeId: 16, Attributes: (AttributeTypeId: 50, value(s):[null(Tess Aguila)],AttributeTypeId: 133, value(s):[null(false)],AttributeTypeId: 120, value(s):[null(Thu May 15 23:19:00 IST 2025)],AttributeTypeId: 121, value(s):,AttributeTypeId: 128, value(s):), avatar: false with actions: [CREATE] due to rlabs-insight-attribute-121: At least one value must be set; rlabs-insight-attribute-128: At least one value must be set;
      2025-05-16 15:34:09,526 [insight-InsightImportThreadGroup-4-worker-thread-28] {jira.username=admin} | Failed to create new object: Sara Peen (null), ObjectTypeId: 16, Attributes: (AttributeTypeId: 50, value(s):[null(Sara Peen)],AttributeTypeId: 128, value(s):[null(123456)],AttributeTypeId: 133, value(s):[null(false)],AttributeTypeId: 121, value(s):), avatar: false with actions: [CREATE] due to rlabs-insight-attribute-121: At least one value must be set;
      2025-05-16 15:34:09,526 [insight-InsightImportThreadGroup-4-worker-thread-26] {jira.username=admin} | Failed to create new object: Anton Dry   (null), ObjectTypeId: 16, Attributes: (AttributeTypeId: 50, value(s):[null(Anton Dry  )],AttributeTypeId: 133, value(s):[null(false)],AttributeTypeId: 120, value(s):[null(Thu May 15 23:19:00 IST 2025)],AttributeTypeId: 121, value(s):,AttributeTypeId: 128, value(s):), avatar: false with actions: [CREATE] due to rlabs-insight-attribute-121: At least one value must be set; rlabs-insight-attribute-128: At least one value must be set;
      2025-05-16 15:34:09,526 [insight-InsightImportThreadGroup-4-worker-thread-27] {jira.username=admin} | Failed to create new object: Fred Astair (null), ObjectTypeId: 16, Attributes: (AttributeTypeId: 50, value(s):[null(Fred Astair)],AttributeTypeId: 133, value(s):[null(false)],AttributeTypeId: 120, value(s):[null(Fri May 16 23:19:00 IST 2025)],AttributeTypeId: 121, value(s):,AttributeTypeId: 128, value(s):), avatar: false with actions: [CREATE] due to rlabs-insight-attribute-121: At least one value must be set; rlabs-insight-attribute-128: At least one value must be set; 

      Versions Tested

      Please confirm all versions that have been tested for this issue, and indicate whether the tested version is affected or not affected, below: 

      Testing Requirements Version Affected Version
      Customers Reported Version Example: 10.3.5 Yes
      Most Recent Bug-Fix Release 10.6 Yes
      Previous Major Release    
      Most Recent LTS    
      Previous Supported LTS    
      Other Versions..    
      (Add rows as needed)    

            [JSDSERVER-16216] Insight import log summary does not record all object after upgrade

            Bartosz Ornatowski made changes -
            Status Original: Needs Triage [ 10030 ] New: Gathering Impact [ 12072 ]
            SET Analytics Bot made changes -
            Support reference count New: 1
            Security Metrics Bot made changes -
            Labels New: ril
            Security Metrics Bot made changes -
            Remote Link New: This issue links to "Internal ticket (Web Link)" [ 1019182 ]
            Shiwani Choudhary created issue -

              Unassigned Unassigned
              6f6f0ed1241f Shiwani Choudhary
              Affected customers:
              1 This affects my team
              Watchers:
              2 Start watching this issue

                Created:
                Updated: