Problem

Currently, the Automation Platform does not support the use of NLP features with internally hosted Large Language Models (LLMs). This limitation makes it impossible for customers who have opted to host their LLMs in-house to take advantage of the AI features offered by the our platform.

Suggested Solution

Implement support for internally hosted LLMs within the Automation Platform to ensure compatibility and functionality for all customers, regardless of their hosting preferences.

Why This Is Important

Supporting internal LLM hosting is crucial for customers who prioritize data privacy and security by keeping their data in-house. This enhancement will make the AI product accessible and usable for those who prefer not to send their data to external LLM services.

Workaround

Currently, there is no known workaround for this issue. A workaround will be documented here if one becomes available.