The integration does not present itself to NC in a consistent way

[TheWojtek]

Which version of integration_openai are you using?

3.9.1

Which version of Nextcloud are you using?

32.0.2

Which browser are you using? In case you are using the phone App, specify the Android or iOS version and device please.

Safari 26.1 (build 21622.2.11.11.9)

Describe the Bug

I struggle to understand what this integration does and what it does not. The settings available in the Nextcloud assistant once the integration is installed are rather confusing:

It warns me it needs something to generate stickers but I have the sticker feature turned off.
It warns me it needs something for speech-to-text, though if I have S2T turned off
It wants me to install OpenAI/LocalAI integration... but I have it installed:

These may be bugs in the NC Assistant and I raised them there. However I struggle to understand the actual functionality of the "integration" since it passes the input from NC to LocalAI (etc) and - in most cases - is able to get the results back. Well, OK, but NC claims there are no functions available, while they are and in the process it introduces a mess in the NC UI.

• selected the "extract topics" and "summarize" toggles, the functionality becomes available in the NC Assistant, however there is no way to instruct the LocalAI integration to use a specialized model for topic extraction and summary. It will use whatever text generation is selected.
• NC Assistant claims there are no text nor image generation "apps"

yet this is exactly what LocalAI/OpenAI integration does. Allows NC Assistant to process text. Same goes for the image generation - warning of "None of your currently installed apps provide image generation functionality" while NC Assistant provides exactly this functionality once it interfaced to an image generation model running on LocalAI.

Expected Behavior

1. Ability to reliably map OpenAI/LocalAI models functionality to tasks that are made available to users
2. Removal of unnecessary alerts claiming OpenAI/LocalAI integration is not installed
3. UI and message cleanup for clarity

To Reproduce

1. Install NC Assistant and OpenAI/LocalAI integration
2. Connect to an AI engine (OpenwebUI proxying to underlying models in my case)
3. Manage the integration from "Nextcloud Assistant" pane in NC Settings.

[kyteinsky]

hello,

I struggle to understand what this integration does and what it does not. The settings available in the Nextcloud assistant once the integration is installed are rather confusing:

the setting in the top-most picture come from the Assistant app, the structure is that there is one section of settings "Assistant" and multiple apps pour their settings in this section, the Assistant app, OpenAI/LocalAI integration, Context Chat, etc.

It warns me it needs something to generate stickers but I have the sticker feature turned off.
It warns me it needs something for speech-to-text, though if I have S2T turned off

when these providers are turned off in this integration, they just disappear/are not registered at all so the Assistant app (at least I think that's what happens) so it is a difficult state to analyse, maybe there could be some hints to remedy the situation but it needs to be done in the Assistant app.

It wants me to install OpenAI/LocalAI integration... but I have it installed:

that's just a hard-coded warning message listing all our possible providers, why is it so bothersome?

selected the "extract topics" and "summarize" toggles, the functionality becomes available in the NC Assistant, however there is no way to instruct the LocalAI integration to use a specialized model for topic extraction and summary. It will use whatever text generation is selected.

those are meta-task-types, the task types that use another task types. For example "extract topics" task type adds instructions for the model to follow but logic to the actually process the prompt is the same as the text generation/text-to-text task type so that is re-used.

NC Assistant claims there are no text nor image generation "apps"

oh those are old APIs, and you're right that's an issue, they should be marked "old" or "deprecated" in the UI too.
would you mind opening an issue with the image in the server repo https://github.com/nextcloud/server/ ?

does that answer everything?

[TheWojtek]

It wants me to install OpenAI/LocalAI integration... but I have it installed:

that's just a hard-coded warning message listing all our possible providers, why is it so bothersome?

Because it looks like something is not working while it is. This is an unnecessary warning that looks like it is a result of some diagnostics while it is not. If there is a working LocalAI integration, users should not be reminded that they need a working LoclAI integration, because it is unnecessary. No one displays a "Low fuel" warning when the tank is full.

oh those are old APIs, and you're right that's an issue, they should be marked "old" or "deprecated" in the UI too. would you
mind opening an issue with the image in the server repo https://github.com/nextcloud/server/ ?

Sure, just let me phrase it properly.

does that answer everything?

As always, you know I keep bugging you and you do provide answers, so I am always satisfied with your approach.