Questions about AI Framework & AI Management modules (availability and custom chat client integration) #10089

2 Answer(s)

• 

  0

  AI-Bot created 17 hours ago

  Support Team ABP Agent

  1. Solution

  • Using the preview modules
    • Install and enable:
      • Add Volo.Abp.AI and Volo.Abp.AI.Management packages to your solution and add the corresponding module dependencies in your module classes.
      • Configure an IChatClient via Microsoft.Extensions.AI in your web (or application) module. ABP’s AI infrastructure is designed to work with Microsoft.Extensions.AI abstractions.
      • Example minimal setup (OpenAI shown as a reference provider):

  using Microsoft.Extensions.AI;
        using OpenAI;
  
        [DependsOn(
            typeof(AbpAIModule),          // AI infrastructure
            typeof(AiManagementModule)    // AI Management module
        )]
        public class MyProjectWebModule : AbpModule
        {
            public override void ConfigureServices(ServiceConfigurationContext context)
            {
                var configuration = context.Services.GetConfiguration();
  
                context.Services.AddSingleton(new OpenAIClient(configuration["AI:OpenAI:Key"]));
  
                context.Services.AddChatClient(services =>
                    services.GetRequiredService<OpenAIClient>()
                            .AsChatClient(configuration["AI:OpenAI:Chat:ModelId"] ?? "gpt-4o-mini"));
            }
        }
  

  - appsettings.json example:
  

  {
          "AI": {
            "OpenAI": {
              "Key": "YOUR-KEY",
              "Chat": { "ModelId": "gpt-4o-mini" }
            }
          }
        }
  

  • Current limitations to be aware of (preview):

    • Provider coverage is driven by Microsoft.Extensions.AI integrations; features vary per provider (e.g., tool/function calling, images, embeddings). Ensure the chosen provider supports your required capabilities.
    • The AI Management module is evolving: management UI and orchestration features are being expanded; some scenarios may be incomplete in preview.
    • Expect changes while in preview; validate your configuration and keep packages in sync with the related ABP version.

  • Roadmap / planning

    • The modules are in preview; ABP aims to build on Microsoft.Extensions.AI and add management, configuration, and orchestration capabilities on top. Some features (like deeper agent/orchestration support and richer management UI) are planned and rolling out. While abstractions are intended to be stable, preview implies there may be breaking changes. Follow the docs/changelogs for updates as versions progress from preview to stable.

  • Custom chat client calling an external API (AI agents)

    • Yes, you can plug a custom chat client using ConfigureChatClient/AddChatClient. The recommended way is to implement Microsoft.Extensions.AI.IChatClient (or adapt an existing client) and register it, so the rest of ABP AI infrastructure and AI Management can use it like built-in providers.
    • Minimal example: forwarding to an arbitrary HTTP endpoint

  using System.Net.Http;
      using System.Net.Http.Json;
      using System.Threading;
      using System.Threading.Tasks;
      using Microsoft.Extensions.AI;
  
      public sealed class HttpForwardingChatClient : IChatClient
      {
          private readonly HttpClient _http;
          private readonly string _endpoint; // e.g. https://customer-api.example.com/agent/chat
  
          public HttpForwardingChatClient(HttpClient http, string endpoint)
          {
              _http = http;
              _endpoint = endpoint;
          }
  
          public async Task<ChatCompletion> CompleteAsync(
              ChatMessage message,
              ChatOptions options = null,
              CancellationToken cancellationToken = default)
          {
              var payload = new
              {
                  input = message.Text,
                  // optionally map options (system prompt, temperature, tools, etc.)
              };
  
              var response = await _http.PostAsJsonAsync(_endpoint, payload, cancellationToken);
              response.EnsureSuccessStatusCode();
              var result = await response.Content.ReadFromJsonAsync<ExternalResponse>(cancellationToken: cancellationToken);
  
              return new ChatCompletion(new ChatMessage(Role.Assistant, result?.Output ?? string.Empty));
          }
  
          // Implement other IChatClient members if needed by your use-cases (e.g., streaming)
          private sealed class ExternalResponse
          {
              public string Output { get; set; }
          }
      }
  

  - Registering the custom client with ABP AI:
  

  [DependsOn(typeof(AbpAIModule), typeof(AiManagementModule))]
        public class MyProjectWebModule : AbpModule
        {
            public override void ConfigureServices(ServiceConfigurationContext context)
            {
                var configuration = context.Services.GetConfiguration();
                context.Services.AddHttpClient<HttpForwardingChatClient>(client =>
                {
                    client.BaseAddress = new Uri(configuration["AI:ExternalAgent:BaseUrl"]);
                });
  
                context.Services.AddChatClient(sp =>
                    sp.GetRequiredService<HttpForwardingChatClient>());
            }
        }
  

  - After registration, you can inject IChatClient anywhere (app services, pages, components) and AI Management can treat it similarly to built-in providers, as the integration point is the same abstraction (IChatClient). If your scenario requires streaming, tools/functions, or multi-turn context, implement the corresponding members or map the needed options to your external API.
  

  2. Sources

  • ABP AI infrastructure (preview) overview:
    • https://abp.io/docs/10.0/framework/infrastructure/artificial-intelligence
  • AI Management module:
    • https://abp.io/docs/10.0/modules/ai-management
  • Example of configuring IChatClient via Microsoft.Extensions.AI in ABP (community article showing the same patterns used by ABP AI):
    • https://abp.io/community/articles/rsfvihla

  ---

  This response was generated by AI. If it didn’t solve your problem, feel free to post a new answer — our support team will jump in to help you soon.

  Save Cancel
• 

  0

  Frontis2 created 17 hours ago

  AI agent answer is not relevant for us :)

  Save Cancel