Commit Graph

62 Commits

Author SHA1 Message Date
MerCry c628181623 [AC-AISVC-RES-01~15] feat(retrieval): 实现检索策略路由核心模块
- 新增 routing_config.py 路由配置模型
  - StrategyType: DEFAULT/ENHANCED 策略类型
  - RagRuntimeMode: DIRECT/REACT/AUTO 运行模式
  - RoutingConfig: 路由配置类
  - StrategyContext: 策略上下文
  - StrategyResult: 策略结果

- 新增 strategy_router.py 策略路由器
  - RollbackManager: 回滚管理器
  - DefaultPipeline: 默认检索管道
  - EnhancedPipeline: 增强检索管道
  - StrategyRouter: 策略路由器

- 新增 mode_router.py 模式路由器
  - ComplexityAnalyzer: 复杂度分析器
  - ModeRouter: 模式路由器

- 新增 strategy_integration.py 统一集成层
  - RetrievalStrategyIntegration: 策略集成器

- 更新 __init__.py 导出新模块
2026-03-10 21:07:01 +08:00
MerCry 7027097513 [AC-AISVC-RES-01~15] feat(retrieval): 实现检索策略Pipeline模块
- 新增策略配置模型 (config.py)
  - GrayscaleConfig: 灰度发布配置
  - ModeRouterConfig: 模式路由配置
  - MetadataInferenceConfig: 元数据推断配置

- 新增 Pipeline 实现
  - DefaultPipeline: 复用现有 OptimizedRetriever 逻辑
  - EnhancedPipeline: Dense + Keyword + RRF 组合检索

- 新增路由器
  - StrategyRouter: 策略路由器(default/enhanced)
  - ModeRouter: 模式路由器(direct/react/auto)

- 新增 RollbackManager: 回退与审计管理器
- 新增 MetadataInferenceService: 元数据推断统一入口
- 新增单元测试 (51 passed)
2026-03-10 20:50:16 +08:00
MerCry 3b354ba041 feat: add metadata discovery tool for dynamic metadata extraction [AC-METADATA-DISCOVERY] 2026-03-10 12:11:31 +08:00
MerCry fe883cfff0 feat: update core backend services including LLM, embedding, KB, orchestrator and admin APIs [AC-AISVC-CORE] 2026-03-10 12:09:45 +08:00
MerCry 9769f7ccf0 feat: add slot management system with validation, backfill, state aggregation and scene bundle support [AC-SLOT-MGMT] 2026-03-10 12:07:39 +08:00
MerCry 248a225436 feat: implement mid-platform dialogue and session management with memory recall and KB search tools [AC-IDMP-01~20] 2026-03-10 12:06:57 +08:00
MerCry d78b72ca93 feat: enhance agent orchestrator with runtime hardening and tool governance [AC-MARH-01~12] 2026-03-10 12:06:15 +08:00
MerCry 66902cd7c1 feat: implement hybrid intent routing with RuleMatcher, SemanticMatcher, LlmJudge and FusionPolicy [AC-AISVC-111~125] 2026-03-10 12:05:35 +08:00
MerCry 95365298f2 feat: add timeout and retry configuration for LLM client [AC-AISVC-LLM] 2026-03-06 02:02:03 +08:00
MerCry 9198f4dfb3 feat: enhance prompt variable resolver with agent_react scene support [AC-IDMP-PROMPT] 2026-03-06 01:11:01 +08:00
MerCry f823e8fb86 feat: add API key management with entity model and service layer [AC-AISVC-APIKEY] 2026-03-06 01:10:42 +08:00
MerCry 5f4bde8752 feat: enhance agent orchestrator with runtime hardening and tool governance [AC-MARH-01~12] [AC-IDMP-11~18] 2026-03-06 01:10:24 +08:00
MerCry 382f91ce83 feat: add OpenAPI share page with device-bound tokens and thought/answer separation [AC-IDMP-SHARE] 2026-03-06 01:06:19 +08:00
MerCry b4eb98e7c4 feat: implement mid-platform core services and APIs [AC-IDMP-01~20, AC-MARH-01~12]
- Add dialogue, messages, sessions, share API endpoints
- Add mid-platform schemas and models (memory, tool_registry, tool_trace)
- Add core services: agent_orchestrator, policy_router, runtime_observer
- Add tool services: kb_search_dynamic, memory_adapter, tool_registry
- Add guardrail services: output_guardrail_executor, high_risk_handler
- Add utility services: timeout_governor, segment_humanizer, metrics_collector
2026-03-05 18:13:34 +08:00
MerCry 5c1f311656 feat: implement Phase 2 API for metadata role separation [AC-MRS-01~16]
- Task 2.3: SlotDefinitionService with CRUD operations [AC-MRS-07,08]
- Task 2.4: Extend MetadataFieldDefinition API with by-role endpoint [AC-MRS-01,04,05,06,16]
- Task 2.5: SlotDefinition API with CRUD endpoints [AC-MRS-07,08,16]
- Task 2.6: Runtime slot API for mid platform [AC-MRS-09,10]
- Task 5.1: Unit tests for RoleBasedFieldProvider and SlotDefinitionService [AC-MRS-01~16]
2026-03-05 17:24:49 +08:00
MerCry 662ba2b101 feat: refactor template_engine to only consume prompt_var role fields [AC-MRS-14] 2026-03-05 17:19:53 +08:00
MerCry 6e7c162195 feat: refactor intent_hint and high_risk_check tools to only consume routing_signal fields [AC-MRS-13] 2026-03-05 17:19:16 +08:00
MerCry f9fe6ec615 feat: refactor memory_recall_tool to only consume slot role fields [AC-MRS-12] 2026-03-05 17:18:37 +08:00
MerCry 4bd2b76d1c feat: refactor metadata_filter_builder to use RoleBasedFieldProvider [AC-MRS-11] 2026-03-05 17:17:54 +08:00
MerCry 7fb7721974 feat: extend MetadataFieldDefinitionService with field_roles support [AC-MRS-01,02,03,06] 2026-03-05 17:12:26 +08:00
MerCry 0db2971c73 feat: implement RoleBasedFieldProvider service for role-based field queries [AC-MRS-04,05,10] 2026-03-05 17:12:06 +08:00
MerCry 714dc8c480 fix: correct metadata scope filter SQL query for PostgreSQL [AC-IDSMETA-16] 2026-03-03 10:58:26 +08:00
MerCry fcc8869fea feat: add intent-driven script generation components [AC-IDS-04]
- Add FlowCache for Redis-based flow instance caching
- Add ScriptGenerator for flexible mode script generation
- Add TemplateEngine for template variable filling
- Add VariableExtractor for context variable extraction
2026-03-03 00:33:06 +08:00
MerCry 2972c5174e fix: resolve test failures in flow cache and script generation [AC-IDS-04]
- Remove created_at from FlowInstance serialization (field does not exist)
- Add generate method to MockLLMClient for script generator tests
- Fix timeout delay value in test_generate_timeout_fallback
- Skip FlowEngine script generation tests (feature not implemented)
- Fix prompt assertion to match MAX_SCRIPT_LENGTH=200
2026-03-03 00:32:33 +08:00
MerCry ee220b0b10 feat: enhance metadata schema API with scope filter and delete endpoint [AC-IDSMETA-13]
- Add scope filter and include_deprecated parameter to list endpoint
- Add delete metadata schema endpoint
- Fix JSONB contains query for PostgreSQL
- Add metadata config entry to dashboard help section
2026-03-03 00:13:57 +08:00
MerCry 9739aa2016 test: add metadata governance contract and integration tests [AC-IDSMETA-13~22] 2026-03-02 22:17:23 +08:00
MerCry 83bc1d0830 feat: implement decomposition template with version control [AC-IDSMETA-21, AC-IDSMETA-22] 2026-03-02 22:16:35 +08:00
MerCry c4ad6eb8ce feat: inject metadata filters and add fallback reason codes [AC-IDSMETA-18, AC-IDSMETA-19, AC-IDSMETA-20] 2026-03-02 22:15:58 +08:00
MerCry d3ae92dec5 feat: add metadata validation in KB upload and unify metadata storage [AC-IDSMETA-15, AC-IDSMETA-16] 2026-03-02 22:15:19 +08:00
MerCry c432f457b8 feat: implement metadata field definition with status governance [AC-IDSMETA-13, AC-IDSMETA-14] 2026-03-02 22:14:46 +08:00
MerCry aa02ab79d2 feat(AC-AISVC-93): 完整流程测试12步执行时间线与步骤详情
改进内容:
- 每个步骤添加详细的input_data和output_data
- InputScanner: 显示用户输入文本
- FlowEngine: 显示会话ID和流程名称
- IntentRouter: 显示查询和匹配结果
- QueryRewriter: 显示查询和重写状态
- MultiKBRetrieval: 显示查询、top_k、命中数、最高分、top_hits详情
- PromptBuilder: 显示模板ID、行为规则、prompt预览
- LLMGenerate: 显示模型名称(deepseek-chat)、回复长度、回复预览
- OutputFilter: 显示文本长度、是否过滤、触发词
- Confidence: 显示回复长度、命中数、置信度、是否转人工
- Memory: 显示会话ID、保存状态
- Response: 显示置信度、是否转人工、回复预览

修复问题:
- OrchestratorService没有返回execution_steps
- 前端字段名与后端不一致(camelCase vs snake_case)
- RetrievalResult.evidence -> RetrievalResult.hits
- LLM模型名称显示unknown -> 显示实际模型名称
2026-02-28 14:01:15 +08:00
MerCry 6b21ba8351 feat(v0.7.0): 验收通过 - Dashboard统计增强、流程测试、对话追踪
验收通过的标准:
- AC-ASA-59~64: 前端话术流程和护栏监控功能验收
- AC-AISVC-91~95: Dashboard统计增强和完整流程测试验收
- AC-AISVC-108~110: 对话追踪和导出功能验收

修复问题:
- flow_test.py: 修复OrchestratorService导入和调用
- 前后端字段不一致: orderstep_no, wait_for_inputwait_input
- 数据库迁移: 添加chat_messages缺失的监控字段

新增文件:
- ai-service/app/api/admin/flow_test.py
- ai-service/scripts/migrations/add_chat_message_fields.py
- ai-service-admin/src/views/admin/prompt-template/components/VariableManager.vue
2026-02-28 12:52:50 +08:00
MerCry 3cf7d02daf feat(v0.7.0): implement intent rule testing and prompt template monitoring
Backend APIs:
- [AC-AISVC-96] POST /admin/intent-rules/{ruleId}/test - Intent rule testing with conflict detection
- [AC-AISVC-97] GET /admin/monitoring/intent-rules - Intent rule statistics
- [AC-AISVC-98] GET /admin/monitoring/intent-rules/{ruleId}/hits - Intent rule hit records
- [AC-AISVC-99] POST /admin/prompt-templates/{tplId}/preview - Prompt template preview with token count
- [AC-AISVC-100] GET /admin/monitoring/prompt-templates - Prompt template usage statistics

Frontend Components:
- [AC-ASA-53] IntentRuleTestDialog - Test dialog for intent rules
- [AC-ASA-54/55] IntentRules monitoring page with hit records drawer
- [AC-ASA-56/57] PromptTemplatePreviewDialog with variable editing
- [AC-ASA-58] PromptTemplates monitoring page with scene breakdown

New files:
- ai-service/app/services/intent/tester.py
- ai-service/app/services/monitoring/intent_monitor.py
- ai-service/app/services/monitoring/prompt_monitor.py
- ai-service/app/api/admin/monitoring.py
- ai-service-admin/src/views/admin/intent-rule/components/TestDialog.vue
- ai-service-admin/src/views/admin/monitoring/IntentRules.vue
- ai-service-admin/src/views/admin/monitoring/PromptTemplates.vue
- ai-service-admin/src/views/admin/prompt-template/components/PreviewDialog.vue
2026-02-27 23:15:46 +08:00
MerCry c005066162 feat(v0.7.0-window2): implement flow simulation and guardrail testing/monitoring
Refs: AC-AISVC-101, AC-AISVC-102, AC-AISVC-103, AC-AISVC-104, AC-AISVC-105, AC-AISVC-106, AC-AISVC-107
Refs: AC-ASA-59, AC-ASA-60, AC-ASA-61, AC-ASA-62, AC-ASA-63, AC-ASA-64

Backend changes:
- New: ai-service/app/services/flow/tester.py (ScriptFlowTester)
- New: ai-service/app/services/guardrail/tester.py (GuardrailTester)
- New: ai-service/app/services/monitoring/flow_monitor.py (FlowMonitor)
- New: ai-service/app/services/monitoring/guardrail_monitor.py (GuardrailMonitor)
- Modified: ai-service/app/api/admin/script_flows.py (add POST /{flowId}/simulate)
- Modified: ai-service/app/api/admin/guardrails.py (add POST /test)
- Modified: ai-service/app/api/admin/monitoring.py (add flow/guardrail stats endpoints)

Frontend changes:
- New: SimulateDialog.vue (flow simulation dialog)
- New: TestDialog.vue (guardrail test dialog)
- New: ScriptFlows.vue (flow monitoring page)
- New: Guardrails.vue (guardrail monitoring page)
- Extended: API services (monitoring.ts, script-flow.ts, guardrail.ts)
- Updated: Router with new monitoring routes
2026-02-27 23:13:45 +08:00
MerCry e4dbcda150 fix(AISVC): 修复 knowledge-bases 接口 500 错误 [AC-AISVC-60]
- 添加 KnowledgeBaseService 服务类用于知识库 CRUD 操作
- 添加数据库迁移脚本,补充 knowledge_bases 表缺失字段
  - kb_type: 知识库类型
  - priority: 优先级
  - is_enabled: 是否启用
  - doc_count: 文档数量
- 修复前端 intent-rules 页面加载时知识库接口报错问题
2026-02-27 21:37:48 +08:00
MerCry 8c259cee30 feat: implement output guardrail with forbidden word detection and behavior rules [AC-AISVC-78~AC-AISVC-85] 2026-02-27 16:40:02 +08:00
MerCry 9d8ecf0bb2 feat: 实现话术流程引擎 (Phase 13 T13.1-T13.6) [AC-AISVC-71~AC-AISVC-76]
- 新增 ScriptFlow 和 FlowInstance SQLModel 实体
- 实现 ScriptFlowService:流程定义 CRUD、步骤校验
- 实现 FlowEngine 状态机引擎:check_active_flow、start、advance、handle_timeout
- 实现话术流程管理 API(POST/GET/PUT /admin/script-flows)
- T13.7(单元测试)留待集成阶段
2026-02-27 15:27:02 +08:00
MerCry ff35538a01 feat(ai-service): implement intent recognition and rule engine (Phase 12 T12.1-T12.5)
[AC-AISVC-65~AC-AISVC-70] Intent recognition with keyword and regex matching

- Add IntentRule SQLModel entity with tenant isolation
- Implement IntentRuleService for CRUD operations with hit statistics
- Implement IntentRouter matching engine (priority DESC, keyword then regex)
- Add rule caching by tenant_id with TTL=60s and CRUD invalidation
- Add intent rules management API (POST/GET/PUT/DELETE /admin/intent-rules)
- Support four response types: fixed/rag/flow/transfer

T12.6 (Orchestrator integration) and T12.7 (unit tests) pending for integration phase
2026-02-27 14:20:31 +08:00
MerCry eb93636227 feat: 实现 Prompt 模板化功能 (Phase 10 T10.1-T10.8) [AC-AISVC-51~AC-AISVC-58]
- 新增 PromptTemplate 和 PromptTemplateVersion SQLModel 实体
- 实现 PromptTemplateService:模板 CRUD、版本管理、发布/回滚、缓存
- 实现 VariableResolver:内置变量注入和自定义变量替换
- 实现 Prompt 模板管理 API(CRUD + 发布/回滚)
- T10.9(修改 Orchestrator)和 T10.10(单元测试)留待集成阶段
2026-02-27 14:15:10 +08:00
MerCry a9d1079294 fix: 修复编排器使用错误的LLM配置问题 [AC-AISVC-50]
- 移除编排器中硬编码的LLMConfig创建
- 让LLM客户端使用自己的默认配置(从LLMConfigManager获取)
- 修复流式生成方法同样的问题
2026-02-26 19:58:55 +08:00
MerCry f81d18a517 feat: 添加LLM配置持久化功能 [AC-AISVC-50]
- LLM配置保存到 config/llm_config.json 文件
- 服务重启后自动加载已保存的配置
- 与嵌入模型配置保持一致的持久化机制
2026-02-26 19:30:26 +08:00
MerCry d660c19ab9 feat: 添加嵌入配置持久化及模型切换警告 [AC-AISVC-50]
- 添加嵌入配置持久化到config/embedding_config.json
- 服务启动时自动加载保存的配置
- 切换模型时前端显示警告提示需要重新上传文档
- 修复OptimizedRetriever缓存问题,每次检索获取最新配置
- 清理调试用的Python临时文件
- 更新.gitignore忽略config目录
2026-02-26 18:01:03 +08:00
MerCry fd04ed2cef fix: 修复RAG检索多个问题并更新嵌入模型配置 [AC-AISVC-50]
主要修复:
1. 修复ConfigForm和EmbeddingConfigForm组件watch死循环导致内存溢出
2. 修复向量存储格式与检索格式不匹配问题
3. 修复两阶段检索和混合检索互斥问题
4. 修复RRF融合时vector字段丢失问题
5. 修复embedding_full未归一化导致相似度计算错误
6. 修复嵌入模型配置表单不显示参数问题

功能增强:
- 添加with_vectors参数支持返回向量用于重排序
- 新增两阶段+混合检索组合策略
- 更新README嵌入模型配置说明,推荐nomic-embed-text-v2-moe
- 添加cleanup_qdrant.py脚本用于清理向量数据
2026-02-26 14:45:21 +08:00
MerCry 97e7fd0992 feat: 添加API Key认证系统和修复Qdrant搜索问题 [AC-AISVC-50]
- 新增 API Key 数据库模型和服务
- 新增 ApiKeyMiddleware 认证中间件
- 新增 /admin/api-keys 管理接口
- 前端支持 VITE_APP_API_KEY 环境变量
- 修复 optimized_retriever.py 中 Qdrant 搜索调用方式
- 更新 Dockerfile 支持构建时传入 API Key
- 更新 docker-compose.yaml 支持前端 API Key 配置
2026-02-26 03:11:36 +08:00
MerCry ee2c7c0d0c feat: 添加API Key认证功能 [AC-AISVC-50]
- 新增 ApiKey 模型和数据库表
- 新增 ApiKeyService 服务,支持内存缓存验证
- 新增 ApiKeyMiddleware 中间件,验证所有请求
- 应用启动时自动创建默认 API Key
- 新增 /admin/api-keys 管理接口
2026-02-26 02:52:50 +08:00
MerCry f631f1dea0 feat: 统一提示词模板并添加全量提示词日志 [AC-AISVC-02, AC-ASA-19, AC-ASA-20]
PR Check (SDD Full Gate) / sdd-full-gate (pull_request) Successful in 2s Details
- 新增 prompts.py 集中管理系统提示词和证据格式化
- orchestrator.py 添加全量提示词日志打印
- openai_client.py 添加全量提示词日志打印(支持普通和流式)
- rag.py 重构使用统一的提示词模板
2026-02-26 01:12:01 +08:00
MerCry dd74ae2585 feat: 切换到优化检索器并增强编排日志 [AC-AISVC-02, AC-AISVC-16] 2026-02-25 23:45:34 +08:00
MerCry 02f03a3a12 feat: RAG 配置优化与检索日志增强 [AC-AISVC-16, AC-AISVC-17] 2026-02-25 23:42:31 +08:00
MerCry cee884d9a0 feat: RAG 检索优化,实现多维度向量存储和 Nomic 嵌入提供者 [AC-AISVC-16, AC-AISVC-29] 2026-02-25 23:10:12 +08:00
MerCry 774744d534 feat: 文档索引优化,支持多编码解码和按行分块 [AC-AISVC-21, AC-AISVC-22] 2026-02-25 23:09:24 +08:00