MerCry
/
ai-robot-core
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
ai-robot-core/docs/progress/ai-service-progress.md

136 lines
4.9 KiB
Markdown
Raw Normal View History

feat(ai-service): implement SSE event generator for message events [AC-AISVC-07] - Optimize Orchestrator streaming output with LLM client integration - Implement _stream_from_llm() to wrap LLM chunks as message events - Implement _stream_mock_response() for demo/testing - Add SSE event format tests (message/final/error) - Fix by_alias=True for final event JSON output - 79 tests passing
2026-02-24 05:28:10 +00:00
# ai-service - Progress
---
## 📋 Context
- module: `ai-service`
- feature: `AISVC` (Python AI 中台)
docs: 更新 progress 文档，记录 Phase 9 完成状态 [AC-AISVC-10]
2026-02-25 15:44:28 +00:00
- status: ✅ 已完成
feat(ai-service): implement SSE event generator for message events [AC-AISVC-07] - Optimize Orchestrator streaming output with LLM client integration - Implement _stream_from_llm() to wrap LLM chunks as message events - Implement _stream_mock_response() for demo/testing - Add SSE event format tests (message/final/error) - Fix by_alias=True for final event JSON output - 79 tests passing
2026-02-24 05:28:10 +00:00
---
## 🔗 Spec References (SSOT)
- agents: `agents.md`
- contracting: `spec/contracting.md`
- requirements: `spec/ai-service/requirements.md`
- openapi_provider: `spec/ai-service/openapi.provider.yaml`
- design: `spec/ai-service/design.md`
- tasks: `spec/ai-service/tasks.md`
---
## 📊 Overall Progress (Phases)
- [x] Phase 1: 基础设施（FastAPI 框架与多租户基础） (100%) ✅
- [x] Phase 2: 存储与检索实现（Memory & Retrieval） (100%) ✅
feat(ai-service): add contract validation tests for T3.5 [AC-AISVC-02] - Verify ChatResponse fields match OpenAPI contract - Test required fields: reply, confidence, shouldTransfer - Test optional fields: transferReason, metadata - Test JSON serialization uses camelCase (by_alias=True) - Test confidence range validation [0.0, 1.0] - Test ChatRequest contract compliance - Test ErrorResponse contract compliance - Test SSEFinalEvent matches ChatResponse structure - Test SSEErrorEvent matches ErrorResponse structure - Add end-to-end contract validation with OrchestratorService - All 184 tests passing
2026-02-24 05:55:17 +00:00
- [x] Phase 3: 核心编排（Orchestrator & LLM Adapter） (100%) ✅
docs: 更新 progress 文档，记录 Phase 9 完成状态 [AC-AISVC-10]
2026-02-25 15:44:28 +00:00
- [x] Phase 4: 流式响应（SSE 实现与状态机） (100%) ✅
- [x] Phase 5: 集成与冒烟测试（Quality Assurance） (100%) ✅
- [x] Phase 6: 前后端联调真实对接 (100%) ✅
- [x] Phase 7: 嵌入模型可插拔与文档解析 (100%) ✅
- [x] Phase 8: LLM 配置与 RAG 调试输出 (100%) ✅
- [x] Phase 9: 租户管理与 RAG 优化 (100%) ✅
feat(ai-service): implement SSE event generator for message events [AC-AISVC-07] - Optimize Orchestrator streaming output with LLM client integration - Implement _stream_from_llm() to wrap LLM chunks as message events - Implement _stream_mock_response() for demo/testing - Add SSE event format tests (message/final/error) - Fix by_alias=True for final event JSON output - 79 tests passing
2026-02-24 05:28:10 +00:00
---
## 🔄 Current Phase
### Goal
docs: 更新 progress 文档，记录 Phase 9 完成状态 [AC-AISVC-10]
2026-02-25 15:44:28 +00:00
Phase 9 已完成！项目进入稳定迭代阶段。
feat(ai-service): implement SSE event generator for message events [AC-AISVC-07] - Optimize Orchestrator streaming output with LLM client integration - Implement _stream_from_llm() to wrap LLM chunks as message events - Implement _stream_mock_response() for demo/testing - Add SSE event format tests (message/final/error) - Fix by_alias=True for final event JSON output - 79 tests passing
2026-02-24 05:28:10 +00:00
docs: 更新 progress 文档，记录 Phase 9 完成状态 [AC-AISVC-10]
2026-02-25 15:44:28 +00:00
### Completed Tasks (Phase 9)
feat(ai-service): implement SSE event generator for message events [AC-AISVC-07] - Optimize Orchestrator streaming output with LLM client integration - Implement _stream_from_llm() to wrap LLM chunks as message events - Implement _stream_mock_response() for demo/testing - Add SSE event format tests (message/final/error) - Fix by_alias=True for final event JSON output - 79 tests passing
2026-02-24 05:28:10 +00:00
docs: 更新 progress 文档，记录 Phase 9 完成状态 [AC-AISVC-10]
2026-02-25 15:44:28 +00:00
- [x] T9.1 实现 `Tenant` 实体：定义租户数据模型 `[AC-AISVC-10]` ✅
- [x] T9.2 实现租户 ID 格式校验：`name@ash@year` 格式验证 `[AC-AISVC-10, AC-AISVC-12]` ✅
- [x] T9.3 实现租户自动创建：请求时自动创建不存在的租户 `[AC-AISVC-10]` ✅
- [x] T9.4 实现 `GET /admin/tenants` API：返回租户列表 `[AC-AISVC-10]` ✅
- [x] T9.5 前端租户选择器：实现租户切换功能 `[AC-ASA-01]` ✅
- [x] T9.6 文档多编码支持：支持 UTF-8、GBK、GB2312 等编码解码 `[AC-AISVC-21]` ✅
- [x] T9.7 按行分块功能：实现 `chunk_text_by_lines` 函数 `[AC-AISVC-22]` ✅
- [x] T9.8 实现 `NomicEmbeddingProvider`：支持多维度向量 `[AC-AISVC-29]` ✅
- [x] T9.9 实现多向量存储：支持 full/256/512 三种维度 `[AC-AISVC-16]` ✅
- [x] T9.10 实现 `KnowledgeIndexer`：优化的知识库索引服务 `[AC-AISVC-22]` ✅
feat(ai-service): implement SSE event generator for message events [AC-AISVC-07] - Optimize Orchestrator streaming output with LLM client integration - Implement _stream_from_llm() to wrap LLM chunks as message events - Implement _stream_mock_response() for demo/testing - Add SSE event format tests (message/final/error) - Fix by_alias=True for final event JSON output - 79 tests passing
2026-02-24 05:28:10 +00:00
---
## 🏗️ Technical Context
### Module Structure
- `ai-service/`
- `app/`
- `api/` - FastAPI 路由层
docs: 更新 progress 文档，记录 Phase 9 完成状态 [AC-AISVC-10]
2026-02-25 15:44:28 +00:00
- `admin/tenants.py` - 租户管理 API ✅
feat(ai-service): implement SSE event generator for message events [AC-AISVC-07] - Optimize Orchestrator streaming output with LLM client integration - Implement _stream_from_llm() to wrap LLM chunks as message events - Implement _stream_mock_response() for demo/testing - Add SSE event format tests (message/final/error) - Fix by_alias=True for final event JSON output - 79 tests passing
2026-02-24 05:28:10 +00:00
- `core/` - 配置、异常、中间件、SSE
docs: 更新 progress 文档，记录 Phase 9 完成状态 [AC-AISVC-10]
2026-02-25 15:44:28 +00:00
- `middleware.py` - 租户 ID 格式校验与自动创建 ✅
feat(ai-service): implement SSE event generator for message events [AC-AISVC-07] - Optimize Orchestrator streaming output with LLM client integration - Implement _stream_from_llm() to wrap LLM chunks as message events - Implement _stream_mock_response() for demo/testing - Add SSE event format tests (message/final/error) - Fix by_alias=True for final event JSON output - 79 tests passing
2026-02-24 05:28:10 +00:00
- `models/` - Pydantic 模型和 SQLModel 实体
docs: 更新 progress 文档，记录 Phase 9 完成状态 [AC-AISVC-10]
2026-02-25 15:44:28 +00:00
- `entities.py` - Tenant 实体 ✅
feat(ai-service): implement SSE event generator for message events [AC-AISVC-07] - Optimize Orchestrator streaming output with LLM client integration - Implement _stream_from_llm() to wrap LLM chunks as message events - Implement _stream_mock_response() for demo/testing - Add SSE event format tests (message/final/error) - Fix by_alias=True for final event JSON output - 79 tests passing
2026-02-24 05:28:10 +00:00
- `services/`
docs: 更新 progress 文档，记录 Phase 9 完成状态 [AC-AISVC-10]
2026-02-25 15:44:28 +00:00
- `embedding/nomic_provider.py` - Nomic 嵌入提供者 ✅
feat(ai-service): implement SSE event generator for message events [AC-AISVC-07] - Optimize Orchestrator streaming output with LLM client integration - Implement _stream_from_llm() to wrap LLM chunks as message events - Implement _stream_mock_response() for demo/testing - Add SSE event format tests (message/final/error) - Fix by_alias=True for final event JSON output - 79 tests passing
2026-02-24 05:28:10 +00:00
- `retrieval/` - 检索层
docs: 更新 progress 文档，记录 Phase 9 完成状态 [AC-AISVC-10]
2026-02-25 15:44:28 +00:00
- `indexer.py` - 知识库索引服务 ✅
- `metadata.py` - 元数据模型 ✅
- `optimized_retriever.py` - 优化检索器 ✅
- `tests/` - 单元测试
feat(ai-service): implement SSE event generator for message events [AC-AISVC-07] - Optimize Orchestrator streaming output with LLM client integration - Implement _stream_from_llm() to wrap LLM chunks as message events - Implement _stream_mock_response() for demo/testing - Add SSE event format tests (message/final/error) - Fix by_alias=True for final event JSON output - 79 tests passing
2026-02-24 05:28:10 +00:00
### Key Decisions (Why / Impact)
docs: 更新 progress 文档，记录 Phase 9 完成状态 [AC-AISVC-10]
2026-02-25 15:44:28 +00:00
- decision: 租户 ID 格式采用 `name@ash@year` 格式
reason: 便于解析和展示租户信息
impact: 中间件自动校验格式并解析
feat(ai-service): implement SSE event generator for message events [AC-AISVC-07] - Optimize Orchestrator streaming output with LLM client integration - Implement _stream_from_llm() to wrap LLM chunks as message events - Implement _stream_mock_response() for demo/testing - Add SSE event format tests (message/final/error) - Fix by_alias=True for final event JSON output - 79 tests passing
2026-02-24 05:28:10 +00:00
docs: 更新 progress 文档，记录 Phase 9 完成状态 [AC-AISVC-10]
2026-02-25 15:44:28 +00:00
- decision: 租户自动创建策略
reason: 简化租户管理流程，无需预先创建
impact: 首次请求时自动创建租户记录
feat(ai-service): implement complete Orchestrator generation pipeline for T3.4 [AC-AISVC-01, AC-AISVC-02] - Integrate Memory, ContextMerger, Retriever, LLMClient, ConfidenceCalculator - Implement 8-step generation pipeline: 1. Load local history from Memory 2. Merge with external history (dedup + truncate) 3. RAG retrieval (optional) 4. Build prompt with context and evidence 5. LLM generation 6. Calculate confidence 7. Save messages to Memory 8. Return ChatResponse - Add GenerationContext dataclass for tracking intermediate results - Implement fallback response mechanism for error handling - Add 21 unit tests for OrchestratorService - All 138 tests passing
2026-02-24 05:47:12 +00:00
docs: 更新 progress 文档，记录 Phase 9 完成状态 [AC-AISVC-10]
2026-02-25 15:44:28 +00:00
- decision: 多维度向量存储（full/256/512）
reason: 支持不同检索场景的性能优化
impact: Qdrant 使用 named vector 存储
feat(ai-service): implement complete Orchestrator generation pipeline for T3.4 [AC-AISVC-01, AC-AISVC-02] - Integrate Memory, ContextMerger, Retriever, LLMClient, ConfidenceCalculator - Implement 8-step generation pipeline: 1. Load local history from Memory 2. Merge with external history (dedup + truncate) 3. RAG retrieval (optional) 4. Build prompt with context and evidence 5. LLM generation 6. Calculate confidence 7. Save messages to Memory 8. Return ChatResponse - Add GenerationContext dataclass for tracking intermediate results - Implement fallback response mechanism for error handling - Add 21 unit tests for OrchestratorService - All 138 tests passing
2026-02-24 05:47:12 +00:00
docs: 更新 progress 文档，记录 Phase 9 完成状态 [AC-AISVC-10]
2026-02-25 15:44:28 +00:00
- decision: 文档多编码支持
reason: 兼容中文文档的各种编码格式
impact: 按优先级尝试多种编码解码
feat(ai-service): implement SSE event generator for message events [AC-AISVC-07] - Optimize Orchestrator streaming output with LLM client integration - Implement _stream_from_llm() to wrap LLM chunks as message events - Implement _stream_mock_response() for demo/testing - Add SSE event format tests (message/final/error) - Fix by_alias=True for final event JSON output - 79 tests passing
2026-02-24 05:28:10 +00:00
---
## 🧾 Session History
docs: 更新 progress 文档，记录 Phase 9 完成状态 [AC-AISVC-10]
2026-02-25 15:44:28 +00:00
### Session #6 (2026-02-25)
feat(ai-service): add contract validation tests for T3.5 [AC-AISVC-02] - Verify ChatResponse fields match OpenAPI contract - Test required fields: reply, confidence, shouldTransfer - Test optional fields: transferReason, metadata - Test JSON serialization uses camelCase (by_alias=True) - Test confidence range validation [0.0, 1.0] - Test ChatRequest contract compliance - Test ErrorResponse contract compliance - Test SSEFinalEvent matches ChatResponse structure - Test SSEErrorEvent matches ErrorResponse structure - Add end-to-end contract validation with OrchestratorService - All 184 tests passing
2026-02-24 05:55:17 +00:00
- completed:
docs: 更新 progress 文档，记录 Phase 9 完成状态 [AC-AISVC-10]
2026-02-25 15:44:28 +00:00
- T9.1-T9.10 租户管理与 RAG 优化功能
- 实现 Tenant 实体和租户管理 API
- 实现租户 ID 格式校验与自动创建
- 实现前端租户选择器
- 实现文档多编码支持
- 实现按行分块功能
- 实现 NomicEmbeddingProvider
- 实现多维度向量存储
- 实现 KnowledgeIndexer
feat(ai-service): add contract validation tests for T3.5 [AC-AISVC-02] - Verify ChatResponse fields match OpenAPI contract - Test required fields: reply, confidence, shouldTransfer - Test optional fields: transferReason, metadata - Test JSON serialization uses camelCase (by_alias=True) - Test confidence range validation [0.0, 1.0] - Test ChatRequest contract compliance - Test ErrorResponse contract compliance - Test SSEFinalEvent matches ChatResponse structure - Test SSEErrorEvent matches ErrorResponse structure - Add end-to-end contract validation with OrchestratorService - All 184 tests passing
2026-02-24 05:55:17 +00:00
- changes:
docs: 更新 progress 文档，记录 Phase 9 完成状态 [AC-AISVC-10]
2026-02-25 15:44:28 +00:00
- 新增 `app/models/entities.py` Tenant 实体
- 更新 `app/core/middleware.py` 租户校验逻辑
- 新增 `app/api/admin/tenants.py` 租户管理 API
- 新增 `ai-service-admin/src/api/tenant.ts` 前端 API
- 更新 `ai-service-admin/src/App.vue` 租户选择器
- 更新 `ai-service/app/api/admin/kb.py` 多编码支持
- 新增 `app/services/embedding/nomic_provider.py`
- 新增 `app/services/retrieval/indexer.py`
- 新增 `app/services/retrieval/metadata.py`
- 新增 `app/services/retrieval/optimized_retriever.py`
- commits:
- `docs: 更新任务清单，添加 Phase 9 租户管理与 RAG 优化任务 [AC-AISVC-10, AC-ASA-01]`
- `feat: 实现租户管理功能，支持租户ID格式校验与自动创建 [AC-AISVC-10, AC-AISVC-12, AC-ASA-01]`
- `feat: 文档索引优化，支持多编码解码和按行分块 [AC-AISVC-21, AC-AISVC-22]`
- `feat: RAG 检索优化，实现多维度向量存储和 Nomic 嵌入提供者 [AC-AISVC-16, AC-AISVC-29]`
- `feat: RAG 配置优化与检索日志增强 [AC-AISVC-16, AC-AISVC-17]`
feat(ai-service): add contract validation tests for T3.5 [AC-AISVC-02] - Verify ChatResponse fields match OpenAPI contract - Test required fields: reply, confidence, shouldTransfer - Test optional fields: transferReason, metadata - Test JSON serialization uses camelCase (by_alias=True) - Test confidence range validation [0.0, 1.0] - Test ChatRequest contract compliance - Test ErrorResponse contract compliance - Test SSEFinalEvent matches ChatResponse structure - Test SSEErrorEvent matches ErrorResponse structure - Add end-to-end contract validation with OrchestratorService - All 184 tests passing
2026-02-24 05:55:17 +00:00
feat(ai-service): implement SSE event generator for message events [AC-AISVC-07] - Optimize Orchestrator streaming output with LLM client integration - Implement _stream_from_llm() to wrap LLM chunks as message events - Implement _stream_mock_response() for demo/testing - Add SSE event format tests (message/final/error) - Fix by_alias=True for final event JSON output - 79 tests passing
2026-02-24 05:28:10 +00:00
---
## 🚀 Startup Guide
1. 读取本进度文档，定位当前 Phase 与 Next Action。
2. 打开并阅读 Spec References 指向的模块规范。
3. 直接执行 Next Action；遇到缺口先更新 spec 再编码。