feat(admin): Add user management and upgrade to module permission system

Features - User Management (Phase 4.1):
- Database: Add user_modules table for fine-grained module permissions
- Database: Add 4 user permissions (view/create/edit/delete) to role_permissions
- Backend: UserService (780 lines) - CRUD with tenant isolation
- Backend: UserController + UserRoutes (648 lines) - 13 API endpoints
- Backend: Batch import users from Excel
- Frontend: UserListPage (412 lines) - list/filter/search/pagination
- Frontend: UserFormPage (341 lines) - create/edit with module config
- Frontend: UserDetailPage (393 lines) - details/tenant/module management
- Frontend: 3 modal components (592 lines) - import/assign/configure
- API: GET/POST/PUT/DELETE /api/admin/users/* endpoints

Architecture Upgrade - Module Permission System:
- Backend: Add getUserModules() method in auth.service
- Backend: Login API returns modules array in user object
- Frontend: AuthContext adds hasModule() method
- Frontend: Navigation filters modules based on user.modules
- Frontend: RouteGuard checks requiredModule instead of requiredVersion
- Frontend: Remove deprecated version-based permission system
- UX: Only show accessible modules in navigation (clean UI)
- UX: Smart redirect after login (avoid 403 for regular users)

Fixes:
- Fix UTF-8 encoding corruption in ~100 docs files
- Fix pageSize type conversion in userService (String to Number)
- Fix authUser undefined error in TopNavigation
- Fix login redirect logic with role-based access check
- Update Git commit guidelines v1.2 with UTF-8 safety rules

Database Changes:
- CREATE TABLE user_modules (user_id, tenant_id, module_code, is_enabled)
- ADD UNIQUE CONSTRAINT (user_id, tenant_id, module_code)
- INSERT 4 permissions + role assignments
- UPDATE PUBLIC tenant with 8 module subscriptions

Technical:
- Backend: 5 new files (~2400 lines)
- Frontend: 10 new files (~2500 lines)
- Docs: 1 development record + 2 status updates + 1 guideline update
- Total: ~4900 lines of code

Status: User management 100% complete, module permission system operational
This commit is contained in:
2026-01-16 13:42:10 +08:00
parent 98d862dbd4
commit 66255368b7
560 changed files with 70424 additions and 52353 deletions

View File

@@ -1,10 +1,11 @@
# <EFBFBD>唳旿摨栞挽霈⊥<EFBFBD>獢?- 撌亙<E6928C>B嚗<42><E59A97><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>箏膥鈭綽<E988AD>
# 数据库设计文档 - 工具B病历结构化机器人
> **模块**: DC数据清洗整理 - 工具B
> **版本**: V2.0 (MVP)
> **Schema**: `dc_schema`
> **更新日期**: 2025-12-03
> **<EFBFBD><EFBFBD>?*: <EFBFBD>?MVP摰峕<EFBFBD><EFBFBD>歇撉諹<EFBFBD><EFBFBD>舐鍂嚗𣬚<EFBFBD>摰墧㺭<EFBFBD><EFBFBD>霂閖<EFBFBD><EFBFBD>嚗?
> **状态**: MVP完成(已验证可用,真实数据测试通过)
---
## 📋 目录
@@ -12,37 +13,49 @@
- [一、概述](#一概述)
- [二、Schema设计原则](#二schema设计原则)
- [三、数据表设计](#三数据表设计)
- [<EFBFBD><EFBFBD><EFBFBD>揣撘閗挽霈(#<23>𤤿揣撘閗挽霈?
- [鈭𢛵<EFBFBD><EFBFBD><EFBFBD><EFBFBD>桃漲<EFBFBD>篏(#鈭𥪜<EFBFBD><EFBFBD>桃漲<EFBFBD>?
- [<EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>賢𪂹<EFBFBD>篏(#<23>剜㺭<E5899C><EFBFBD><E6A183>賢𪂹<E8B3A2>?
- [四、索引设计](#四索引设计)
- [五、外键约束](#五外键约束)
- [六、数据生命周期](#六数据生命周期)
---
## <EFBFBD><EFBFBD><EFBFBD><EFBFBD>餈?
## 一、概述
### 1.1 设计目标
撌亙<EFBFBD>B<EFBFBD><EFBFBD><EFBFBD><EFBFBD>霈曇恣<EFBFBD>典銁<EFBFBD><EFBFBD>嚗?- <20>?<3F><>之璅<E79285>鈭文<E988AD>撉諹<E69289><E8ABB9><EFBFBD><EFBFBD><EFBFBD><EFBFBD><E7A589><EFBFBD><EFBFBD>
- <EFBFBD>?憭扯<E686AD><E79285>甇乩遙<E4B9A9><EFBFBD><E288AA><EFBFBD><EFBFBD>1000+<2B>∟扇敶𤏪<E695B6>
- <EFBFBD>?<3F><EFBFBD><EFBFBD>瘚衤<E7989A>鈭箏極鋆<E6A5B5><E98B86>
- <EFBFBD>?憸<>挽璅⊥踎蝞∠<E89D9E>銝𤾸<E98A9D><F0A4BEB8>?- <20>?<3F>亙熒璉<E78692><E79289><EFBFBD>摮䀝<E691AE><E4809D>?
工具B的数据库设计旨在支持
- ✅ 双大模型交叉验证的文本结构化
- ✅ 大规模异步任务处理1000+条记录)
- ✅ 冲突检测与人工裁决
- ✅ 预设模板管理与复用
- ✅ 健康检查缓存优化
### 1.2 表关系总览
```
dc_schema <EFBFBD>?撌脣<E6928C>撱箏僎餈鞱<E9A488>銝?<3F><EFBFBD><E98EBF><EFBFBD> dc_health_checks [<5B>亙熒璉<E78692><E79289><EFBFBD>摮𤊓 <20>?餈鞱<E9A488><EFBFBD>
<EFBFBD><EFBFBD><EFBFBD><EFBFBD> dc_templates [憸<>挽璅⊥踎] <20>?3銝芷<E98A9D>霈暹芋<E69AB9>踹虾<E8B8B9>?<3F><EFBFBD><E98EBF><EFBFBD> dc_extraction_tasks [<5B>𣂼<EFBFBD>隞餃𦛚] <20>?撌脣<E6928C><E884A3>𣂼<EFBFBD>銝芯遙<E88AAF>?<3F>? <20><EFBFBD><E5A999><EFBFBD> dc_extraction_items [<5B>𣂼<EFBFBD>霈啣<E99C88>] (1:N) <20>?<3F>峕芋<E5B395><EFBFBD><E8AEA0>𨀣迤撣訾<E692A3>摮?```
dc_schema ✅ 已创建并运行中
├── dc_health_checks [健康检查缓存] ✅ 运行正常
├── dc_templates [预设模板] ✅ 3个预设模板可用
├── dc_extraction_tasks [提取任务] ✅ 已完成多个任务
│ └── dc_extraction_items [提取记录] (1:N) ✅ 双模型结果正常保存
```
**<2A>?MVP摰峕<E691B0><E5B395><EFBFBD><E59786><EFBFBD>2025-12-03嚗?*嚗?- <20><><EFBFBD>㕑”甇<E2809D>虜撌乩<E6928C><EFBFBD>歇憭<E6AD87><E686AD>憭帋葵<E5B88B><EFBFBD>隞餃𦛚
- 3銝芷<E98A9D>霈暹芋<E69AB9><EFBFBD><E981B8><EFBFBD><E7AE87><EFBFBD><EFBFBD><EFBFBD><EFBFBD><E4BA99><EFBFBD><EFBFBD>撠輻<E692A0><E8BCBB>仿堺霈啣<E99C88><E595A3><EFBFBD><EFBFBD><EFBFBD><E98AB5>钅秄霂羓<E99C82><E7BE93>?- <20><EFBFBD>瘚贝<E7989A>嚗?<3F><EFBFBD><E288A0><EFBFBD><EFBFBD><EFBFBD><E6A0BC>𡝗<EFBFBD><F0A19D97><EFBFBD><EFBFBD>100%<25>𣂼<EFBFBD><F0A382BC>?- <20>峕芋<E5B395><EFBFBD><E8AEA0><EFBFBD>resultA<74><41>esultB<74><42>inalResult摮埈挾甇<E68CBE>虜靽嘥<E99DBD>
**✅ MVP完成状态2025-12-03**
- 所有表正常工作,已处理多个真实任务
- 3个预设模板肺癌病理报告、糖尿病入院记录、高血压门诊病历
- 真实测试9条病理数据提取成功100%成功率
- 双模型结果resultA、resultB、finalResult字段正常保存
- Token统计totalTokens字段正常累加
- 冲突检测conflictFields数组正常工作
- 验证脚本:`backend/scripts/check-task-progress.mjs`
### 1.3 技术栈
- **<2A>唳旿摨?*: PostgreSQL 15
- **数据库**: PostgreSQL 15
- **ORM**: Prisma 6
- **Schema隔离**: `dc_schema`(独立命名空间)
- **JSON摮埈挾**: 雿輻鍂JSONB蝐餃<EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>亥砭嚗?
- **JSON字段**: 使用JSONB类型(高性能查询)
---
## 二、Schema设计原则
@@ -55,9 +68,10 @@ CREATE TABLE "dc_schema"."dc_health_checks" (...);
CREATE TABLE "dc_schema"."dc_extraction_tasks" (...);
```
**隡睃飵**嚗?- <20>?銝𤾸<E98A9D>隞𡝗芋<F0A19D97><EFBFBD><E5A092><EFBFBD>蝳鳴<E89DB3>platform_schema<6D><61>sl_schema蝑㚁<E89D91>
- <EFBFBD>?<3F>唳旿摰匧<E691B0>嚗屸<E59A97><E5B1B8>滩秤<E6BBA9><EFBFBD>
- <EFBFBD>?靘蹂<E99D98><E79285><E288AA>𣇉恣<F0A38789><E681A3><EFBFBD><EFBFBD>
**优势**
- ✅ 与其他模块完全隔离platform_schema、asl_schema等
- ✅ 数据安全,避免误操作
- ✅ 便于模块化管理和迁移
### 2.2 命名规范
@@ -65,23 +79,24 @@ CREATE TABLE "dc_schema"."dc_extraction_tasks" (...);
|------|------|------|
| **表名前缀** | `dc_` | `dc_extraction_tasks` |
| **字段命名** | snake_case | `user_id`, `source_file_key` |
| **<EFBFBD>園𡢿<EFBFBD>?* | 蝏煺<E89D8F><E785BA>𡒊<EFBFBD> | `created_at`, `started_at` |
| **时间戳** | 统一后缀 | `created_at`, `started_at` |
| **外键** | 实体名_id | `task_id`, `user_id` |
### 2.3 JSONB字段使用场景
| 字段 | 类型 | 原因 |
|------|------|------|
| `target_fields` | JSONB | <EFBFBD>菜暑<EFBFBD><EFBFBD><EFBFBD>畾菟<EFBFBD>蝵?|
| `result_a/result_b` | JSONB | <EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>𣇉<EFBFBD><EFBFBD>?|
| `final_result` | JSONB | <EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>?|
| `target_fields` | JSONB | 灵活的字段配置 |
| `result_a/result_b` | JSONB | 动态提取结果 |
| `final_result` | JSONB | 最终裁决结果 |
---
## 三、数据表设计
### 3.1 dc_health_checks<EFBFBD><EFBFBD>摨瑟<EFBFBD><EFBFBD><EFBFBD>摮䁅”嚗?
**<2A><EFBFBD>?*: 蝻枏<E89DBB><E69E8F>亙熒璉<E78692><E79289><EFBFBD><E4BAA6><EFBFBD><E9A0A3><EFBFBD><E8B8B9><EFBFBD>霈∠<E99C88>
### 3.1 dc_health_checks(健康检查缓存表)
**用途**: 缓存健康检查结果,避免重复计算
```sql
CREATE TABLE "dc_schema"."dc_health_checks" (
@@ -96,39 +111,46 @@ CREATE TABLE "dc_schema"."dc_health_checks" (
"total_rows" INTEGER NOT NULL,
"estimated_tokens" INTEGER NOT NULL,
-- <EFBFBD><EFBFBD><EFBFBD><EFBFBD>? "status" TEXT NOT NULL, -- 'good' | 'bad'
-- 检查结果
"status" TEXT NOT NULL, -- 'good' | 'bad'
"message" TEXT NOT NULL,
"created_at" TIMESTAMP(3) NOT NULL DEFAULT CURRENT_TIMESTAMP
);
```
**摮埈挾霂湔<EFBFBD>**嚗?
**字段说明**
| 字段 | 类型 | 说明 | 示例 |
|------|------|------|------|
| `id` | TEXT | UUID主键 | `uuid()` |
| `user_id` | TEXT | 用户ID | `user-123` |
| `file_name` | TEXT | <EFBFBD><EFBFBD><EFBFBD>?| `<60><><EFBFBD><EFBFBD><EFBFBD>?xlsx` |
| `file_name` | TEXT | 文件名 | `患者数据.xlsx` |
| `column_name` | TEXT | 检查的列名 | `病历文本` |
| `empty_rate` | DOUBLE | 空值率 (0-1) | 0.15 (15%) |
| `avg_length` | DOUBLE | 平均文本长度 | 256.8 |
| `total_rows` | INT | <EFBFBD><EFBFBD><EFBFBD>?| 500 |
| `estimated_tokens` | INT | <EFBFBD>Token<EFBFBD>?| 150000 |
| `status` | TEXT | <EFBFBD>亙熒<EFBFBD><EFBFBD>?| `good` / `bad` |
| `total_rows` | INT | 总行数 | 500 |
| `estimated_tokens` | INT | 预估Token| 150000 |
| `status` | TEXT | 健康状态 | `good` / `bad` |
| `message` | TEXT | 提示信息 | `健康度良好` |
**<EFBFBD>**嚗?```sql
**索引**
```sql
CREATE INDEX "dc_health_checks_user_id_file_name_idx"
ON "dc_schema"."dc_health_checks"("user_id", "file_name");
```
**銝𡁜𦛚閫<EFBFBD><EFBFBD>**嚗?- 蝛箏<E89D9B><EFBFBD> > 80% <20>?`status = 'bad'`
- 撟喳<E6929F><E596B3>踹漲 < 10 <20>?`status = 'bad'`
- 蝻枏<E89DBB><E69E8F><EFBFBD><E39787><EFBFBD><EFBFBD>24撠𤩺𧒄嚗<F0A79284><E59A97><EFBFBD><EFBFBD>摰䂿緵嚗?
**业务规则**
- 空值率 > 80% → `status = 'bad'`
- 平均长度 < 10 → `status = 'bad'`
- 缓存有效期24小时应用层实现
---
### 3.2 dc_templates<EFBFBD><EFBFBD>霈暹芋<EFBFBD>輯”嚗?
**<2A><EFBFBD>?*: 摮睃<E691AE><E79D83><EFBFBD>蝐餃<E89D90><E9A483><EFBFBD><EFBFBD>霈暹<E99C88><E69AB9>𡝗芋<F0A19D97>?
### 3.2 dc_templates(预设模板表)
**用途**: 存储疾病类型的预设提取模板
```sql
CREATE TABLE "dc_schema"."dc_templates" (
"id" TEXT NOT NULL PRIMARY KEY,
@@ -146,16 +168,18 @@ CREATE TABLE "dc_schema"."dc_templates" (
);
```
**摮埈挾霂湔<EFBFBD>**嚗?
**字段说明**
| 字段 | 类型 | 说明 | 示例 |
|------|------|------|------|
| `disease_type` | TEXT | 疾病类型 | `lung_cancer` |
| `report_type` | TEXT | 报告类型 | `pathology` |
| `display_name` | TEXT | 显示名称 | `肺癌病理报告` |
| `fields` | JSONB | <EFBFBD>𣂼<EFBFBD>摮埈挾<EFBFBD>滨蔭 | 閫<><E996AB><EFBFBD>寧內靘?|
| `prompt_template` | TEXT | Prompt璅⊥踎 | `霂瑚<EFBFBD>隞乩<EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>銝剜<EFBFBD><EFBFBD>?..` |
| `fields` | JSONB | 提取字段配置 | 见下方示例 |
| `prompt_template` | TEXT | Prompt模板 | `请从以下病理报告中提取...` |
**fields摮埈挾蝏𤘪<EFBFBD>**嚗?```json
**fields字段结构**
```json
[
{
"name": "病理类型",
@@ -164,20 +188,23 @@ CREATE TABLE "dc_schema"."dc_templates" (
},
{
"name": "分化程度",
"desc": "擃?銝?雿𤾸<E99BBF><F0A4BEB8>?,
"desc": "高/中/低分化",
"width": "w-32"
}
]
```
**<EFBFBD><EFBFBD>蝥行<EFBFBD>**嚗?```sql
**唯一约束**
```sql
UNIQUE ("disease_type", "report_type")
```
<EFBFBD><EFBFBD><EFBFBD><EFBFBD>+<2B><EFBFBD>蝐餃<E89D90><EFBFBD><E89D8F><EFBFBD><EFBFBD><E88ABE><EFBFBD>銝芣芋<E88AA3>?
同一疾病+报告类型组合只能有一个模板
---
### 3.3 dc_extraction_tasks<EFBFBD><EFBFBD><EFBFBD>碶遙<EFBFBD>∟”嚗?
**<2A><EFBFBD>?*: 蝞∠<E89D9E><E288A0><EFBFBD><E5AFA5>𣂼<EFBFBD>隞餃𦛚嚗諹蕭頦芾<E9A0A6>摨血<E691A8><E8A180>鞉𧋦
### 3.3 dc_extraction_tasks(提取任务表)
**用途**: 管理批量提取任务,追踪进度和成本
```sql
CREATE TABLE "dc_schema"."dc_extraction_tasks" (
@@ -192,10 +219,12 @@ CREATE TABLE "dc_schema"."dc_extraction_tasks" (
"report_type" TEXT NOT NULL,
"target_fields" JSONB NOT NULL,
-- <EFBFBD>峕芋<EFBFBD><EFBFBD>蝵? "model_a" TEXT NOT NULL DEFAULT 'deepseek-v3',
-- 双模型配置
"model_a" TEXT NOT NULL DEFAULT 'deepseek-v3',
"model_b" TEXT NOT NULL DEFAULT 'qwen3-72b',
-- 隞餃𦛚<EFBFBD><EFBFBD>? "status" TEXT NOT NULL DEFAULT 'pending',
-- 任务状态
"status" TEXT NOT NULL DEFAULT 'pending',
"total_count" INTEGER NOT NULL DEFAULT 0,
"processed_count" INTEGER NOT NULL DEFAULT 0,
"clean_count" INTEGER NOT NULL DEFAULT 0,
@@ -209,41 +238,47 @@ CREATE TABLE "dc_schema"."dc_extraction_tasks" (
-- 错误信息
"error" TEXT,
-- <EFBFBD>園𡢿<EFBFBD>? "created_at" TIMESTAMP(3) NOT NULL DEFAULT CURRENT_TIMESTAMP,
-- 时间戳
"created_at" TIMESTAMP(3) NOT NULL DEFAULT CURRENT_TIMESTAMP,
"started_at" TIMESTAMP(3),
"completed_at" TIMESTAMP(3)
);
```
**摮埈挾霂湔<EFBFBD>**嚗?
**字段说明**
| 字段 | 类型 | 说明 | 示例 |
|------|------|------|------|
| `source_file_key` | TEXT | Storage路径 | `uploads/user123/data.xlsx` |
| `text_column` | TEXT | 文本列名 | `病历文本` |
| `target_fields` | JSONB | 提取字段 | `[{name, desc}]` |
| `status` | TEXT | 隞餃𦛚<EFBFBD><EFBFBD>?| `pending/processing/completed/failed` |
| `status` | TEXT | 任务状态 | `pending/processing/completed/failed` |
| `total_count` | INT | 总记录数 | 500 |
| `processed_count` | INT | 已处理数 | 250 |
| `clean_count` | INT | 一致数 | 200 |
| `conflict_count` | INT | <EFBFBD><EFBFBD><EFBFBD>?| 45 |
| `failed_count` | INT | 憭梯揖<EFBFBD>?| 5 |
| `total_tokens` | INT | <EFBFBD>oken<EFBFBD>?| 150000 |
| `total_cost` | DOUBLE | <EFBFBD><EFBFBD><EFBFBD>?$) | 0.27 |
| `conflict_count` | INT | 冲突数 | 45 |
| `failed_count` | INT | 失败数 | 5 |
| `total_tokens` | INT | 总Token| 150000 |
| `total_cost` | DOUBLE | 总成本($) | 0.27 |
**<EFBFBD><EFBFBD><EFBFBD><EFBFBD>頧?*嚗?```
pending <20>?processing <20>?completed
<20>?failed
**状态流转**
```
pending → processing → completed
→ failed
```
**<EFBFBD>**嚗?```sql
**索引**
```sql
CREATE INDEX "dc_extraction_tasks_user_id_status_idx"
ON "dc_schema"."dc_extraction_tasks"("user_id", "status");
```
---
### 3.4 dc_extraction_items<EFBFBD><EFBFBD><EFBFBD>𤥁扇敶閗”嚗?
**<2A><EFBFBD>?*: 摮睃<E691AE>瘥𤩺辺霈啣<E99C88><E595A3><EFBFBD><EFBFBD><E79285><E288AA>𣂼<EFBFBD>蝏𤘪<E89D8F><F0A498AA><EFBFBD><EFBFBD><EFBFBD>𠶖<EFBFBD>?
### 3.4 dc_extraction_items(提取记录表)
**用途**: 存储每条记录的双模型提取结果和冲突状态
```sql
CREATE TABLE "dc_schema"."dc_extraction_items" (
"id" TEXT NOT NULL PRIMARY KEY,
@@ -253,13 +288,16 @@ CREATE TABLE "dc_schema"."dc_extraction_items" (
"row_index" INTEGER NOT NULL,
"original_text" TEXT NOT NULL,
-- <EFBFBD>峕芋<EFBFBD><EFBFBD><EFBFBD>? "result_a" JSONB,
-- 双模型结果
"result_a" JSONB,
"result_b" JSONB,
-- <EFBFBD><EFBFBD><EFBFBD>瘚? "status" TEXT NOT NULL DEFAULT 'pending',
-- 冲突检测
"status" TEXT NOT NULL DEFAULT 'pending',
"conflict_fields" TEXT[] DEFAULT ARRAY[]::TEXT[],
-- <EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>? "final_result" JSONB,
-- 最终结果
"final_result" JSONB,
-- Token统计
"tokens_a" INTEGER NOT NULL DEFAULT 0,
@@ -278,63 +316,78 @@ CREATE TABLE "dc_schema"."dc_extraction_items" (
);
```
**摮埈挾霂湔<EFBFBD>**嚗?
**字段说明**
| 字段 | 类型 | 说明 | 示例 |
|------|------|------|------|
| `row_index` | INT | Excel行号 | 5 |
| `original_text` | TEXT | <EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>𧋦 | `<EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>45撗?..` |
| `original_text` | TEXT | 原始病历文本 | `患者45岁...` |
| `result_a` | JSONB | DeepSeek结果 | `{"肿瘤大小": "3cm"}` |
| `result_b` | JSONB | Qwen结果 | `{"肿瘤大小": "3.0cm"}` |
| `status` | TEXT | <EFBFBD><EFBFBD><EFBFBD><EFBFBD>?| `clean/conflict/resolved/failed` |
| `status` | TEXT | 处理状态 | `clean/conflict/resolved/failed` |
| `conflict_fields` | TEXT[] | 冲突字段列表 | `["肿瘤大小"]` |
| `final_result` | JSONB | <EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>?| `{"<22>輻𠈔憭批<E686AD>": "3cm"}` |
| `final_result` | JSONB | 最终裁决结果 | `{"肿瘤大小": "3cm"}` |
**result_a/result_b蝏𤘪<EFBFBD>蝷箔<EFBFBD>**嚗?```json
**result_a/result_b结构示例**
```json
{
"<22><><EFBFBD>蝐餃<E89D90>": "瘚豢隋<E8B1A2><EFBFBD><E689AF>?,
"<22><><EFBFBD>蝔见漲": "銝剖<E98A9D><E58996>?,
"病理类型": "浸润性腺癌",
"分化程度": "中分化",
"肿瘤大小": "3cm",
"瘛见毀蝏栞蓮蝘?: "<22>?
"淋巴结转移": "无"
}
```
**<EFBFBD><EFBFBD><EFBFBD><EFBFBD>?*嚗?- `pending`: 蝑匧<E89D91><EFBFBD><E686AD>
- `clean`: <20>峕芋<E5B395><EFBFBD><E8AEA0><EFBFBD><E99D9D>?- `conflict`: 摮睃銁<E79D83><EFBFBD>嚗屸<E59A97>鈭箏極鋆<E6A5B5><E98B86>
- `resolved`: <20><EFBFBD>撌脰圾<E884B0>?- `failed`: <20>𣂼<EFBFBD>憭梯揖
**状态说明**
- `pending`: 等待处理
- `clean`: 双模型结果一致
- `conflict`: 存在冲突,需人工裁决
- `resolved`: 冲突已解决
- `failed`: 提取失败
**<EFBFBD>**嚗?```sql
**索引**
```sql
CREATE INDEX "dc_extraction_items_task_id_status_idx"
ON "dc_schema"."dc_extraction_items"("task_id", "status");
```
**憭㚚睸蝥行<EFBFBD>**嚗?- `ON DELETE CASCADE`: <20>𣳇膄隞餃𦛚<E9A483>嗉䌊<E59789><EFBFBD><E585B8><EFBFBD><E69697>㕑扇敶?
**外键约束**
- `ON DELETE CASCADE`: 删除任务时自动删除所有记录
---
## <EFBFBD><EFBFBD><EFBFBD>揣撘閗挽霈?
## 四、索引设计
### 4.1 索引列表
| 銵典<EFBFBD> | 蝝<E89D9D>摮埈挾 | 蝐餃<E89D90> | <20><EFBFBD>?|
| 表名 | 索引字段 | 类型 | 用途 |
|------|---------|------|------|
| `dc_health_checks` | `(user_id, file_name)` | 憭滚<EFBFBD> | <20>亥砭<E4BAA5><EFBFBD><E586BD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><E884AB>?|
| `dc_health_checks` | `(user_id, file_name)` | 复合 | 查询用户的历史检查 |
| `dc_templates` | `(disease_type, report_type)` | 唯一 | 防止重复模板 |
| `dc_extraction_tasks` | `(user_id, status)` | 憭滚<EFBFBD> | <20>亥砭<E4BAA5><EFBFBD><E586BD><EFBFBD><EFBFBD><EFBFBD>銵?|
| `dc_extraction_items` | `(task_id, status)` | 憭滚<EFBFBD> | <20>亥砭隞餃𦛚<E9A483><F0A69B9A>扇敶訫<E695B6>銵?|
| `dc_extraction_tasks` | `(user_id, status)` | 复合 | 查询用户的任务列表 |
| `dc_extraction_items` | `(task_id, status)` | 复合 | 查询任务的记录列表 |
### 4.2 性能考虑
**<EFBFBD>亥砭隡睃<EFBFBD>**嚗?```sql
-- 擃䀹<E69383><E480B9>亥砭嚗𡁜⏚<F0A1819C>函揣撘?SELECT * FROM dc_extraction_tasks
**查询优化**
```sql
-- 高效查询:利用索引
SELECT * FROM dc_extraction_tasks
WHERE user_id = 'user123' AND status = 'processing';
-- 擃䀹<E69383><E480B9>亥砭嚗𡁜⏚<F0A1819C>函揣撘?SELECT * FROM dc_extraction_items
-- 高效查询:利用索引
SELECT * FROM dc_extraction_items
WHERE task_id = 'task456' AND status = 'conflict';
```
**<EFBFBD><EFBFBD><EFBFBD>刻”<EFBFBD><EFBFBD>**嚗?- <20>?憪讠<E686AA><E8AEA0>汾HERE摮𣂼蘂銝剖<E98A9D><E58996>怎揣撘訫<E69298>畾?- <20>?雿輻鍂`status`摮埈挾餈<E68CBE><EFBFBD>臭誑<E887AD><EFBFBD><E69B87><EFBFBD><E8AAA9><EFBFBD>銵峕㺭
**避免全表扫描**
- ✅ 始终在WHERE子句中包含索引字段
- ✅ 使用`status`字段过滤可以显著减少扫描行数
---
## 鈭𢛵<EFBFBD><EFBFBD><EFBFBD><EFBFBD>桃漲<EFBFBD>?
## 五、外键约束
### 5.1 级联删除
```sql
@@ -345,34 +398,46 @@ REFERENCES "dc_schema"."dc_extraction_tasks"("id")
ON DELETE CASCADE;
```
**銵䔶蛹**嚗?- <20>𣳇膄隞餃𦛚 <20>?<3F>芸𢆡<E88AB8>𣳇膄<F0A3B387><E88684><EFBFBD><EFBFBD><E58CA7>𠉛<EFBFBD><F0A0899B>𣂼<EFBFBD>霈啣<E99C88>
- 靽肽<E99DBD><E882BD>唳旿銝<E697BF><E98A9D><EFBFBD>?
### 5.2 <20><EFBFBD><E683A9><EFBFBD>銵?
- `dc_health_checks`: <20><EFBFBD>銵剁<E98AB5><E58981><EFBFBD><E683A9>?- `dc_templates`: <20><EFBFBD>銵剁<E98AB5><E58981><EFBFBD><E683A9>?- `dc_extraction_tasks`: <20><EFBFBD><E683A9><EFBFBD>user_id隞<64><EFBFBD><E89BB9><EFBFBD>嚗䔶<E59A97>撘箏<E69298><E7AE8F><EFBFBD>嚗?
**<2A><EFBFBD>**嚗?- <20>?<3F><EFBFBD>頝沒chema靘肽<E99D98>
- <20>?<3F><EFBFBD><E79285><E288AA><EFBFBD><E7A589>?- <20>?蝞<><E89D9E>𤥁<EFBFBD>蝘餃<E89D98><E9A483><EFBFBD>
**行为**
- 删除任务 → 自动删除所有关联的提取记录
- 保证数据一致性
### 5.2 无外键的表
- `dc_health_checks`: 独立表,无外键
- `dc_templates`: 独立表,无外键
- `dc_extraction_tasks`: 无外键user_id仅为标识不强制关联
**原因**
- ✅ 减少跨Schema依赖
- ✅ 提高模块独立性
- ✅ 简化迁移和回滚
---
## <EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>賢𪂹<EFBFBD>?
## 六、数据生命周期
### 6.1 数据保留策略
| 表名 | 保留时间 | 清理策略 |
|------|---------|---------|
| `dc_health_checks` | 7憭?| 摰𡁏<E691B0><EFBFBD><E79A9C><EFBFBD>扯扇敶?|
| `dc_health_checks` | 7天 | 定期清理旧记录 |
| `dc_templates` | 永久 | 手动管理 |
| `dc_extraction_tasks` | 90憭?| 敶埝﹝<E59F9D>𤾸<EFBFBD><F0A4BEB8>?|
| `dc_extraction_items` | 90憭?| <20>譍遙<E8AD8D><EFBFBD><E288AA>?|
| `dc_extraction_tasks` | 90天 | 归档后删除 |
| `dc_extraction_items` | 90天 | 随任务删除 |
### 6.2 归档策略
**憭找遙<EFBFBD><EFBFBD>獢?* (> 1000<30>∟扇敶?嚗?1. 隞餃𦛚摰峕<E691B0><E5B395>𠬍<EFBFBD>撖澆枂蝏𤘪<E89D8F><F0A498AA>蚓SV/Excel
**大任务归档** (> 1000条记录)
1. 任务完成后导出结果到CSV/Excel
2. 上传到Storage永久保存
3. <20>𣳇膄<F0A3B387>唳旿摨栞扇敶𤏪<E695B6><F0A48FAA>𦠜𦆮蝛粹𡢿嚗?
3. 删除数据库记录(释放空间)
### 6.3 清理脚本(示例)
```typescript
// 皜<><E79A9C>7憭拙<E686AD><E68B99><EFBFBD><EFBFBD>摨瑟<E691A8><E7919F>亥扇敶?await prisma.dCHealthCheck.deleteMany({
// 清理7天前的健康检查记录
await prisma.dCHealthCheck.deleteMany({
where: {
createdAt: {
lt: new Date(Date.now() - 7 * 24 * 60 * 60 * 1000)
@@ -391,7 +456,8 @@ const oldTasks = await prisma.dCExtractionTask.findMany({
include: { items: true }
});
// 撖澆枂<EFBFBD>𤾸<EFBFBD><EFBFBD>?for (const task of oldTasks) {
// 导出后删除
for (const task of oldTasks) {
await exportTaskToStorage(task);
await prisma.dCExtractionTask.delete({ where: { id: task.id } });
}
@@ -399,39 +465,52 @@ const oldTasks = await prisma.dCExtractionTask.findMany({
---
## <EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>?
## 七、数据安全
### 7.1 PII保护
**<EFBFBD>𤩺<EFBFBD>摮埈挾**嚗?- `original_text`: <20><EFBFBD><E888AA><EFBFBD><EFBFBD><E98984><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><E6BABB>澈隞質<E99A9E><E8B3AA>?- `result_a/result_b/final_result`: <20><EFBFBD><E888AA><EFBFBD>鉄蝏𤘪<E89D8F><F0A498AA>𣇉<EFBFBD><F0A38789>𤩺<EFBFBD>靽⊥<E99DBD>
**敏感字段**
- `original_text`: 可能包含患者姓名、身份证号
- `result_a/result_b/final_result`: 可能包含结构化的敏感信息
**靽脲擪<EFBFBD>芣鴌**嚗?- <20>?<3F><EFBFBD><E785BE>LM<4C>滩䌊<E6BBA9><EFBFBD><E588BB>𧶏<EFBFBD>PIIMaskUtil嚗?- <20>?<3F>唳旿摨枏<E691A8><EFBFBD><E69296>PostgreSQL SSL嚗?- <20>?摰𡁏<E691B0><EFBFBD><E79A9C><EFBFBD><EFBFBD><EFBFBD>唳旿
**保护措施**
- ✅ 发送LLM前自动脱敏PIIMaskUtil
- ✅ 数据库加密PostgreSQL SSL
- ✅ 定期清理历史数据
### 7.2 用户隔离
**<EFBFBD><EFBFBD>**嚗?- <20><><EFBFBD>㕑”<E39591><E2809D>鉄`user_id`摮埈挾
**机制**
- 所有表包含`user_id`字段
- 应用层强制过滤:`WHERE user_id = currentUserId`
- 瘞訾<E7989E>頝函鍂<E587BD>瑟䰻霂?
- 永不跨用户查询
---
## <EFBFBD><EFBFBD><EFBFBD><EFBFBD>敶?
## 八、附录
### 8.1 完整Schema DDL
摰峕㟲<EFBFBD><EFBFBD>chema<EFBFBD>𥕦遣<EFBFBD>𡁏𧋦雿滢<EFBFBD>嚗?```
完整的Schema创建脚本位于
```
backend/prisma/migrations/20251127_add_dc_tool_b_tables/migration.sql
```
### 8.2 Prisma模型定义
摰峕㟲<EFBFBD><EFBFBD>risma璅<EFBFBD>摰帋<EFBFBD>雿滢<EFBFBD>嚗?```
完整的Prisma模型定义位于
```
backend/prisma/schema.prisma
```
<EFBFBD>𦦵揣 `dc_schema` <20><EFBFBD><E4BAA6><EFBFBD><EFBFBD>㗇芋<E39787><EFBFBD>?
搜索 `dc_schema` 查看所有模型。
### 8.3 变更历史
| 版本 | 日期 | 变更内容 |
|------|------|---------|
| V1.0 | 2025-11-27 | <EFBFBD><EFBFBD><EFBFBD><EFBFBD>𧋦嚗?銝芾” |
| V1.0 | 2025-11-27 | 初始版本4个表 |
---
**<EFBFBD><EFBFBD>﹝蝏𤘪<EFBFBD>** <20>?
**文档结束**