HaHafeng
fa72beea6c
Major Changes: - Implement Platform-Only architecture pattern (unified task management) - Add PostgresCacheAdapter for unified caching (platform_schema.app_cache) - Add PgBossQueue for job queue management (platform_schema.job) - Implement CheckpointService using job.data (generic for all modules) - Add intelligent threshold-based dual-mode processing (THRESHOLD=50) - Add task splitting mechanism (auto chunk size recommendation) - Refactor ASL screening service with smart mode selection - Refactor DC extraction service with smart mode selection - Register workers for ASL and DC modules Technical Highlights: - All task management data stored in platform_schema.job.data (JSONB) - Business tables remain clean (no task management fields) - CheckpointService is generic (shared by all modules) - Zero code duplication (DRY principle) - Follows 3-layer architecture principle - Zero additional cost (no Redis needed, save 8400 CNY/year) Code Statistics: - New code: ~1750 lines - Modified code: ~500 lines - Test code: ~1800 lines - Documentation: ~3000 lines Testing: - Unit tests: 8/8 passed - Integration tests: 2/2 passed - Architecture validation: passed - Linter errors: 0 Files: - Platform layer: PostgresCacheAdapter, PgBossQueue, CheckpointService, utils - ASL module: screeningService, screeningWorker - DC module: ExtractionController, extractionWorker - Tests: 11 test files - Docs: Updated 4 key documents Status: Phase 1-7 completed, Phase 8-9 pending
55 lines
1.1 KiB
Batchfile
55 lines
1.1 KiB
Batchfile
@echo off
|
||
REM Windows批处理脚本 - 运行缺失值处理功能测试
|
||
|
||
echo ========================================
|
||
echo 缺失值处理功能 - 自动化测试
|
||
echo ========================================
|
||
echo.
|
||
|
||
REM 检查Python是否安装
|
||
python --version >nul 2>&1
|
||
if %errorlevel% neq 0 (
|
||
echo [错误] Python未安装或不在PATH中
|
||
pause
|
||
exit /b 1
|
||
)
|
||
|
||
echo [1/3] 检查Python服务状态...
|
||
curl -s http://localhost:8001/health >nul 2>&1
|
||
if %errorlevel% neq 0 (
|
||
echo [警告] Python服务未运行，请先启动服务：
|
||
echo cd extraction_service
|
||
echo python main.py
|
||
echo.
|
||
pause
|
||
exit /b 1
|
||
)
|
||
echo [OK] Python服务运行正常
|
||
echo.
|
||
|
||
echo [2/3] 检查依赖...
|
||
python -c "import pandas, numpy, requests" >nul 2>&1
|
||
if %errorlevel% neq 0 (
|
||
echo [警告] 缺少依赖，正在安装...
|
||
pip install pandas numpy requests
|
||
)
|
||
echo [OK] 依赖检查完成
|
||
echo.
|
||
|
||
echo [3/3] 运行测试...
|
||
echo.
|
||
python test_fillna_operations.py
|
||
|
||
echo.
|
||
echo ========================================
|
||
echo 测试完成
|
||
echo ========================================
|
||
pause
|
||
|
||
|
||
|
||
|
||
|
||
|
||
|