feat(platform): Fix pg-boss queue conflict and add safety standards

Summary:
- Fix pg-boss queue conflict (duplicate key violation on queue_pkey)
- Add global error listener to prevent process crash
- Reduce connection pool from 10 to 4
- Add graceful shutdown handling (SIGTERM/SIGINT)
- Fix researchWorker recursive call bug in catch block
- Make screeningWorker idempotent using upsert

Security Standards (v1.1):
- Prohibit recursive retry in Worker catch blocks
- Prohibit payload bloat (only store fileKey/ID in job.data)
- Require Worker idempotency (upsert + unique constraint)
- Recommend task-specific expireInSeconds settings
- Document graceful shutdown pattern

New Features:
- PKB signed URL endpoint for document preview/download
- pg_bigm installation guide for Docker
- Dockerfile.postgres-with-extensions for pgvector + pg_bigm

Documentation:
- Update Postgres-Only async task processing guide (v1.1)
- Add troubleshooting SQL queries
- Update safety checklist

Tested: Local verification passed
This commit is contained in:
2026-01-23 22:07:26 +08:00
parent 9c96f75c52
commit 61cdc97eeb
297 changed files with 1147 additions and 21 deletions

View File

@@ -87,5 +87,6 @@ models/

View File

@@ -75,5 +75,6 @@ __version__ = '1.0.0'

View File

@@ -208,5 +208,6 @@ def get_missing_summary(df: pd.DataFrame) -> dict:

View File

@@ -168,5 +168,6 @@ def apply_filter(

View File

@@ -332,5 +332,6 @@ def get_unpivot_preview(

View File

@@ -147,3 +147,4 @@ def extract_pdf_to_markdown(pdf_path: str) -> Dict[str, Any]:

View File

@@ -342,5 +342,6 @@ if __name__ == "__main__":

View File

@@ -108,5 +108,6 @@ except Exception as e:

View File

@@ -88,5 +88,6 @@ except Exception as e: