generated from john/python-template
zoltan57andCopilot App
7b9715b3f1
Claim jobs atomically [CRIT-01] - Replace JobService.read_next_queued_job with claim_next_queued_job, which selects and transitions QUEUED -> PROCESSING inside one transaction. The old read-then-write sequence left a window in which two workers could observe the same QUEUED row. - Add the missing .limit(1). The poll previously ordered the entire queued set and discarded all but the first row. - Drop the eager loads from the hot poll entirely. They were pure waste: process_queued_job immediately re-reads the job through read_job with the relationships it actually needs. - Guard the row with with_for_update(skip_locked=True) on PostgreSQL so the claim stays correct once more than one worker exists. On SQLite the claim is a bounded single-writer transaction. - Correct the comment at the remaining direct-call claim site, which described the hazard rather than the guarantee. Reuse the provider connection [HIGH-02] - Build the ServiceBundle once per worker loop instead of once per job, and close it at loop shutdown. Every job previously constructed a new SourceService, and with it a new provider adapter and a new httpx.AsyncClient, paying a full TLS handshake per page and discarding the connection pool. - process_next_queued_job now accepts an optional caller-owned bundle and only closes bundles it created itself. Uncap the provider timeout [HIGH-03] - Remove le=20.0 from worker_provider_timeout_seconds. The cap equalled the default, so the ceiling could never be raised, and dense-page vision transcription routinely needs longer. Default raised to 180s. - Pass an explicit httpx.Timeout to the OpenRouter AsyncClient. httpx defaults every phase to 5 seconds, so the real read budget was 5s regardless of the configured value; the outer asyncio.wait_for could never be the binding constraint. Connect stays at 10s. Tighten the provider boundary [MED-03] - Declare model, current_request_manifest, current_transport_evidence, and aclose on the TranscriptionProvider Protocol. - Delete the per-call inspect.signature(adapter.transcribe).parameters reflection and the untyped kwargs dict it fed. The Protocol had declared requested_model all along, so the reflection was dead defensive weight on the hot path. - Replace the three getattr probes for aclose and the evidence attributes with direct typed access. Deduplicate bundle construction [MED-06] - Add ServiceBundle.from_session_factory and ServiceBundle.aclose, replacing the duplicated four-service instantiation blocks in app.py and worker.py. - _recover_stale_processing_jobs now uses the bundle built moments earlier instead of constructing a second JobService. Tests - Claiming returns the oldest job, marks it PROCESSING, never hands the same job out twice, and emits exactly one unadorned SELECT carrying LIMIT and no JOIN. - The worker loop threads one bundle through consecutive jobs and closes it once at shutdown; a caller-owned bundle is left open. - Settings accepts a timeout above 20 seconds and still rejects zero. - The OpenRouter client's read, write, and pool timeouts track the configured budget rather than the httpx default. Note: .env in this checkout still pins WORKER_PROVIDER_TIMEOUT_SECONDS=20 and should be raised to pick up this fix. Verified: 268 passed, 4 skipped; ruff check clean. Co-authored-by: Copilot App <[email protected]>
57 lines
1.8 KiB
Bash
57 lines
1.8 KiB
Bash
# --- NiceGUI Server ---
|
|
# HOST=`0.0.0.0` (default)
|
|
# PORT=8000 (default)
|
|
# LOG_LEVEL: [`critical`, `error`, `warning`, `info` (default), `debug`, `trace`]
|
|
# RELOAD=false (default)
|
|
|
|
# --- AI provider ---
|
|
# PROVIDER=[`openrouter`(default), `google_genai`]
|
|
PROVIDER=openrouter
|
|
# OPENROUTER_API_KEY - Required when `PROVIDER=openrouter`
|
|
OPENROUTER_API_KEY=your-api-key-goes-here
|
|
# GEMINI_API_KEY - Required when `PROVIDER=google_genai`
|
|
# PROVIDER_MODEL= specify model. If left blank OpenRouter will supply default.
|
|
PROVIDER_MODEL=google/gemini-2.5-flash
|
|
# Optional JSON allowlist for model selection. The default above is always first.
|
|
# PROVIDER_MODELS=["google/gemini-2.5-flash","google/gemini-2.5-pro","anthropic/claude-sonnet-4"]
|
|
# OPENROUTER_HTTP_REFERER=https://example.com
|
|
# OPENROUTER_APP_TITLE="Google: Gemini 2.5 Flash (openrouter)"
|
|
|
|
# --- runtime environment ---
|
|
# ENVIRONMENT: [`development`(default), `test`, `production`]
|
|
|
|
# --- persistence ---
|
|
# Use nested settings with double underscore because env_nested_delimiter="__".
|
|
# SQLite example:
|
|
# DATABASE__DRIVER=sqlite
|
|
# DATABASE__PATH=app.db
|
|
#
|
|
# SQLite with custom relative path:
|
|
# DATABASE__DRIVER=sqlite
|
|
DATABASE__PATH=./data/transcription.db
|
|
#
|
|
# Postgres example:
|
|
# DATABASE__DRIVER=postgres
|
|
# DATABASE__HOST=localhost
|
|
# DATABASE__PORT=5432
|
|
# DATABASE__DATABASE=transcription
|
|
# DATABASE__USER=postgres
|
|
# DATABASE__PASSWORD=change-me
|
|
#
|
|
# Optional persistence flags:
|
|
# BOOTSTRAP_SCHEMA_ON_STARTUP=false
|
|
# SQLITE_CHECK_SAME_THREAD=false
|
|
|
|
# --- filesystem paths ---
|
|
UPLOAD_DIR="./data"
|
|
PROMPT_DIR="./prompts"
|
|
|
|
# --- worker reliability ---
|
|
WORKER_MAX_RETRIES=0
|
|
WORKER_RETRY_BACKOFF_SECONDS=0
|
|
# WORKER_PROVIDER_TIMEOUT_SECONDS=180
|
|
WORKER_PROVIDER_TIMEOUT_SECONDS=180
|
|
WORKER_MIN_TRANSCRIPTION_CHARS=0
|
|
WORKER_MIN_TRANSCRIPTION_LINES=0
|
|
WORKER_FAIL_ON_FINISH_REASON_LENGTH=false
|