Update hivegrid-cloud reference to latest main
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
1 parent
e98d38e716
commit
7b21524c86
3781 files changed
+373484
-225607
No files matched your search
@@ -53,7 +53,7 @@ short app/group/port summary and link back here.
|
||||
`worker-plugin` is required as a persistent Coolify service so the deploy
|
||||
topology is stable, but production plugin execution is still gated. With
|
||||
`PLUGIN_RUNTIME_PRODUCTION_ENABLED` unset or `false`, the plugin worker starts
|
||||
as an idle topology placeholder and must not consume `toolctrl.plugin-invoke`.
|
||||
as an idle topology placeholder and must not consume `hivegrid.plugin-invoke`.
|
||||
Only after the external WASM sandbox signoff in
|
||||
`docs/security/plugin-runtime-signoff.md` may operators set
|
||||
`PLUGIN_RUNTIME_PRODUCTION_ENABLED=true`, provide the trusted public keys, and
|
||||
@@ -66,7 +66,7 @@ separate Coolify app with `WORKER_QUEUE_GROUP=import`, but keep
|
||||
`IMPORT_QUEUE_ENABLED` and `IMPORT_QUEUE_RUNTIME_READY` unset until import,
|
||||
export, and scan services are wired into the worker bootstrap. In that idle
|
||||
state `/readyz` may be healthy with an empty queue list, which proves topology
|
||||
without consuming `toolctrl.imports` or `toolctrl.exports`. When both runtime
|
||||
without consuming `hivegrid.imports` or `hivegrid.exports`. When both runtime
|
||||
gates are set, startup fails closed unless the worker has real import, export,
|
||||
and scan service dependencies.
|
||||
|
||||
@@ -74,11 +74,11 @@ and scan service dependencies.
|
||||
|
||||
| Group | Package queues | Bootstrapped subscriber queues | Default concurrency | Default replicas | Workload profile |
|
||||
| --------- | ---------------------------------------------------------------------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ------------------- | ---------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
|
||||
| `general` | `toolctrl.notifications`, `toolctrl.maintenance`, `toolctrl.file-scan` | Outbox dispatcher, `outbox.ai-cost`, `outbox.search-index`, `outbox.rag-index`, `outbox.audit`, `outbox.notification`, `outbox.plugin-hook`, `outbox.plugin-capability-use`, `outbox.workflow`, `outbox.form-submission-route`, `plugin-audit-retention` | 10 | 1 | Mixed short I/O, fanout, AI-cost persistence, indexing, audit persistence, plugin hook fanout, plugin capability-use audit persistence, workflow trigger fanout, form-submission routing. The `outbox.plugin-capability-use` subscriber intentionally defaults to concurrency `1` to keep capability-use hash chains linear; do not raise `PLUGIN_CAPABILITY_USE_CONCURRENCY` without store-level serialization. |
|
||||
| `mail` | `toolctrl.email` | `outbox.mail`, `outbox.marketing` (email-sequence trigger only), `outbox.webhook` (form-submission delivery bridge), `email-sequence.step` | 5 | 2 | SMTP/HTTP throughput-bound; owns direct transactional mail delivery, transactional mail outbox bridging, form-submission webhook bridging, and email-sequence trigger/step subscriber contracts. Email-sequence subscribers require `MARKETING_SEQUENCES_ENABLED=true`; keep it unset or false in production until the remaining approval follow-ups in `docs/features/email-sequences.md` land and the Mailjet env pair is configured. Stale-lead/trial-expiring cron runner functions exist but are not production scheduler-registered yet; trial-expiring still needs a canonical trial-end source before that scheduler can be wired safely. The generic marketing outbound adapter/handler foundation exists in `packages/marketing-outbound` and `apps/worker/src/jobs/marketing-outbound.ts`, but it is pure handler foundation and does not claim active ownership of `outbox.marketing`; general marketing integration delivery is not bootstrapped in `apps/worker/src/index.ts` yet. |
|
||||
| `import` | `toolctrl.imports`, `toolctrl.exports` after `IMPORT_QUEUE_ENABLED=true` and `IMPORT_QUEUE_RUNTIME_READY=true` | none | 1 | 1 | CPU/memory-bound, long-running; idle topology placeholder until import/export/scan services are wired |
|
||||
| `webhook` | `toolctrl.ai-chatbot`, `toolctrl.browser-automation` | none | 20 | 3 | I/O-bound calls to external services |
|
||||
| `plugin` | `toolctrl.plugin-invoke` | none | 5 | 2 | Third-party WASM plugin invocations, isolated from core queues. In production this group is idle until `PLUGIN_RUNTIME_PRODUCTION_ENABLED=true` is set after external sandbox signoff. |
|
||||
| `general` | `hivegrid.notifications`, `hivegrid.maintenance`, `hivegrid.file-scan` | Outbox dispatcher, `outbox.ai-cost`, `outbox.search-index`, `outbox.rag-index`, `outbox.audit`, `outbox.notification`, `outbox.plugin-hook`, `outbox.plugin-capability-use`, `outbox.workflow`, `outbox.form-submission-route`, `plugin-audit-retention` | 10 | 1 | Mixed short I/O, fanout, AI-cost persistence, indexing, audit persistence, plugin hook fanout, plugin capability-use audit persistence, workflow trigger fanout, form-submission routing. The `outbox.plugin-capability-use` subscriber intentionally defaults to concurrency `1` to keep capability-use hash chains linear; do not raise `PLUGIN_CAPABILITY_USE_CONCURRENCY` without store-level serialization. |
|
||||
| `mail` | `hivegrid.email` | `outbox.mail`, `outbox.marketing` (email-sequence trigger only), `outbox.webhook` (form-submission delivery bridge), `email-sequence.step` | 5 | 2 | SMTP/HTTP throughput-bound; owns direct transactional mail delivery, transactional mail outbox bridging, form-submission webhook bridging, and email-sequence trigger/step subscriber contracts. Email-sequence subscribers require `MARKETING_SEQUENCES_ENABLED=true`; keep it unset or false in production until the remaining approval follow-ups in `docs/features/email-sequences.md` land and the Mailjet env pair is configured. Stale-lead/trial-expiring cron runner functions exist but are not production scheduler-registered yet; trial-expiring still needs a canonical trial-end source before that scheduler can be wired safely. The generic marketing outbound adapter/handler foundation exists in `packages/marketing-outbound` and `apps/worker/src/jobs/marketing-outbound.ts`, but it is pure handler foundation and does not claim active ownership of `outbox.marketing`; general marketing integration delivery is not bootstrapped in `apps/worker/src/index.ts` yet. |
|
||||
| `import` | `hivegrid.imports`, `hivegrid.exports` after `IMPORT_QUEUE_ENABLED=true` and `IMPORT_QUEUE_RUNTIME_READY=true` | none | 1 | 1 | CPU/memory-bound, long-running; idle topology placeholder until import/export/scan services are wired |
|
||||
| `webhook` | `hivegrid.ai-chatbot`, `hivegrid.browser-automation` | none | 20 | 3 | I/O-bound calls to external services |
|
||||
| `plugin` | `hivegrid.plugin-invoke` | none | 5 | 2 | Third-party WASM plugin invocations, isolated from core queues. In production this group is idle until `PLUGIN_RUNTIME_PRODUCTION_ENABLED=true` is set after external sandbox signoff. |
|
||||
|
||||
Source of truth: `packages/queue/src/groups.ts`. A test
|
||||
(`groups.test.ts`) fails CI if a queue exists that isn't mapped to a
|
||||
@@ -117,11 +117,13 @@ dispatcher or bridge dependency fails startup instead of leaving outbox rows or
|
||||
`outbox.workflow` silently undrained behind a green process.
|
||||
Source-inventory tests guard that legacy `WorkflowEngine.trigger(...)`
|
||||
call-sites stay absent and that only the signed internal trigger bridge may
|
||||
start `type: "trigger"` executions directly. The `row.created`, `row.updated`,
|
||||
and `row.deleted` route-backed and workflow-context producers now write the row
|
||||
mutation, application event, and `workflow.trigger.event` outbox row in the same
|
||||
transaction when a request or workflow event context is passed. Other internal
|
||||
requestless mutations remain eventless by default to avoid worker feedback loops.
|
||||
start `type: "trigger"` executions directly. The generic entity-builder's
|
||||
`row.created` / `row.updated` / `row.deleted` route-backed producers were
|
||||
**removed with the entity-builder** (R-P6B-β, AD-2); typed fachentities and
|
||||
workflow row blocks (via the typed model registry) no longer emit generic
|
||||
`row.*` outbox events. `workflow.trigger.event` application events still publish
|
||||
through `EventsService`. Other internal requestless mutations remain eventless by
|
||||
default to avoid worker feedback loops.
|
||||
|
||||
`worker-general` also registers the
|
||||
`workflow-execution-stalled-reconcile` maintenance scheduler. It repairs only
|
||||
@@ -146,7 +148,7 @@ outbox dispatcher routes to `outbox.form-submission-route` on
|
||||
`worker-general`. That subscriber performs tenant-scoped CRM/entity routing,
|
||||
marks the submission, and publishes follow-up events. Webhook follow-ups use
|
||||
`webhook.form-submission.deliver`, routed to `outbox.webhook` on
|
||||
`worker-mail`, where the bridge enqueues the existing `toolctrl.email`
|
||||
`worker-mail`, where the bridge enqueues the existing `hivegrid.email`
|
||||
`deliver-webhook` job. This keeps webhook HTTP delivery in the mail/HTTP
|
||||
throughput group and leaves the general group responsible only for the
|
||||
database-backed routing decision.
|
||||
@@ -290,7 +292,7 @@ Managed Coolify `worker-mail` apps must keep
|
||||
`TRANSACTIONAL_MAIL_OUTBOX_REQUIRED=true` so the process fails fast when
|
||||
`outbox.mail` cannot subscribe; without that bridge, invite and other
|
||||
`mail.transactional.*` outbox events can remain pending even if the direct
|
||||
`toolctrl.email` worker is alive. The Coolify worker-group provisioner writes
|
||||
`hivegrid.email` worker is alive. The Coolify worker-group provisioner writes
|
||||
and drift-checks this env value for managed mail workers.
|
||||
|
||||
Example:
|
||||
|
||||
Reference in new issue
Block a user