WIP: Integrate TF Grid #52

Draft

zaelgohary wants to merge 26 commits from development_tfgrid into development

pull from: development_tfgrid

merge into: lhumina_code:development

lhumina_code:development

lhumina_code:development_show_node_versions

lhumina_code:development_fix_congfig_script

lhumina_code:development_hero_router

lhumina_code:main

lhumina_code:development_fix_deploy_ssh_keys_target_node

Conversation 0 Commits 26 Files changed 77 +11573 -4303

zaelgohary commented 2026-04-01 06:52:50 +00:00

Member

Copy link

Related Issue: #8

Related Issue: https://forge.ourworld.tf/lhumina_code/hero_compute/issues/8

zaelgohary added 6 commits 2026-04-01 06:52:50 +00:00

Integrate tfgrid 649d6d811d

Simplify TFGrid RPC handler and grid driver: inline request ... 78a5ce1fe6

construction in grid_driver, flatten rpc.rs by removing intermediate
variables, and add cancel_contracts CLI option to main.rs

test: Add comprehensive unit and integration tests for tfgrid crate b20fd30c75

Add secret access control, VM name validation, and structured logging to TFGrid RPC 5f278dc268

fix: Harden TFGrid with sr25519 signed-request auth ... 49fc781a52

Sr25519 signed tokens replace plain-text secrets. CRUD trigger guards block external vm/slice writes. Ownership checks on get/list/logs/stop/delete
with secret scrubbing from responses. Reject stop during provisioning, fail on corrupt contract metadata, rollback slices on allocation failure. CSPRNG for mycelium keys, pass all SSH keys to grid. Add --delete-all-vms and --sign-auth CLI commands, bind TCP bridge to localhost only

Refactor TFGrid for multi-node support, strip dead code, and fix module declarations 183201b618

zaelgohary added 1 commit 2026-04-01 07:36:35 +00:00

Replace hypervisor_id JSON string with typed HypervisorMeta, consolidate config loading, fix CRUD tests, and guard against double-stop, deduplicate main.rs helpers 2333decf8f

zaelgohary added 1 commit 2026-04-01 07:56:54 +00:00

Format code, fix workflows a1bb5951d0

zaelgohary added 1 commit 2026-04-01 10:09:24 +00:00

Fix log msg, add readme, Update generated files 7689920baf

zaelgohary added 1 commit 2026-04-02 04:48:58 +00:00

Unify cloud schema for SDK compatibility across server and tfgrid ... ed36c2b428

Add HypervisorMeta, ComputeNode.node_id, list_nodes() to shared schema. Server ignores node_id (local-only). TFGrid stubs server-only methods. Regenerate all codegen files from merged schema.

zaelgohary added 1 commit 2026-04-02 05:16:40 +00:00

Make auth optional and simplify config/test setup d61d60dd5b

zaelgohary added 1 commit 2026-04-02 05:42:12 +00:00

Remove backward compat code, TCP bridge from tfgrid, and untrack build-generated artifacts 3a255d9112

zaelgohary added 1 commit 2026-04-02 09:50:06 +00:00

Reuse reqwest client, add tfgrid to build_service_definition 7eb448756a

zaelgohary added 1 commit 2026-04-02 09:50:11 +00:00

Revert tfgrid to single-node architecture for UI compatibility d778edb7e6

zaelgohary added 1 commit 2026-04-05 00:13:31 +00:00

Integrate explorer fleet: heartbeats, hero_proc tracking, unified UI routing ... 04a793183f

- Add NodeType (server/tfgrid) to explorer schema and heartbeat
- Create tfgrid heartbeat sender using Grid Proxy stats
- Add hero_proc sentinel jobs for tfgrid deploy_vm
- Route all UI /rpc calls through explorer (remove --server flag)
- Add TCP transport to heartbeat senders, raw_rpc() to SDK
- Parse speed/cpu_benchmark/uptime from Grid Proxy for node_stats

zaelgohary added 1 commit 2026-04-05 02:21:56 +00:00

Fix double-encoded explorer responses, remove local mode, add SSH key proxy and tfgrid images 7877c9d467

zaelgohary added 1 commit 2026-04-05 05:30:45 +00:00

Implement SSH keys, deployment logs, and per-node image loading for tfgrid 412d9cec7d

zaelgohary added 1 commit 2026-04-06 08:34:33 +00:00

Implement master/worker architecture for server and tfgrid nodes ... be6cf42a33

- Master runs server + explorer + UI + optional tfgrid (if TFGRID_TWIN_ID set)
- Worker runs tfgrid + UI, connects to master's explorer
- Replace TFGRID_NODE_ID with TFGRID_TWIN_ID for multi-node discovery
- Explorer auto-detects master by hostname (NodeRole enum)
- Fix Grid Proxy list endpoint parsing (top-level vs nested resources)
- Simplify CLI with build_daemon_action helper and tests with MockServer guard

zaelgohary added 1 commit 2026-04-06 15:28:37 +00:00

Merge remote-tracking branch 'origin/development' into development_tfgrid 92d593820f

zaelgohary added 1 commit 2026-04-06 15:28:52 +00:00

Fix formatting after merge 15763f854f

zaelgohary added 1 commit 2026-04-07 06:55:11 +00:00

fix: Restore UI and tfgrid integration after merge d1dd2d499d

zaelgohary added 1 commit 2026-04-07 10:59:35 +00:00

feat: Add node-targeted deployment for TFGrid and fix SSH key injection, fix node in vms table 7710e6b69d

zaelgohary added 3 commits 2026-04-08 06:41:29 +00:00

refactor: Extract TCP bridge, fix socket paths, optimize heartbeats efb85cb656

refactor: Optimize heartbeats, extract shared SDK helpers, enforce best practices 8dd20ab137

fix: Console routing, Hide unsupported actions for TFGrid VMs, Attach _nodeType to VM data, Add serde(default) to explorer node_type/node_role/status 85365eede1

zaelgohary added 1 commit 2026-04-08 10:10:49 +00:00

refactor: Remove auto-discovery, simplify node registration, cleanup c376da1cd0

All checks were successful

Hide all checks

Test / test (push) Successful in 3m50s

Details

Test / test (pull_request) Successful in 3m51s

Details

This pull request has changes conflicting with the target branch.

• .env.example
• Cargo.lock
• crates/hero_compute/src/main.rs
• crates/hero_compute_examples/examples/basic_usage.rs
• crates/hero_compute_examples/examples/health.rs
• crates/hero_compute_examples/tests/integration.rs
• crates/hero_compute_explorer/src/config.rs
• crates/hero_compute_explorer/src/explorer/proxy.rs
• crates/hero_compute_explorer/src/main.rs
• crates/hero_compute_sdk/Cargo.toml
• crates/hero_compute_sdk/src/lib.rs
• crates/hero_compute_server/Cargo.toml
• crates/hero_compute_server/heroservice.json
• crates/hero_compute_server/src/config.rs
• crates/hero_compute_server/src/heartbeat_sender.rs
• crates/hero_compute_server/src/main.rs
• crates/hero_compute_ui/src/server.rs
• docs/api.md
• docs/configuration.md
• docs/setup.md
• docs/testing.md
• scripts/install.sh

View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.

git fetch -u origin development_tfgrid:development_tfgrid

git switch development_tfgrid

Merge

Merge the changes and update on Forgejo.

Warning: The "Autodetect manual merge" setting is not enabled for this repository, you will have to mark this pull request as manually merged afterwards.

git switch development

git merge --no-ff development_tfgrid

git switch development_tfgrid

git rebase development

git switch development

git merge --ff-only development_tfgrid

git switch development_tfgrid

git rebase development

git switch development

git merge --no-ff development_tfgrid

git switch development

git merge --squash development_tfgrid

git switch development

git merge --ff-only development_tfgrid

git switch development

git merge development_tfgrid

git push origin development

Sign in to join this conversation.

Reviewers

No reviewers

Labels

Clear labels   

prio_critical

  

prio_low

  

type_bug

  

type_contact

  

type_issue

  

type_lead

  

type_question

  

type_story

  

type_task

No labels

prio_critical

prio_low

type_bug

type_contact

type_issue

type_lead

type_question

type_story

type_task

Milestone

Clear milestone

No items

No milestone

Projects

Clear projects

No items

No project

Assignees

Clear assignees

No assignees

1 participant

Notifications

Subscribe

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

lhumina_code/hero_compute!52

No description provided.