merge development into main branch #29

Merged

rawdaGastan merged 38 commits from development into main 2026-03-04 11:47:01 +00:00

Conversation 1 Commits 38 Files changed 74 +9229 -3475

rawdaGastan commented 2026-03-04 11:46:10 +00:00

Owner

Copy link

No description provided.

rawdaGastan added 38 commits 2026-03-04 11:46:10 +00:00

add rhai bindings and some examples 286f74cb3a

Cleanup: remove legacy code_from_herolib, duplicate README, sync versions ... 5dade6c59b

- Remove code_from_herolib/ directory (legacy herolib integration)
- Remove duplicate 'README MyFS.md' (consolidated into README.md)
- Add FEATURE_VERIFICATION.md (feature testing guide)
- Sync frontend version to 0.2.0 to match backend

Refactor: Clean architecture for client/server separation ... 31993063d8

Major changes:
- ServerStore now properly uses client-provided hash for block storage
- Server block upload API now accepts optional hash, file_hash, and idx params
- Added upload_block_simple() for simplified blob storage without file tracking
- Unified block size to 512KB across pack.rs, upload.rs, and server
- Added DEFAULT_BLOCK_SIZE constant in lib.rs
- Simplified publish_website() to use upload_dir() internally
- Added documentation clarifying encrypted (pack) vs unencrypted (upload) paths

Architecture:
- Server is now a pure key-value blob store (zero-knowledge capable)
- Client handles all encryption/decryption via BlockStore wrapper
- File structure tracked only in client-side flist metadata
- Two clear modes: encrypted pack/unpack vs simple upload/download

Always create flist when uploading directories ... fb9fbd9e94

- Remove --create-flist flag from upload-dir command (always create flist)
- Simplify upload_dir() to always use pack() with encryption
- Remove unused collect_files() function
- Update publish_website() to delegate to upload_dir()
- This ensures all uploaded directories have proper metadata and encryption

Add comprehensive test suite and acceptance matrix ... d1532856e0

New test files:
- tests/core_tests.rs: 17 tests covering encryption, deduplication,
  pack/unpack edge cases (symlinks, permissions, special filenames,
  large files, empty dirs, nested dirs), DirStore, Router
- tests/cli_tests.rs: 12 tests covering CLI help commands, error
  handling, and integration roundtrips (binary, many files, deep dirs)
- tests/server_api_tests.rs: 8 tests (4 run, 4 ignored requiring server)
  covering error handling for corrupt blocks/flists/truncated data

ACCEPTANCE_MATRIX.md: Documents all test cases organized by category
with current coverage status (~48% overall, ~85% for unit tests)

Test coverage summary:
- Encryption & Security: 100% (5/5)
- Core Operations: 92% (12/13)
- CLI Commands: 100% (8/8)
- DirStore: 75% (3/4)
- Router: 67% (2/3)
- Edge Cases: 43% (3/7)
- Integration: 60% (6/10)

Total: 62 tests, 56 passing, 6 ignored (need external services)

Add Makefile for project automation ... b57079cd10

Provides targets for:
- Build: build, build-release, lib, check, clean
- Test: test, test-all, test-core, test-cli, test-server, test-verbose
- Code Quality: fmt, fmt-check, lint, lint-fix
- Documentation: doc, doc-open
- Development: install, run-server, watch, watch-test
- CI/CD: ci, validate, release, dist
- Examples: pack-example, unpack-example
- Docker: docker-build, docker-run

Run 'make help' for full command list.

Add container and FUSE mount tests ... 6ae976bc6a

New test file: tests/container_mount_tests.rs (10 tests)
- Container tests (4): alpine conversion, filesystem structure,
  CLI help, invalid image handling
- Mount tests (5): CLI help, invalid flist, invalid mountpoint,
  container flist unpack, full mount cycle (ignored - needs FUSE)
- Integration test (1): full container flow (busybox → flist → unpack)

Updated ACCEPTANCE_MATRIX.md:
- Added Container Conversion section (K1-K5): 100% coverage
- Added FUSE Mount section (U1-U7): 43% coverage (rest needs FUSE)
- Extended CLI section with container/mount help tests
- Overall coverage: ~53% (50 of 96 test cases)
- Unit tests without external deps: ~90% coverage

Updated Makefile:
- Added test-container target (requires podman)
- Added test-mount target
- Updated help text

Add multi-runtime container support (podman/docker/nerdctl) ... 4951c8f978

Container runtime detection:
- Added ContainerRuntime enum with Podman, Docker, Nerdctl variants
- ContainerRuntime::detect() finds first available runtime
- ContainerRuntime::is_available() checks if runtime is functional
- ContainerImageToFlist::with_runtime() allows specifying runtime
- ContainerImageToFlist::new() auto-detects runtime

Updated all container functions to use runtime parameter:
- pull_image(), create_container(), export_container()
- clean_container(), clean_image(), write_startup_toml()

Updated tests:
- is_container_runtime_available() replaces is_podman_available()
- Tests print which runtime is being used
- container_test.rs uses with_runtime() for explicit runtime

This allows users with docker or nerdctl (but not podman) to use
container-to-flist conversion.

docs: Add system requirements for FUSE mount and debug builds ... 8ced03684b

- Add System Requirements section to README with:
  - Stack size requirements for debug builds (ulimit -s unlimited)
  - FUSE mount prerequisites (fuse3 package, user_allow_other config)
- Add module-level documentation in main.rs with requirements
- Update Mount command help text to mention FUSE requirements
- Add helpful error context in fs/mod.rs for mount failures

The FUSE on-demand filesystem requires:
1. fuse3 package installed
2. /etc/fuse.conf with 'user_allow_other' uncommented
3. Debug builds need unlimited stack size due to async runtime overhead

docs: Add system requirements for FUSE mount and debug builds ... 62495991f5

- Add System Requirements section to README with:
  - Stack size requirements for debug builds (ulimit -s unlimited)
  - FUSE mount prerequisites (fuse3 package, user_allow_other config)
- Add module-level documentation in main.rs with requirements
- Update Mount command help text to mention FUSE requirements
- Add helpful error context in fs/mod.rs for mount failures

The FUSE on-demand filesystem requires:
1. fuse3 package installed
2. /etc/fuse.conf with 'user_allow_other' uncommented
3. Debug builds need unlimited stack size due to async runtime overhead

update with parallel unpacking and refine the tests 64a335e28f

fix fmt and tests 765f6587e9

Add build_lib build system with Makefile and updated workflows ... a0f9fddef6

Replace manual workflow scripts with build_lib pattern: buildenv.sh for
config, scripts/build_lib.sh for shared logic, Makefile for dev targets.
Add Linux ARM64 cross-compilation and macOS build workflows.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Fix Makefile cargo and shell compatibility ... 289cf64857

Add SHELL := /bin/bash to use bash instead of sh (enables source command)
Add CARGO_ENV helper to ensure cargo is in PATH before running cargo commands

This fixes exit code 127 errors in CI/CD environments where cargo might not
be in the default PATH.

Applies to all cargo-using targets: build, check, fmt, fmt-check, lint,
run, test, test-all, clean, installdev, deps.

Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>

[BUG] Refactor recursive tree traversal to avoid Stack Overflow 0d47b7dbd8

[SECURITY] Prevent Path Traversal in website_handlers abbc34b3f6

[ENHANCEMENT] Make server concurrency/timeouts configurable 453c6d48f1

[ROBUSTNESS] Implement atomic metadata writes (Write-Rename pattern) 7f81d772b6

[FUSE] Complete Error to Errno mapping for filesystem mounts a9f84b5700

[SECURITY] Insecure AES-GCM nonce usage in website_handlers 2e699fb63c

[SECURITY] Timing Attack Vulnerability in Authentication cdd4319a8f

[RELIABILITY] Unbounded Temporary File Creation in website_handlers 1450ed81e5

sync: Cargo.lock a0d75870fe

Update Cargo.lock with dependency version bumps ... fd02b4535a

Includes updates to anyhow, async-compression, bumpalo, clap,
compression-codecs, deranged, syn, and other transitive dependencies.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Merge branch 'development' into development_bugs cc6ae63c88

Merge pull request 'development_bugs' (#24) from development_bugs into development ... af96e64704

Reviewed-on: #24
Reviewed-by: thabeta <thabeta@incubaid.com>

follow consistent error structure across all crate modules a08590f553

Merge branch 'development' of https://forge.ourworld.tf/geomind_code/my_fs into development_consistent_bugs cc9e7b8038

Merge branch 'development' of https://forge.ourworld.tf/geomind_code/my_fs into develop_xmon fee52d394f

fix parallel functions and tests 3870c30109

Merge branch 'development' of https://forge.ourworld.tf/geomind_code/my_fs into main_rhai_bindings c8261b9584

undo different nonce changes ff6d42bc36

Merge pull request 'follow consistent error structure across all crate modules' (#25) from development_consistent_bugs into development ... d48671cc74

Reviewed-on: #25
Reviewed-by: thabeta <thabeta@incubaid.com>

Merge branch 'development' of https://forge.ourworld.tf/geomind_code/my_fs into develop_xmon 293e1e9a4c

Merge pull request 'develop_xmon' (#10) from develop_xmon into development ... 72b369e54c

Reviewed-on: #10
Reviewed-by: rawdaGastan <fawzyr@incubaid.com>

Merge branch 'development' of https://forge.ourworld.tf/geomind_code/my_fs into main_rhai_bindings dd710fc295

fix examples b3ba4da991

Merge pull request 'add rhai bindings and some examples' (#3) from main_rhai_bindings into development ... cdf44d0c11

Reviewed-on: #3
Reviewed-by: thabeta <thabeta@incubaid.com>

thabeta approved these changes 2026-03-04 11:46:49 +00:00

rawdaGastan merged commit 128492eb7f into main 2026-03-04 11:47:01 +00:00

rawdaGastan referenced this pull request from a commit 2026-03-04 11:47:02 +00:00

Merge pull request 'merge development into main branch' (#29) from development into main

Sign in to join this conversation.

Reviewers

No reviewers

thabeta

Labels

Clear labels

No items

No labels

Milestone

Clear milestone

No items

No milestone

Projects

Clear projects

No items

No project

Assignees

Clear assignees

No assignees

2 participants

Notifications

Subscribe

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

geomind_code/my_fs!29

No description provided.