docs: add developer docs for gpu and cloud
This commit is contained in:
181
docs/mycelium_cloud_for_devs.md
Normal file
181
docs/mycelium_cloud_for_devs.md
Normal file
@@ -0,0 +1,181 @@
|
||||
# Mycelium Cloud for Developers
|
||||
|
||||
*Developer Guide to Decentralized Cloud Computing*
|
||||
|
||||
## Overview
|
||||
Mycelium Cloud provides a comprehensive platform for deploying and managing Kubernetes clusters on the decentralized ThreeFold Grid infrastructure. This guide covers the core features and capabilities available to developers.
|
||||
|
||||
## Architecture
|
||||
|
||||
### Decentralized Infrastructure
|
||||
Mycelium Cloud deploys on ThreeFold Grid's distributed network, providing:
|
||||
- **Direct Node Access**: Each node gets a unique Mycelium IP address
|
||||
- **Cross-Node Communication**: Services communicate across nodes using Mycelium networking
|
||||
- **Secure Communication**: All traffic is encrypted through the Mycelium network
|
||||
- **No Public IPs Required**: Services accessible via Mycelium IPs
|
||||
|
||||
### Network Flow
|
||||
User Machine → Mycelium Network → Cluster Node → Service
|
||||
|
||||
### Kubernetes Management
|
||||
- **K3s Support**: Full K3s cluster deployment and management
|
||||
- **IPv6 Networking**: Mycelium peer-to-peer networking
|
||||
- **High Availability**: Multi-master cluster support
|
||||
|
||||
---
|
||||
|
||||
## Core Features
|
||||
|
||||
### Mycelium Networking
|
||||
Ultra-fast, decentralized networking inspired by nature. Mycelium Networking forms a resilient, adaptive mesh that routes around failures and optimizes for speed and security.
|
||||
|
||||
**Features:**
|
||||
- End-to-end encrypted
|
||||
- Nature-inspired
|
||||
- Direct node communication
|
||||
- Secure peer-to-peer connections
|
||||
|
||||
### Zero-Image Technology
|
||||
Metadata-driven zero-images cut artifacts up to 100x, slashing bandwidth and deployment overhead.
|
||||
|
||||
**Benefits:**
|
||||
- **Deterministic Deployments**: Cryptographic verification ensures every workload deploys exactly as intended—no tampering, no drift
|
||||
- **Multi-Workload Compatibility with Secure Boot**: Run containers, VMs, and Linux workloads anywhere with stateless secure boot and continuous verification
|
||||
- **Smart Contract-Based Deployment**: Cryptographically signed contracts orchestrate every workload with transparent, tamper-proof execution
|
||||
|
||||
### Quantum-Safe Storage (QSS)
|
||||
Quantum-resistant encryption secures data beyond the app layer so ownership and control stay yours.
|
||||
|
||||
**Features:**
|
||||
- **Self-Healing Storage System**: Autonomous recovery heals failures or corruption instantly, preserving integrity without human intervention
|
||||
- **Multi-Protocol Data Access**: Serve the same data via IPFS, S3, WebDAV, HTTP, and native file systems for seamless integration
|
||||
- **Geo-Aware Data Placement & Replication**: Define residency, redundancy, and distribution per workload while zone-to-zone replication hardens resilience
|
||||
|
||||
### Multi-Master Clusters
|
||||
High-availability Kubernetes clusters with multiple control plane nodes. Automatic failover, leader election, and zero-downtime upgrades built-in.
|
||||
|
||||
**Capabilities:**
|
||||
- **HA Control Plane**
|
||||
- **Automatic Failover**
|
||||
- **Zero-downtime Upgrades**
|
||||
|
||||
### Effortless Load Balancing & Scaling
|
||||
Mycelium Cloud automatically balances traffic and scales your services up or down based on demand. Enjoy high availability and optimal performance with zero manual intervention.
|
||||
|
||||
**Features:**
|
||||
- **Auto-scaling**
|
||||
- **Built-in load balancing**
|
||||
- **High availability**
|
||||
|
||||
### Simple Web Gateway Access
|
||||
Expose any service to the public web with a simple Kubernetes resource. No complex Ingress controllers. Domain and prefix-based routing is built-in.
|
||||
|
||||
**Benefits:**
|
||||
- **Simple configuration**
|
||||
- **Built-in routing**
|
||||
- **No ingress controllers**
|
||||
|
||||
---
|
||||
|
||||
## Getting Started
|
||||
|
||||
### 1. Account Setup
|
||||
- **Sign Up**: Create your account from signup page
|
||||
- **Verify Email**: Check your email and verify your account
|
||||
- **Add Funds**: Navigate to your dashboard and add credits to your account
|
||||
- **Add SSH Key**: Navigate to Add SSH card and upload your public SSH key
|
||||
|
||||
### 2. Deploy Your First Cluster
|
||||
- **Access Deploy**: Click "Deploy Cluster" from your dashboard
|
||||
- **Configure VMs**: Define your virtual machines:
|
||||
- Choose CPU, memory, and storage requirements
|
||||
- Select the number of master and worker nodes
|
||||
- **Select Nodes**: Choose ThreeFold Grid nodes for deployment
|
||||
- **Review & Deploy**: Confirm your configuration and deploy
|
||||
|
||||
### 3. Access Your Cluster
|
||||
|
||||
#### Download Kubeconfig
|
||||
- Go to dashboard → Clusters → Click download icon (⬇️)
|
||||
- Set kubeconfig: `export KUBECONFIG=/path/to/config`
|
||||
- Test: `kubectl get nodes`
|
||||
|
||||
#### SSH Access
|
||||
- **Find Mycelium IPs**: Check cluster details page for node IPs
|
||||
- **Download Mycelium Binary**:
|
||||
```bash
|
||||
wget https://github.com/threefoldtech/mycelium/releases/latest/download/mycelium-private-x86_64-unknown-linux-musl.tar.gz
|
||||
tar -xzf mycelium-private-x86_64-unknown-linux-musl.tar.gz
|
||||
sudo chmod +x mycelium-private
|
||||
sudo mv mycelium-private /usr/local/bin/mycelium
|
||||
```
|
||||
- **Start Mycelium**:
|
||||
```bash
|
||||
sudo mycelium --peers tcp://188.40.132.242:9651 tcp://136.243.47.186:9651 tcp://185.69.166.7:9651 tcp://185.69.166.8:9651 tcp://65.21.231.58:9651 tcp://65.109.18.113:9651 tcp://209.159.146.190:9651 tcp://5.78.122.16:9651 tcp://5.223.43.251:9651 tcp://142.93.217.194:9651
|
||||
```
|
||||
- **SSH to nodes**: `ssh root@<mycelium-ip>`
|
||||
|
||||
---
|
||||
|
||||
## Use Cases
|
||||
|
||||
### AI/ML Training
|
||||
Run GPU-accelerated workloads for deep learning and data science on demand.
|
||||
- **GPU Acceleration**
|
||||
- **Scalable Compute**
|
||||
- **Cost Optimization**
|
||||
|
||||
### Enterprise Kubernetes
|
||||
Deploy production-grade clusters with full control and no vendor lock-in.
|
||||
- **High Availability**
|
||||
- **Security**
|
||||
- **Compliance**
|
||||
|
||||
### Edge & IoT
|
||||
Leverage global nodes for low-latency edge computing and IoT applications.
|
||||
- **Low Latency**
|
||||
- **Global Distribution**
|
||||
- **Real-time Processing**
|
||||
|
||||
### DigitalMe Example
|
||||
Example of what can be done with Mycelium Cloud. With a very simple execution, the following can be deployed on k8s cluster and served on Mycelium IPs:
|
||||
|
||||
- **Cryptpad**: Encrypted document collaboration
|
||||
- **Elements**: Matrix chat (the Rust one)
|
||||
- **Stallwart**: Mail/calendar/contacts
|
||||
- **Gitea**: Git hosting and code collaboration
|
||||
- **Nextcloud**: File storage and synchronization
|
||||
- **LiveKit or Jitsi**: Video conferencing integrated with elements/nextcloud
|
||||
- **SSO**: Single Sign-On (can this be gitea as backend - later)
|
||||
|
||||
This demonstrates the platform's capability to host complex, integrated applications with minimal configuration.
|
||||
|
||||
---
|
||||
|
||||
## Key Differentiators
|
||||
|
||||
### Sovereign by Design
|
||||
Control jurisdiction, residency, and governance for every workload with transparent, verifiable operations.
|
||||
|
||||
### Secure by Default
|
||||
Cryptographic verification, secure boot, and zero-image delivery protect the entire lifecycle automatically.
|
||||
|
||||
### Ready to Scale
|
||||
Autonomous orchestration keeps the platform elastic, cost-efficient, and always available across the globe.
|
||||
|
||||
---
|
||||
|
||||
## Security Architecture
|
||||
|
||||
### Provable Sovereignty
|
||||
Assign workloads to trusted zones, verify state with cryptographic proofs, and maintain full lineage for every byte.
|
||||
|
||||
### Autonomous Zero-Trust
|
||||
Identity, policy, and attestation are enforced continuously—no manual keys, no hidden backdoors, no shared control.
|
||||
|
||||
### Planetary-Scale Resilience
|
||||
Mesh-connected infrastructure routes around failure, keeping applications responsive even when regions go dark.
|
||||
|
||||
---
|
||||
|
||||
*Mycelium Cloud - Comprehensive platform for decentralized Kubernetes deployment.*
|
||||
Reference in New Issue
Block a user