round-robin Load balancing for tfgrid stacks #96

New Issue

mik-tf · 2024-08-27T16:41:29Z

mik-tf commented

2024-08-27 16:41:29 +00:00

Situation

As explained and developed on GH issue: https://github.com/threefoldtech/grid_deployment/issues/56

Status

WIP: Bert is on it and doing great progress.
- Now compiling geoip2 into caddy and more tests

Update

Will keep this issue updated

Load balancing and certifications

host a small but truly geo garage cluster that exposes an S3 endpoint at 3 locations and one or more gateways
store any cert of (in this case geo forwarders) x amount of nodes that need to share it in some way (via an S3 caddy plugin).
- certs need to be shared to cancel out the SPOF, and to offer more then one location to be forwarded from
- specs: random and cyclical as per round-robin, i.e. can't check geolocation, but regions are possible (see below)

Future Phase

Once this issue is done, we can have new issues for future phase. See below.

Add functionality of zone records

# Situation - As explained and developed on GH issue: https://github.com/threefoldtech/grid_deployment/issues/56 # Status - WIP: Bert is on it and doing great progress. - Now compiling geoip2 into caddy and more tests # Update - Will keep this issue updated # Load balancing and certifications - host a small but truly geo garage cluster that exposes an S3 endpoint at 3 locations and one or more gateways - store any cert of (in this case geo forwarders) x amount of nodes that need to share it in some way (via an S3 caddy plugin). - certs need to be shared to cancel out the SPOF, and to offer more then one location to be forwarded from - specs: random and cyclical as per round-robin, i.e. can't check geolocation, but regions are possible (see below) # Future Phase Once this issue is done, we can have new issues for future phase. See below. - Add functionality of zone records

mik-tf added the

Story

label 2024-08-27 16:41:29 +00:00

mik-tf added this to the tfgrid_3_15 project 2024-08-27 16:41:29 +00:00

mik-tf changed title from ~~Load balancer for tfgrid validators~~ to round-robin Load balancing for tfgrid stacks

2024-08-27 16:47:40 +00:00

mik-tf commented

2024-09-30 17:34:16 +00:00

Update

The geoforwarder + basic load balancing part is done. We need to clarify how to set HTTPS now.

Status

WIP
- @coesensb is finalizing the HTTPS part, see below

Specs

Geoforwarder
- 3 options: https://github.com/threefoldtech/grid_deployment/issues/56#issuecomment-2379452618
- the user is directed to the closest dashboard among the available dashboards: be, us, sg, fin, etc.
Load balancing
- Round robin at DNS provider level for each geoforwarder
HTTPS: the geoforwarder needs to direct user to proper dashboard URLs, via HTTPS
- setup: 3 instances of the geo-forwarder with DSN round-robin, set with HTTPS
  - every server needs access to certificate
    - we need shared storage across endpoint
      - Option: S3 server garage node on every endpoint
        
        Notes: we want it as FOSS as possible, but first we need that it WORKS :)

# Update The geoforwarder + basic load balancing part is done. We need to clarify how to set HTTPS now. # Status - WIP - @coesensb is finalizing the HTTPS part, see below # Specs - Geoforwarder - 3 options: https://github.com/threefoldtech/grid_deployment/issues/56#issuecomment-2379452618 - the user is directed to the closest dashboard among the available dashboards: be, us, sg, fin, etc. - Load balancing - Round robin at DNS provider level for each geoforwarder - HTTPS: the geoforwarder needs to direct user to proper dashboard URLs, via HTTPS - setup: 3 instances of the geo-forwarder with DSN round-robin, set with HTTPS - every server needs access to certificate - we need shared storage across endpoint - Option: S3 server garage node on every endpoint - Notes: we want it as FOSS as possible, but first we need that it WORKS :)

Sign in to join this conversation.