Multi-Site Network Infrastructure & Fortinet Security Engineering

// case study 01 · Network engineering

Multi-Site Network Infrastructure & Fortinet Security Engineering

Engineering and supporting FortiGate-protected business networks across many customer environments: site-to-site VPNs, segmentation, routing, remote access and security-service health, including interoperability with UniFi, Cisco and Meraki equipment.

StatusOngoing engineering work
My roleSystem Administrator II on an MSP technician team
ContextMany customer networks, mixed vendors

01Executive summary

Supporting business networks for a managed service provider means no two environments look alike. Firewall models, firmware, VLAN layouts, switching platforms and remote-access methods all vary from customer to customer, and every change lands on a running business.

This case study covers the recurring engineering work behind those networks and two representative scenarios: a FortiGuard connectivity degradation affecting nine FortiGate devices after a rollout, and a native VLAN mismatch between switching and firewall subinterfaces.

02Disciplines & technologies

Disciplines

  • Network engineering
  • Firewall administration
  • VPN & remote access
  • Segmentation
  • Incident response
  • Vendor interoperability

Technologies

  • FortiGate
  • FortiOS
  • FortiManager
  • FortiClient EMS
  • FortiGuard
  • IPsec
  • SSL VPN
  • SAML
  • VLANs / 802.1Q
  • Routing & NAT
  • DHCP relay
  • DNS
  • UniFi
  • Cisco
  • Meraki

03The problem

Customer networks have to stay connected and segmented while the business keeps working. When something fails it rarely announces the layer it failed at: a tunnel that will not come up, a VLAN that cannot reach its gateway, a remote user who cannot authenticate, or security services that quietly stop updating.

Each of those has a different root-cause layer, and each customer is configured differently. The work is diagnosing quickly without guessing, and changing things without creating a second outage.

04Environment & complexity

SITE A · PRIMARYSITE B · BRANCHCLOUD & REMOTEFortiGatepolicies · NAT · routingSwitchingUniFi · Cisco · MerakiServersDHCP · DNS · filesStaff VLANVoIP VLANGuest VLANUniFi gatewaysite-to-site VPNFortiGuardupdates · ratingFortiClient + EMSSAML sign-inFortiManagerIPsec tunnelremote access
Generalized topology of the kind of environment this work covers. No customer-specific addressing or configuration.
  • Multiple customer sites with different FortiGate models and firmware levels
  • Some environments centrally managed in FortiManager, others administered per device
  • Switching from UniFi, Cisco and Meraki, each with different native VLAN defaults
  • Remote access through FortiClient, with EMS and SAML-based sign-in
  • Site-to-site IPsec between FortiGates and to UniFi gateways
  • Shared services such as DHCP relayed from the firewall to central servers
Why it is complexA single firewall change affects an entire business, usually remotely and often inside a short maintenance window.

05My contributions

  • FortiGate firewall management, configuration and troubleshooting across customer sites
  • Site-to-site IPsec tunnel configuration and connectivity validation: proposals, selectors, routes and policies
  • FortiGate-to-UniFi IPsec interoperability
  • VLAN tagging, native VLAN mismatches and trunk configuration
  • Firewall policies, routing, NAT, DNS and DHCP relay
  • FortiClient EMS and SAML authentication troubleshooting for remote users
  • Work inside FortiManager-managed environments
  • FortiGuard service communication and update troubleshooting
Team contextThis work happens on a team. Escalations, approvals and larger changes involve other technicians and leadership.

06Diagnostic workflow

Scenario A · FortiGuard connectivity degradation

Following a rollout, nine FortiGate devices showed degraded FortiGuard connectivity. The key was separating two questions that look the same from the outside: can the firewall reach the internet, and are the FortiGuard services actually working?

  1. Scope itConfirm which devices and which FortiGuard services were affected, and how the timing lined up with the rollout.
  2. Reachability ≠ service healthBasic reachability to FortiGuard hostnames succeeding does not prove the services are healthy, so test the service itself.
  3. Review FortiGuard settingsCheck the anycast setting and which update servers the device was using.
  4. Exercise the update pathTrigger updates and review what the update service actually did.
  5. Adjust connectivityEvaluate changes to FortiGuard connectivity, including regional update service selection, on affected devices.
  6. Validate and recordRe-check service status per device and document what changed.
Representative FortiOS commands for this workflow
# reachability vs. service health
› execute ping service.fortiguard.net
› diagnose debug rating
# update service behavior
› diagnose autoupdate versions
› execute update-now
# connectivity settings that were evaluated
› config system fortiguard
›     set fortiguard-anycast disable
›     set update-server-location usa
› end
Verification markerThe commands above are representative of the workflow, not a transcript. The precise root cause and the final remediation for this incident are not stated because they have not been confirmed against project records.

Scenario B · Native VLAN vs. tagged subinterfaces

A multi-site switching and firewall integration issue: a switch sent a VLAN untagged as its native VLAN, while the FortiGate expected that VLAN tagged on a subinterface. The link is up, but frames land on the parent interface instead of the VLAN subinterface, so clients cannot get DHCP or reach their gateway.

SWITCH TRUNK PORTFORTIGATE INTERFACENative VLANsent untaggedVLAN 20802.1Q tag 20VLAN 10sent untagged ✕port (parent)receives untaggedvlan20expects tag 20vlan10expects tag 10 ✕lands on parent, not vlan10
Illustration of a native VLAN mismatch. VLAN IDs are examples, not customer values.
  • Both ends must agree on which VLAN, if any, is native and untagged
  • Every FortiGate VLAN subinterface ID must match the 802.1Q tag the switch sends
  • The native VLAN has to be consistent across every switch in the path; UniFi, Cisco and Meraki defaults differ
  • DHCP relay and server reachability have to follow the corrected interface
Verification markerSite details, VLAN IDs and which side was changed are generalized. The final change and its validation are pending confirmation against records.

07Challenges & decisions

Test the service, not just the path

Stopping at a successful ping would have hidden the problem. The workflow treats FortiGuard service health as its own check.

Change one variable on a small set first

Fleet changes are tried on a few devices before wider rollout, so a bad setting cannot spread to every customer at once.

Fix the tag, don’t move the problem

The VLAN fix is consistent 802.1Q tagging end to end, not a workaround like flattening the network or moving devices.

Never rely on defaults across vendors

FortiGate to UniFi tunnels need explicit IKE version, encryption, hashing, DH groups, lifetimes and matching phase 2 selectors on both sides.

Central management cuts both ways

FortiManager gives consistency, but a bad push reaches many devices. That raises the bar for testing before deployment.

08Outcomes

  • Ongoing

    Ongoing support of customer networks across FortiGate, UniFi, Cisco and Meraki environments.

  • Pending verification

    FortiGuard degradation on nine devices: diagnostic workflow carried out as described; root cause and final remediation pending confirmation.

  • Pending verification

    Native VLAN scenario: final change and validation pending confirmation.

  • Not documented

    No uptime, performance or incident-reduction figures are claimed.

09Lessons & capabilities

  • “Up” and “working” are different questions at every layer
  • Write down the expected tag on both ends before touching a trunk
  • Interop tunnels should be specified explicitly, never inherited from defaults
  • Fleet-wide changes need a test cohort and a rollback path

Capabilities demonstrated

  • IPsec design & troubleshooting
  • 802.1Q / VLAN design
  • FortiOS CLI diagnostics
  • Fortinet fleet administration
  • Multi-vendor networking
  • Incident triage