gpuai.shop
Networking

Two networks, different jobs

Every node sits on a public interface for pulling data and serving traffic, and on a private fabric used for collective operations between GPUs.

Public interface

  • BandwidthUp to 25 Gbps
  • Public IPv41 included
  • Additional IPv4$2 / month
  • IPv6/64 included
  • IngressFree
  • Egress, first 10 TBFree
  • Egress thereafter$0.01 / GB
  • DDoS mitigationAlways on

Compute fabric

  • TechnologyNDR InfiniBand
  • Per port400 Gbps
  • Ports per SXM node8
  • Aggregate per node3.2 Tbps
  • TopologyRail-optimised fat tree
  • Non-blocking pod512 GPUs
  • Intra-nodeNVLink 900 GB/s
  • Traffic chargedNever

Firewall defaults

New instances accept inbound connections on port 22 only. Everything else is dropped at the edge until you open it, either in the console or through the API. Outbound traffic is unrestricted.

This catches the most common mistake in GPU rental: exposing a Jupyter notebook on port 8888 with no token to the open internet. If you need it reachable, open the port deliberately and put authentication in front of it.

Private networking

Instances within a region and account can talk over a private /24 with no configuration. Traffic on that network never leaves the facility and is not metered.

Cross-region private links and VPC peering back to your own cloud account are available on enterprise agreements. Ask us about it.

Bandwidth in practice

The number that usually matters is not peak throughput but how long it takes to get a dataset onto the box. At 25 Gbps, a 500 GB dataset lands in roughly three minutes if the source can keep up — in practice the bottleneck is almost always the other end, not us.

For repeated runs against the same data, put it on a persistent volume once rather than pulling it each time. The volume attaches in seconds and costs less than the egress you would spend re-downloading.