Skip to content

Commit f09c8d7

Browse files
committed
OCPBUGS-55174: Updated the changing-cluster-network-mtu file with NIC info
1 parent 5e58cf3 commit f09c8d7

File tree

2 files changed

+49
-55
lines changed

2 files changed

+49
-55
lines changed

modules/nw-cluster-mtu-change.adoc

Lines changed: 46 additions & 55 deletions
Original file line numberDiff line numberDiff line change
@@ -23,8 +23,7 @@ ifndef::outposts[= Changing the cluster network MTU]
2323
ifdef::outposts[= Changing the cluster network MTU to support AWS Outposts]
2424

2525
ifdef::outposts[]
26-
During installation, the maximum transmission unit (MTU) for the cluster network is detected automatically based on the MTU of the primary network interface of nodes in the cluster.
27-
You might need to decrease the MTU value for the cluster network to support an AWS Outposts subnet.
26+
During installation, the maximum transmission unit (MTU) for the cluster network is detected automatically based on the MTU of the primary network interface of nodes in the cluster. You might need to decrease the MTU value for the cluster network to support an AWS Outposts subnet.
2827
endif::outposts[]
2928

3029
ifndef::outposts[As a cluster administrator, you can increase or decrease the maximum transmission unit (MTU) for your cluster.]
@@ -72,60 +71,59 @@ Status:
7271

7372
ifndef::local-zone,wavelength-zone,post-aws-zones,outposts[]
7473
. Prepare your configuration for the hardware MTU:
75-
76-
** If your hardware MTU is specified with DHCP, update your DHCP configuration such as with the following dnsmasq configuration:
74+
+
75+
.. If your hardware MTU is specified with DHCP, update your DHCP configuration such as with the following dnsmasq configuration:
7776
+
7877
[source,text]
7978
----
80-
dhcp-option-force=26,<mtu>
79+
dhcp-option-force=26,<mtu> <1>
8180
----
81+
<1> Where `<mtu>` specifies the hardware MTU for the DHCP server to advertise.
82+
+
83+
.. If your hardware MTU is specified with a kernel command line with PXE, update that configuration accordingly.
84+
+
85+
.. If your hardware MTU is specified in a NetworkManager connection configuration, complete the following steps. This approach is the default for {product-title} if you do not explicitly specify your network configuration with DHCP, a kernel command line, or some other method. Your cluster nodes must all use the same underlying network configuration for the following procedure to work unmodified.
8286
+
83-
--
84-
where:
85-
86-
`<mtu>`:: Specifies the hardware MTU for the DHCP server to advertise.
87-
--
88-
89-
** If your hardware MTU is specified with a kernel command line with PXE, update that configuration accordingly.
90-
91-
** If your hardware MTU is specified in a NetworkManager connection configuration, complete the following steps. This approach is the default for {product-title} if you do not explicitly specify your network configuration with DHCP, a kernel command line, or some other method. Your cluster nodes must all use the same underlying network configuration for the following procedure to work unmodified.
92-
9387
... Find the primary network interface by entering the following command:
94-
9588
+
9689
[source,terminal]
9790
----
98-
$ oc debug node/<node_name> -- chroot /host nmcli -g connection.interface-name c show ovs-if-phys0
91+
$ oc debug node/<node_name> -- chroot /host nmcli -g connection.interface-name c show ovs-if-phys0 <1>
9992
----
93+
<1> where `<node_name>` specifies the name of a node in your cluster.
10094
+
101-
--
102-
where:
103-
104-
`<node_name>`:: Specifies the name of a node in your cluster.
105-
--
106-
107-
... Create the following NetworkManager configuration in the `<interface>-mtu.conf` file:
95+
... Create the following NetworkManager configuration in the `<interface>-mtu.conf` file.
10896
+
10997
.Example NetworkManager connection configuration
11098
[source,ini]
11199
----
112100
[connection-<interface>-mtu]
113-
match-device=interface-name:<interface>
114-
ethernet.mtu=<mtu>
101+
match-device=interface-name:<interface> <1>
102+
ethernet.mtu=<mtu> <2>
115103
----
104+
<1> Where `<interface>` specifies the primary network interface name.
105+
<2> Where `<mtu>` specifies the new hardware MTU value.
116106
+
117-
--
118-
where:
119-
120-
`<mtu>`:: Specifies the new hardware MTU value.
121-
`<interface>`:: Specifies the primary network interface name.
122-
--
107+
[NOTE]
108+
====
109+
For nodes that use 2 network interface controller (NIC) bonds, specify the primary NIC bond and the secondary NIC Bond `<interface>-mtu.conf` file.
123110

124-
... Create two `MachineConfig` objects, one for the control plane nodes and another for the worker nodes in your cluster:
111+
.Example NetworkManager connection configuration
112+
[source,ini]
113+
----
114+
[connection-<primary-bond-interface>-mtu]
115+
match-device=interface-name:<bond-iface-name>
116+
ethernet.mtu=9000
125117
126-
.... Create the following Butane config in the `control-plane-interface.bu` file:
118+
[connection-<secondary-bond-interface>-mtu]
119+
match-device=interface-name:<bond-slave-iface-name>
120+
ethernet.mtu=9000
121+
----
122+
====
127123
+
128-
[source,yaml, subs="attributes+"]
124+
... Create the following Butane config in the `control-plane-interface.bu` file, which is the `MachineConfig` object for the control plane nodes:
125+
+
126+
[source,yaml,subs="attributes+"]
129127
----
130128
variant: openshift
131129
version: {product-version}.0
@@ -142,10 +140,10 @@ storage:
142140
----
143141
<1> Specify the NetworkManager connection name for the primary network interface.
144142
<2> Specify the local filename for the updated NetworkManager configuration file from the previous step.
145-
146-
.... Create the following Butane config in the `worker-interface.bu` file:
147143
+
148-
[source,yaml, subs="attributes+"]
144+
... Create the following Butane config in the `worker-interface.bu` file, which is the `MachineConfig` object for the compute nodes:
145+
+
146+
[source,yaml,subs="attributes+"]
149147
----
150148
variant: openshift
151149
version: {product-version}.0
@@ -162,8 +160,8 @@ storage:
162160
----
163161
<1> Specify the NetworkManager connection name for the primary network interface.
164162
<2> Specify the local filename for the updated NetworkManager configuration file from the previous step.
165-
166-
.... Create `MachineConfig` objects from the Butane configs by running the following command:
163+
+
164+
... Create `MachineConfig` objects from the Butane configs by running the following command:
167165
+
168166
[source,terminal]
169167
----
@@ -255,10 +253,9 @@ machineconfiguration.openshift.io/state: Done
255253
+
256254
[source,terminal]
257255
----
258-
$ oc get machineconfig <config_name> -o yaml | grep ExecStart
256+
$ oc get machineconfig <config_name> -o yaml | grep ExecStart <1>
259257
----
260-
+
261-
where `<config_name>` is the name of the machine config from the `machineconfiguration.openshift.io/currentConfig` field.
258+
<1> Where `<config_name>` is the name of the machine config from the `machineconfiguration.openshift.io/currentConfig` field.
262259
+
263260
The machine config must include the following update to the systemd configuration:
264261
+
@@ -269,7 +266,7 @@ ExecStart=/usr/local/bin/mtu-migration.sh
269266

270267
ifndef::local-zone,wavelength-zone,post-aws-zones,outposts[]
271268
. Update the underlying network interface MTU value:
272-
269+
+
273270
** If you are specifying the new MTU with a NetworkManager connection configuration, enter the following command. The MachineConfig Operator automatically performs a rolling reboot of the nodes in your cluster.
274271
+
275272
[source,terminal]
@@ -278,7 +275,7 @@ $ for manifest in control-plane-interface worker-interface; do
278275
oc create -f $manifest.yaml
279276
done
280277
----
281-
278+
+
282279
** If you are specifying the new MTU with a DHCP server option or a kernel command line and PXE, make the necessary changes for your infrastructure.
283280

284281
. As the Machine Config Operator updates machines in each machine config pool, it reboots each node one by one. You must wait until all the nodes are updated. Check the machine config pool status by entering the following command:
@@ -325,10 +322,9 @@ Verify that the following statements are true:
325322
+
326323
[source,terminal]
327324
----
328-
$ oc get machineconfig <config_name> -o yaml | grep path:
325+
$ oc get machineconfig <config_name> -o yaml | grep path: <1>
329326
----
330-
+
331-
where `<config_name>` is the name of the machine config from the `machineconfiguration.openshift.io/currentConfig` field.
327+
<1> Where `<config_name>` is the name of the machine config from the `machineconfiguration.openshift.io/currentConfig` field.
332328
+
333329
If the machine config is successfully deployed, the previous output contains the `/etc/NetworkManager/conf.d/99-<interface>-mtu.conf` file path and the `ExecStart=/usr/local/bin/mtu-migration.sh` line.
334330
endif::local-zone,wavelength-zone,post-aws-zones,outposts[]
@@ -339,14 +335,9 @@ endif::local-zone,wavelength-zone,post-aws-zones,outposts[]
339335
+
340336
----
341337
$ oc patch Network.operator.openshift.io cluster --type=merge --patch \
342-
'{"spec": { "migration": null, "defaultNetwork":{ "ovnKubernetesConfig": { "mtu": <mtu> }}}}'
338+
'{"spec": { "migration": null, "defaultNetwork":{ "ovnKubernetesConfig": { "mtu": <mtu> }}}}' <1>
343339
----
344-
+
345-
--
346-
where:
347-
348-
`<mtu>`:: Specifies the new cluster network MTU that you specified with `<overlay_to>`.
349-
--
340+
<1> Where: `<mtu>` specifies the new cluster network MTU that you specified with `<overlay_to>`.
350341

351342
. After finalizing the MTU migration, each machine config pool node is rebooted one by one. You must wait until all the nodes are updated. Check the machine config pool status by entering the following command:
352343
+

networking/changing-cluster-network-mtu.adoc

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,10 @@ toc::[]
99
[role="_abstract"]
1010
As a cluster administrator, you can change the MTU for the cluster network after cluster installation. This change is disruptive as cluster nodes must be rebooted to finalize the MTU change.
1111

12+
// About the cluster MTU
1213
include::modules/nw-cluster-mtu-change-about.adoc[leveloffset=+1]
14+
15+
// Changing the cluster network MTU or Changing the cluster network MTU to support AWS Outposts
1316
include::modules/nw-cluster-mtu-change.adoc[leveloffset=+1]
1417

1518
[role="_additional-resources"]

0 commit comments

Comments
 (0)