Pod connectivity issue

[henriquedanc]

Terraform Version Details

I'm creating a bare-metal environment on Ubuntu 22.04. I ran the IaC setup and install, and it finished successfully.
However, I initially noticed that DNS resolution is not working for pods (all but pods running on the first control plane node, where core-dns is also running).

This is from a (helper) pod running in the first control plane node, where core-dns is also running:

This is from the helper pod running in all other nodes:

I then tried to reach the core-dns IP from the nodes.
I can reach it from the node where it's running:

But I cannot reach it from any other nodes:

Terraform Variable File Details

No response

Ansible Variable File Details

ansible-vars-suppressed.yaml.txt
inventory-suppressed.txt

Steps to Reproduce

• Create VMs according to the requirements. I'm using Openstack and - Ubuntu 22.04.4 LTS (GNU/Linux 5.15.0-106-generic x86_64) images.
• Run IaC setup phase
• Run IaC install phase
• Test pod networking connectivity

Expected Behavior

Pod networking should work. Pods should be able to talk with each other.

Actual Behavior

Pod networking is broken. Pods cannot talk with each other.

Additional Context

I have this environment available if that would make troubleshooting easier.

References

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[henriquedanc]

Below is another test bypassing the service IP and trying a Pod IP directly.
It fails if the client pod is not in the same node as the server pod:

And below is the same test from the hosts.
The left one (that succeeds) is the host the server pod is running on. The right one is what I get from any other node.

[jarpat]

Hey @henriquedanc are you still running into this issue? Also, am I correct in assuming you are a SAS Employee?

[henriquedanc]

Hi @jarpat . Yes. And Yes :-)

[dhoucgitter]

Hi @henriquedanc, if you are comfortable doing so, please add your SAS company email address to your GitHub profile information so that we can more easily communicate with you, thanks.