OS-specific known issues

CoreOS Container Linux has reached its on May 26, 2020 and no longer receives updates. It is recommended to migrate to another Operating System as soon as possible.

CoreOS uses networkd for network configuration. By default, all interfaces are managed by networkd because of the configuration files that ship with CoreOS. Unfortunately, that includes the gateway interface created by Antrea ( by default). Most of the time, this is not an issue, but if networkd is restarted for any reason, it will cause the interface to lose its IP configuration, and all the routes associated with the interface will be deleted. To avoid this issue, we recommend that you create the following configuration files:

# may be redundant with 50-docker-veth.network (name may differ based on CoreOS version), which should not be an issue
[Match]
Driver=veth
[Link]
Unmanaged=yes

Photon OS 3.0

If your K8s Nodes are running Photon OS 3.0, you may see error messages in the antrea-agent logs like this one: "Received bundle error msg: [...]". These messages indicate that some flow entries could not be added to the OVS bridge. This usually indicates that the Kernel was not compiled with the CONFIG_NF_CONNTRACK_ZONES option, as this option was only enabled recently in Photon OS. This option is required by the Antrea OVS datapath. To confirm that this is indeed the issue, you can run the following command on one of your Nodes:

grep CONFIG_NF_CONNTRACK_ZONES= /boot/config-`uname -r`

If you do not see the following output, then it confirms that your Kernel is indeed missing this option:

After this fix, all the Antrea Agents should be running correctly. If you still experience connectivity issues, it may be because of Photon’s default firewall rules, which are quite strict by default. The easiest workaround is to accept all traffic on the gateway interface created by Antrea (antrea-gw0 by default), which enables traffic to flow between the Node and the Pod network:

Antrea provides support for Pod Traffic Shaping by leveraging the open-source maintained by the CNI project. This plugin requires the following Kernel modules: ifb, sch_tbf and sch_ingress. It seems that at the moment Photon OS 3.0 is built without the ifb Kernel module, which you can confirm by running modprobe --dry-run ifb: an error would indicate that the module is indeed missing. Without this module, Pods with the kubernetes.io/egress-bandwidth annotation cannot be created successfully. Pods with no traffic shaping annotation, or which only use the kubernetes.io/ingress-bandwidth annotation, can still be created successfully as they do not require the creation of an device.