Integration Test Results by Device

These devices are fully tested in each software release:

Device Provider Passed Not
supported
Crashed Config
failed
Validation
failed
Caveats
arubacx libvirt 128 35 8
bird clab 68 41
cat8000v libvirt 155 15 4
csr libvirt 161 16 4
dellos10 libvirt 130 37 4
eos clab 187 18 1
libvirt 11 3 1
frr clab 186 12 1
iol clab 156 15 3
ioll2 clab 164 19 4
iosv libvirt 151 18 1
iosvl2 libvirt 156 20 1
linux clab 12 35
libvirt 6 27 1
srlinux clab 107 50 2
sros clab 116 68
srsim clab 115 68 1
vjunos-router clab 110 44 1
vjunos-switch clab 129 53 1
vptx libvirt 111 49 1
vyos clab 133 42 2
libvirt 138 42 4

Notes:

We try to do our best to support these devices, but we can't do miracles. However, we do run tests whenever we make a change in device configuration template or device definitions.

Device Provider Passed Not
supported
Crashed Config
failed
Validation
failed
Caveats
cumulus libvirt 148 35 2
cumulus_nvue libvirt 101 42
nxos libvirt 82 43
openbsd libvirt 6 19
routeros7 libvirt 51 42 2 8 2
sonic libvirt 11 14 1

We don't test these devices. It might not be worth it, or they are too slow to boot, or it's impossible to get a decent device image, or the vendor concocted some crazy evaluation/licensing restrictions.

Feature Coverage

Feature Passed Caveat Validation
failed
Configuration
failed
Crashed
Initial configuration 124 5
OSPFv2 203 1 1
OSPFv3 209 8 1
BGP 322 4 1
BGP sessions 166 1
BGP policies 96
EBGP multihop 32
IS-IS 115
EIGRP 14
RIPv2/RIPng 67 6
Routing Policies 122
Routing Filters 48
Static Routes 88 3 1
VLANs 321 2 3
VRFs 327 1 2
VXLAN 69 1
EVPN 157 3 1
MPLS (LDP, VPN) 106 1
SR-MPLS 36 8
DHCPv4/v6 70 2
First-hop gateway 35 3
Link aggregation (LAG) 40 2
Spanning Tree (STP) 43

Platform Features Integration Test Results

Feature Passed Not
supported
Crashed Config
failed
Validation
failed
clab 2
components 1
libvirt 3
multiprovider 3
unmanaged 3