Integration Test Results by Device

These devices are fully tested in each software release:

Device Provider Passed Not
supported
Crashed Config
failed
Validation
failed
Caveats
arubacx libvirt 128 35 8
bird clab 68 41
cat8000v libvirt 155 15 4
csr libvirt 161 16 4
dellos10 libvirt 130 37 4
eos clab 187 18 1
libvirt 11 3 1
frr clab 186 12 1
iol clab 156 15 3
ioll2 clab 164 19 4
iosv libvirt 151 18 1
iosvl2 libvirt 156 20 1
linux clab 12 35
libvirt 6 27 1
srlinux clab 107 50 2
sros clab 116 68
vjunos-router clab 110 44 1
vjunos-switch clab 129 53 1
vptx libvirt 111 49 1
vyos clab 133 42 2
libvirt 138 42 4

Notes:

We try to do our best to support these devices, but we can't do miracles. However, we do run tests whenever we make a change in device configuration template or device definitions.

Device Provider Passed Not
supported
Crashed Config
failed
Validation
failed
Caveats
cumulus libvirt 148 35 2
cumulus_nvue libvirt 101 42
nxos libvirt 82 43
openbsd libvirt 6 19
routeros7 libvirt 51 42 2 8 2
sonic libvirt 11 14 1

We don't test these devices. It might not be worth it, or they are too slow to boot, or it's impossible to get a decent device image, or the vendor concocted some crazy evaluation/licensing restrictions.

Feature Coverage

Feature Passed Caveat Validation
failed
Configuration
failed
Crashed
Initial configuration 120 5
OSPFv2 197 1 1
OSPFv3 202 8 1
BGP 311 4 1
BGP sessions 162 1
BGP policies 93
EBGP multihop 30
IS-IS 108
EIGRP 14
RIPv2/RIPng 63 6
Routing Policies 120
Routing Filters 48
Static Routes 88 3 1
VLANs 306 2 3
VRFs 315 1 2
VXLAN 64 1
EVPN 145 3
MPLS (LDP, VPN) 99 1
SR-MPLS 32 8
DHCPv4/v6 70 2
First-hop gateway 35 3
Link aggregation (LAG) 40 2
Spanning Tree (STP) 43

Platform Features Integration Test Results

Feature Passed Not
supported
Crashed Config
failed
Validation
failed
clab 2
components 1
libvirt 3
multiprovider 3
unmanaged 3