Integration Test Results by Device

These devices are fully tested in each software release:

Device Provider Passed Not
supported
Crashed Config
failed
Validation
failed
Caveats
arubacx clab 1
libvirt 127 34 8
bird clab 68 41
cat8000v clab 1
libvirt 154 14 4
csr clab 1
libvirt 159 15 5
dellos10 libvirt 127 38 4
eos clab 186 18 1
libvirt 12 3 1
frr clab 185 13
libvirt 1
iol clab 155 14 3
ioll2 clab 163 18 4
iosv clab 1
libvirt 150 17 1
iosvl2 clab 1
libvirt 155 19 1
linux clab 12 36
libvirt 7 28
srlinux clab 106 50 2
sros clab 115 67
srsim clab 115 68
vjunos-router clab 108 43 1
vjunos-switch clab 128 52 1
vptx clab 1
libvirt 109 48 1
vyos clab 130 44 2
libvirt 134 44 1 4

Notes:

We try to do our best to support these devices, but we can't do miracles. However, we do run tests whenever we make a change in device configuration template or device definitions.

Device Provider Passed Not
supported
Crashed Config
failed
Validation
failed
Caveats
cumulus libvirt 145 35 2
cumulus_nvue libvirt 101 42
nxos clab 1
libvirt 82 44
openbsd libvirt 20 35
routeros7 libvirt 51 42 2 8 2
sonic libvirt 11 14 1

We don't test these devices. It might not be worth it, or they are too slow to boot, or it's impossible to get a decent device image, or the vendor concocted some crazy evaluation/licensing restrictions.

Feature Coverage

Feature Passed Caveat Validation
failed
Configuration
failed
Crashed
Initial configuration 141 5
OSPFv2 207 1 1
OSPFv3 212 9 1
BGP 322 4 1
BGP sessions 165 2
BGP policies 58
EBGP multihop 32
IS-IS 115
EIGRP 14
RIPv2/RIPng 67 6
Routing Policies 122
Routing Filters 48
Static Routes 88 3 1
VLANs 321 2 3
VRFs 327 1 2
VXLAN 69 1
EVPN 161 3
MPLS (LDP, VPN) 105 2
SR-MPLS 36 8
DHCPv4/v6 71 1
First-hop gateway 35 3
Link aggregation (LAG) 40 2
Spanning Tree (STP) 43

Platform Features Integration Test Results

Feature Passed Not
supported
Crashed Config
failed
Validation
failed
clab 2
components 1
libvirt 3
multiprovider 3
unmanaged 3