Automated testing of NFV orchestrators against carrier-grade multi-PoP scenarios using emulation-based smoke testing

EURASIP Journal on Wireless Communications and Networking

Table 1 Interfaces covered in our test suite (TS)

	ETSI	OSM	TS	Runtime
Resource: VIMs
Create		•	•	1.31 s ± 0.31 s
List		•	•	2.58 s ± 0.54 s
Resource: Single VIM
Show		•	•	1.26 s ± 0.37 s
Update		•
Delete		•	•	1.16 s ± 0.33 s
Resource: NSDs
Create	•	•	•	0.52 s ± 0.07 s
List	•	•	•	0.55 s ± 0.04 s
Resource: Single NSD
Show	•	•	•	0.54 s ± 0.09 s
Update	•	•
Delete	•	•	•	0.53 s ± 0.11 s
Resource: VNFD
Create	•	•	•	0.24 s ± 0.06 s
List	•	•	•	0.40 s ± 0.07 s
Resource: Single VNFD
Show	•	•	•	0.24 s ± 0.06 s
Update	•	•
Delete	•	•	•	0.23 s ± 0.06 s
Resource: NS
Create	•	•	•	9.35 s ± 0.51 s
List	•	•	•	9.56 s ± 0.43 s
Resource: Single NS
Show	•	•	•	9.44 s ± 0.44 s
Update	•
Scale	•	•
Create Alarm		•
Export Metric		•
Heal	•
Terminate	•	•	•	9.44 s ± 0.43 s
Resource: VNF
List		•	•	9.81 s ± 0.48 s
Resource: Single VNF
Show		•	•	9.67 s ± 0.42 s