David Esparza
2defdcc598
Merge pull request #7579 from dborquez/simplify_gha_metrics_workflow
...
metrics: install kata once and run multiple checks
2023-08-09 14:45:09 -06:00
David Esparza
473b0d3a31
metrics: compute tensorflow statistics
...
This PR computes average results for TF bench.
Additionally, it improves the data parsing from
all running containers.
Fixes : #7603
Signed-off-by: David Esparza <david.esparza.borquez@intel.com >
2023-08-09 14:42:30 -06:00
Fabiano Fidêncio
eb463b38ec
ci: unencrypted-image: Don't fail to build on s390x
...
Let's make sure that we don't fail in case we're building non x86_64.
Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com >
2023-08-09 20:32:36 +02:00
Gabriela Cervantes
d1a6296221
metrics: Add nginx documentation to network README
...
This PR adds nginx documentation to network README for kata metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-08-09 16:17:46 +00:00
Gabriela Cervantes
498f7c0549
metrics: Add nginx kubernetes yaml
...
This PR adds the nginx kubernetes yaml.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-08-09 16:14:04 +00:00
Gabriela Cervantes
f8a5255cf7
metrics: Add network nginx benchmark
...
This PR adds the network nginx benchmark for kata metrics.
Fixes #7605
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-08-09 16:12:21 +00:00
Fabiano Fidêncio
5cdf981a2b
Merge pull request #7596 from fidencio/topic/create-image-to-be-used-by-the-confidential-tests
...
tests: Create image that will be used in the unencrypted confidential tests
2023-08-09 17:06:07 +02:00
Fabiano Fidêncio
c932369f42
Merge pull request #7492 from fidencio/topic/adapt-tests-to-the-new-kata-deploy-env-vars
...
kata-deploy: Ensure we cover SHIMS / DEFAULT_SHIM as part of our tests
2023-08-09 12:55:03 +02:00
Fabiano Fidêncio
034d7aab87
tests: k8s: Ensure the runtime classes are properly created
...
With these 2 simple checks we can ensure that we do not regress on the
behaviour of allowing the runtime classes / default runtime class to be
created by the kata-deploy payload.
Fixes : #7491
Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com >
2023-08-09 11:46:04 +02:00
Fabiano Fidêncio
ab5f603ffa
ci: k8s: Add the image used for unencrypted confidential tests
...
Let's add here the image we'll be using for unencrypted confidential
tests. Later on, we'll make sure to build and use this image as part of
our CI.
The image can easily be built as a multi-arch image, and has `cpuid`
installed in case of `x86_64` build, so it can be used to detect whether
we're running on a TEE guest without having to rely on `dmesg | grep
...`.
Fixes : #7595
Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com >
2023-08-09 11:33:18 +02:00
Fabiano Fidêncio
1e8fe131bd
k8s: tests: Take advantage of SHIMS and DEFAULT_SHIM env vars
...
We don't have to do any sed to replace the runtimeclass being used by
the moment we start taking advantage of the `DEFAULT_SHIM` environment
variable exposed merged in the previous commits.
Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com >
2023-08-09 11:15:34 +02:00
Unmesh Deodhar
aeaec9dae9
tests: upgrade bats version
...
Instead of using package manager to install bats, building
this from source. This gives us the updated version of bats
which supports functions such as setup_file and
teardown_file.
We can use these functions into our current tests.
Fixes : #7597
Signed-off-by: Unmesh Deodhar <udeodhar@amd.com >
2023-08-08 18:16:39 -05:00
David Esparza
e664969862
metrics: install kata once and run multiple checks
...
This PR changes the metrics workflow in order to just install
kata once, and run the checks for multiple hypervisor variations.
In this way we save time avoiding installing kata for each
hypervisor to be tested.
Fixes : #7578
Signed-off-by: David Esparza <david.esparza.borquez@intel.com >
2023-08-08 10:25:13 -06:00
Chelsea Mafrica
553fd79ea9
Merge pull request #7572 from GabyCT/topic/resnet50fp32
...
metrics: General improvements to mobilenet tensorflow test
2023-08-07 13:33:28 -07:00
Gabriela Cervantes
863283716d
metrics: General improvements to mobilenet tensorflow test
...
This PR renames the mobilenet tensorflow test to have a more specific
tensorflow name mainly because tensorflow has different configurations
and we will add more tensorflow tests so we want to distinguish each
tensorflow test.
Fixes #7571
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-08-07 16:50:00 +00:00
Gabriela Cervantes
3c319d8d4c
metrics: Add iperf to gha run script
...
This PR adds iperf to gha run script.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-08-07 16:20:00 +00:00
GabyCT
7144acb2a5
Merge pull request #7527 from GabyCT/topic/latency
...
metrics: Add network latency test
2023-08-04 15:54:07 -06:00
Gabriela Cervantes
66db5b5350
metrics: Add latency test to network README
...
This PR adds latency test to network README for kata metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-08-04 20:27:27 +00:00
David Esparza
1e15369e59
metrics: Improve naming testing containers in launch times test
...
This commit provides a new way to name the containers used
in the launch-times-test in this form:
'kata_launch_times_RANDOM_NUMBER', where RANDOM_NUMBER is
in the 0-1000 range.
Fixes : #7529
Signed-off-by: David Esparza <david.esparza.borquez@intel.com >
2023-08-02 17:04:55 -06:00
David Esparza
5dbe88330f
metrics: Clean kata components before start a metric test.
...
This PR kills all kata components before start a new
metric test.
Fixes : #7528
Signed-off-by: David Esparza <david.esparza.borquez@intel.com >
2023-08-02 17:04:51 -06:00
David Esparza
542012c8be
Merge pull request #7503 from GabyCT/topic/ghafio
...
metrics: Add FIO test to gha for kata metrics CI
2023-08-02 10:05:09 -06:00
David Esparza
5979f3790b
Merge pull request #7516 from GabyCT/topic/addiperf
...
metrics: Add iperf3 network test
2023-08-02 10:04:51 -06:00
Fabiano Fidêncio
29855ed0c6
Merge pull request #7510 from fidencio/topic/ci-k8s-aks-do-not-fail-gathering-info
...
ci: k8s: Do not fail when gathering info on AKS nodes
2023-08-02 09:44:19 +02:00
Gabriela Cervantes
ad6e53c399
metrics: Modify boot time values
...
This PR modifies boot time values limit.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-08-01 23:34:15 +00:00
Gabriela Cervantes
f764248095
gha: Add FIO test to run metrics yaml
...
This PR adds FIO test to run metrics yaml.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-08-01 20:29:16 +00:00
Gabriela Cervantes
58f9a57c20
metrics: Add network reference to general README metrics
...
This PR adds network reference to the general metrics README.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-08-01 16:54:00 +00:00
Gabriela Cervantes
07694ef3ae
metrics: Add Kata Containers network metrics README
...
This PR adds the Kata Containers network metrics README.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-08-01 16:49:09 +00:00
Gabriela Cervantes
d8439dba89
metrics: Add iperf3 deployment yaml
...
This PR adds the iperf3 deployment yaml.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-08-01 16:45:01 +00:00
Gabriela Cervantes
bda83cee5d
metrics: Add iperf3 daemonset for k8s
...
This PR adds the iperf3 daemonset for k8s.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-08-01 16:42:15 +00:00
Gabriela Cervantes
badff23c71
metrics: Add iperf3 service yaml for k8s
...
This PR adds the iperf3 service yaml for k8s.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-08-01 16:37:19 +00:00
Gabriela Cervantes
27c02367f9
metrics: Add iperf3 network test
...
This PR adds the iperf3 benchmark test for kata metrics.
Fixes #7515
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-08-01 16:30:46 +00:00
GabyCT
a0a524efc2
Merge pull request #7486 from kata-containers/topic/addsysbench
...
metrics: Add sysbench performance test
2023-08-01 10:17:48 -06:00
Fabiano Fidêncio
f910c66d6f
ci: k8s: Do not fail when gathering info on AKS nodes
...
Otherwise the VM deletion may not delete, leaving us with several
machines behind.
Fixes : #7509
Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com >
2023-08-01 12:36:33 +02:00
Gabriela Cervantes
6328181762
metrics: Add k8s sysbench documentation
...
This PR adds k8s sysbench documentation at general density documentation.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-31 20:28:37 +00:00
Gabriela Cervantes
8933d54428
metrics: Add FIO to gha run script
...
This PR adds FIO to gha run script.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-31 17:51:11 +00:00
Gabriela Cervantes
8a584589ff
metrics: Add DAX FIO README
...
This PR adds DAX FIO README information.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-31 17:42:44 +00:00
Gabriela Cervantes
21f5b65233
metrics: Add FIO information in storage general README
...
This PR adds FIO information in storage general README.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-31 17:33:39 +00:00
Gabriela Cervantes
69f05cf9e6
metrics: Add FIO general README
...
This PR adds FIO general README information.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-31 17:30:05 +00:00
Gabriela Cervantes
87d41b3dfa
metrics: Add FIO test to gha for kata metrics CI
...
This PR adds FIO test to gha for kata metrics CI.
Fixes #7502
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-31 16:50:16 +00:00
Gabriela Cervantes
5a1b5d3672
metrics: Add sysbench pod yaml
...
This PR adds the sysbench pod yaml for the sysbench performance test.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 20:03:15 +00:00
Gabriela Cervantes
ad413d1646
metrics: Add sysbench dockerfile
...
This PR adds sysbench dockerfile.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 19:58:10 +00:00
Gabriela Cervantes
1512560111
metrics: Add sysbench performance test
...
This PR adds the sysbench performance test for kata CI.
Fixes #7485
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 19:54:12 +00:00
Gabriela Cervantes
bee1a628bd
metrics: Fix json result for tensorflow
...
This PR fixes the json result for tensorflow.i
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 17:02:16 +00:00
Gabriela Cervantes
51cd99c927
metrics: Round axelnet and resnet results
...
This PR rounds the axelnet and resnet results in order to extract
properly the result.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 16:15:22 +00:00
Gabriela Cervantes
3b883bf5a7
metrics: Fix atoi invalid syntax
...
This PR will avoid to have the strconv.atoi parsing error when we
are retrieving the results from the json.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 16:15:22 +00:00
Gabriela Cervantes
f9dec11a8f
checkmetrics: Move checkmetrics to gha-run script
...
This PR moves the checkmetrics to gha-run script to gathered
tensorflow information.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 16:15:22 +00:00
Gabriela Cervantes
53af71cfd0
checkmetrics: Add AlexNet value for qemu
...
This PR adds AlexNet value for qemu for checkmetrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 16:15:22 +00:00
Gabriela Cervantes
a435d36fe1
checkmetrics: Add Resnet value for qemu
...
This PR adds the Resnet value for qemu for checkmetrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 16:15:22 +00:00
Gabriela Cervantes
a79a3a8e1d
checkmetrics: Add alexnet value for clh
...
This PR adds the AlexNet value for clh for checkmetrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 16:15:22 +00:00
Gabriela Cervantes
3c32875046
checkmetrics: Add Resnet value for clh
...
This PR adds the checkmetrics Resnet value for clh.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
2023-07-28 16:15:22 +00:00