Gabriela Cervantes
b09a3f8f8e
metrics: Add parallel bandwidth limit for qemu
...
This PR adds the parallel bandwidth limit for qemu for kata metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 9aa8d1c917 )
2023-09-21 14:15:45 +02:00
Gabriela Cervantes
63e8c38a7a
metrics: Enable parallel bandwidth iperf limit
...
This PR enables the parallel bandwidth iperf limit for kata metrics.
Fixes #7989
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit af59d4bf4a )
2023-09-21 14:15:39 +02:00
Gabriela Cervantes
c78f740854
metrics: Add iperf cpu utilization limit for qemu
...
This PR adds the iperf cpu utilization limit for qemu for kata metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit cd4fd1292a )
2023-09-21 13:58:28 +02:00
Gabriela Cervantes
73e989c4b1
metrics: Add iperf value for cpu utilization
...
This PR adds the iperf value for cpu utilization for kata metrics.
Fixes #7936
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit df5cd10ea0 )
2023-09-21 13:58:13 +02:00
Gabriela Cervantes
97283b18b4
metrics: Increase jitter value for qemu
...
This PR increases the jitter value for qemu for kata metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 49e2fa189c )
2023-09-21 13:50:31 +02:00
Gabriela Cervantes
3c5bd8c44d
metrics: Increase value limit for jitter in clh
...
This PR increases the value limit for jitter in clh.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 49234433a7 )
2023-09-21 13:50:25 +02:00
Gabriela Cervantes
31c3d9bd80
metrics: Add iperf bandwidth value for qemu
...
This PR adds the iperf bandwidth value for qemu for kata metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 0aa073967d )
2023-09-21 13:49:45 +02:00
Gabriela Cervantes
40ae855f0e
metrics: Add iperf bandwidth value for kata metrics
...
This PR adds the iperf bandwidth value for kata metrics.
Fixes #7924
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 615c1cbf19 )
2023-09-21 13:49:35 +02:00
Gabriela Cervantes
deadacd58f
metrics: Ensure docker is running in init_env
...
This PR ensures that docker is running as part of the init_env function
in kata metrics to avoid failures like docker is not running and making
the kata metrics CI to fail.
Fixes #7898
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit d53eb73eec )
2023-09-21 13:49:28 +02:00
Gabriela Cervantes
31c33f9c1c
metrics: Add Cassandra Metrics documentation
...
This PR adds the Cassandra Metrics documentation for kata metrics.
Fixes #7922
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit ad08321b83 )
2023-09-21 13:49:21 +02:00
David Esparza
0968bf1eb9
metrics: this PR skips the FIO test temprarily to fix issues
...
FIO test is showing ongoing issues when running in k8s.
Working on running FIO on the ctr client which has been
shown to be stable.
Fixes : #7920
Signed-off-by: David Esparza <david.esparza.borquez@intel.com >
(cherry picked from commit a58ea66592 )
2023-09-21 13:48:24 +02:00
Gabriela Cervantes
9f510d059b
metrics: Remove warning from metrics documentation
...
Now that the metrics migration from the tests to kata containers has been completed, this PR removes the warning from the main metrics documentation.
Fixes #7894
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 060499dcae )
2023-09-21 13:45:31 +02:00
David Esparza
053308eefc
metrics: fix FIO test initialization
...
This PR changes the order in which the FIO test first
cleans the environment and then checks if the environment
is indeed clean.
Fixes : #7869
Signed-off-by: David Esparza <david.esparza.borquez@intel.com >
(cherry picked from commit adfea55b8f )
2023-09-21 13:41:12 +02:00
Gabriela Cervantes
92fdaf9719
metrics: Use TensorFlow optimized image
...
This PR replaces the ubuntu image for one which has TensorFlow optimized
for kata metrics.
Fixes #7866
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 3a427795ea )
2023-09-21 13:39:40 +02:00
Gabriela Cervantes
374e77d330
metrics: Add write 95 percentile for FIO for qemu
...
This PR adds the write 95 percentile for FIO for qemu for
checkmetrics for kata metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 438fbf9669 )
2023-09-21 13:38:33 +02:00
Gabriela Cervantes
22ce1671a6
metrics: Add write 95 percentile FIO value
...
This PR adds the write 95 percentile FIO value for checkmetrics
for kata metrics.
Fixes #7842
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 024b4d2ffe )
2023-09-21 13:38:26 +02:00
Gabriela Cervantes
5e90c8e176
metrics: Add checkmetrics to gha run script
...
This PR adds the checkmetrics to gha run script.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit e98e5cdea2 )
2023-09-21 13:38:18 +02:00
Gabriela Cervantes
651b89ba41
metrics: Add checkmetrics value for qemu for iperf
...
This PR adds the checkmetrics value for qemu for iperf benchmark.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit c1edfe5511 )
2023-09-21 13:38:07 +02:00
Gabriela Cervantes
907baa3464
metrics: Add jitter value for clh
...
This PR adds jitter value for clh for iperf metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 6a79ecedf9 )
2023-09-21 13:38:00 +02:00
Gabriela Cervantes
d9408a7283
metrics: Add test selector to iperf metrics
...
This PR adds test selector to iperf metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit f609a9a754 )
2023-09-21 13:37:54 +02:00
Gabriela Cervantes
3583f373f5
metrics: Enable iperf benchmark on gha for kata metrics
...
This PR enables the iperf benchmark to run on the gha for kata metrics.
Fixes #7575
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 5b8db30422 )
2023-09-21 13:37:46 +02:00
David Esparza
4403af74ec
metrics: re-enable memory-usage initialization step
...
This PR re-enables the initialization step disabled
on 538c965c2b .
Fixes : #7804
Signed-off-by: David Esparza <david.esparza.borquez@intel.com >
(cherry picked from commit b151cfd140 )
2023-09-21 13:35:59 +02:00
David Esparza
d2d7c041f3
metrics: fix parsing issue on memory-usage test
...
This PR fixes an issues in the parsing results stage,
by collecting just the n-results from the n-running
containers, discarding irrelevant data.
Fixes : #7774
Signed-off-by: David Esparza <david.esparza.borquez@intel.com >
(cherry picked from commit 538c965c2b )
2023-09-21 13:35:49 +02:00
Gabriela Cervantes
75dcca5a53
metrics: Add grabdata script for metrics report
...
This PR adds the grabdata script so it can be used for the metrics report
for kata metrics.
Fixes #7812
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 6668825752 )
2023-09-21 13:30:07 +02:00
Gabriela Cervantes
8f1cc278ca
metrics: Add report generator link to general documentation
...
This PR adds the report generator link to general documentation.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 9f21fa9b39 )
2023-09-21 13:29:37 +02:00
Gabriela Cervantes
05180b61a0
metrics: Add README for kata metrics report
...
This PR adds the README for kata metrics report.
Fixes #7802
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit c0ed5ea0ad )
2023-09-21 13:29:29 +02:00
Gabriela Cervantes
17c88a1a7f
metrics: Add limit for 90 percentile for qemu value
...
This PR adds the limit for 90 percentile for qemu value for
FIO kata metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit a7b59a5bf9 )
2023-09-21 13:29:21 +02:00
Gabriela Cervantes
dbb4761c4b
metrics: Add limit for write 90 percentile value for clh
...
This PR adds the limit for write 90 percentile value for clh for
FIO metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 99db6568e9 )
2023-09-21 13:29:15 +02:00
Gabriela Cervantes
aebf392e45
metrics: Enable FIO limits for kata metrics
...
This PR enables the FIO limits for kata metrics.
Fixes #7771
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 6e06392c55 )
2023-09-21 13:29:09 +02:00
Gabriela Cervantes
41d05b8857
metrics: Fix memory footprint qemu limit
...
This PR fixes the memory footprint qemu limit for kata metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit c8dd3c0737 )
2023-09-21 13:28:59 +02:00
Gabriela Cervantes
3491407581
metrics: Fix memory inside limits for kata metrics
...
This PR fixes the memory inside limit for clh for kata metrics due
to the recent changes that we had in the script which impacted
in the performance measurement.
Fixes #7786
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 8877ec62fb )
2023-09-21 13:28:50 +02:00
Gabriela Cervantes
08027f2282
metrics: Add test setup details to metrics report
...
This PR adds test setup details to metrics report.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 7e364716dd )
2023-09-21 13:28:35 +02:00
Gabriela Cervantes
99103db1fb
metrics: Add boot lifecycle times to metrics report
...
This PR adds the boot lifecycle times to metrics report.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 17dc1b9760 )
2023-09-21 13:28:29 +02:00
Gabriela Cervantes
75c92ba474
metrics: Add memory inside container to metrics report
...
This PR adds memory inside container to metrics report.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 3b0d6538f2 )
2023-09-21 13:28:22 +02:00
Gabriela Cervantes
1c1eb98107
metrics: Add scaling system footprint in metrics report
...
This PR adds scaling system footprint in metrics report.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 79fbb9d243 )
2023-09-21 13:28:16 +02:00
Gabriela Cervantes
01f6e6a1a3
metrics: Add metrics reportgen
...
This PR adds metrics reportgen for kata metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 8e6d4e6f3d )
2023-09-21 13:28:10 +02:00
Gabriela Cervantes
428eb6908d
metrics: Add report file titles
...
This PR adds report file titles for kata metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 139ffd4f75 )
2023-09-21 13:28:04 +02:00
Gabriela Cervantes
a8fa3d99da
metrics: Generate PNGs alongside the PDF report
...
This PR generates the PNGs for the kata metrics PDF report.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 878d1a2e7d )
2023-09-21 13:27:58 +02:00
Gabriela Cervantes
80625ed573
metrics: Add metrics report R files
...
This PR adds the metrics report R files.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit fce2487971 )
2023-09-21 13:27:52 +02:00
Gabriela Cervantes
9f8e194e6f
metrics: Add report dockerfile
...
This PR adds the report dockerfile for kata metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 08812074d1 )
2023-09-21 13:27:46 +02:00
Gabriela Cervantes
03c206f87f
metrics: Add metrics report script
...
This PR adds metrics report script for kata metrics.
Fixes #7782
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 69781fc027 )
2023-09-21 13:27:40 +02:00
Gabriela Cervantes
3e07c89d39
metrics: Remove unused variable in tensorflow nhwc script
...
This PR removes unused variable in tensorflow nhwc script.
Fixes #7750
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 32a778b6da )
2023-09-21 13:25:56 +02:00
Gabriela Cervantes
7421737229
metrics: Add TensorFlow ResNet50 fp32 Dockerfile
...
This PR adds the TensorFlow ResNet50 fp32 Dockerfile for kata metrics.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 959ca49447 )
2023-09-21 13:25:10 +02:00
Gabriela Cervantes
9acbf2faf7
metrics: Add TensorFlow ResNet50 FP32 benchmark
...
This PR adds TensorFlow ResNet50 FP32 benchmark for kata metrics.
Fixes #7735
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 4b7d72c4a8 )
2023-09-21 13:25:03 +02:00
Gabriela Cervantes
6ea1d3bffd
metrics: Add disk link to README
...
This PR adds disk link to README documentation for kata metrics.
Fixes #7721
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 8afd158cef )
2023-09-21 13:24:35 +02:00
Gabriela Cervantes
ad2036927f
metrics: Fix FIO path
...
This PR fixes the FIO path for the FIO files.
Fixes #7711
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit eee2ee6eeb )
2023-09-21 13:24:06 +02:00
Gabriela Cervantes
abcb225ce3
metrics: Use function from metrics common in pytorch script
...
This PR uses a common function into the pytorch script.
Fixes #7709
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 39bc3488f5 )
2023-09-21 13:23:58 +02:00
David Esparza
d46c300608
metrics: Enable kata runtime in K8s for FIO test.
...
This PR configures the corresponding kata runtime in K8s
based on the tested hypervisor.
This PR also enables FIO metrics test in the kata metrics-ci.
Fixes : #7665
Signed-off-by: David Esparza <david.esparza.borquez@intel.com >
(cherry picked from commit fb571f8be9 )
2023-09-21 13:23:36 +02:00
Gabriela Cervantes
3d3882a06a
metrics: Update tensorflow name in gha run script
...
This PR update tensorflow name in gha run script.
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit 85c02828e1 )
2023-09-21 13:23:17 +02:00
Gabriela Cervantes
7d0a3dbf24
metrics: Fix check results for tensorflow benchmark
...
This PR fixes the check results for tensorflow benchmark now
that we change the name of the test.
Fixes #7684
Signed-off-by: Gabriela Cervantes <gabriela.cervantes.tellez@intel.com >
(cherry picked from commit e8a5119343 )
2023-09-21 13:23:09 +02:00