pedrocarlo
c5bed21dff
fix python test import naming
2025-07-03 02:15:08 -03:00
Pekka Enberg
129713018c
Bring back TPC-H benchmarks
2025-06-26 10:27:46 +03:00
Pekka Enberg
581d143595
github: Disable TPC-H benchmarks from CI
...
With indexing disabled, TPC-H benchmarks take forever to run. Disable
them for now.
2025-06-18 08:43:54 +03:00
blacksmith-sh[bot]
c08b6a8957
Migrate workflows to Blacksmith
2025-05-26 16:28:46 +00:00
pedrocarlo
66f82e47f5
tpc-h with criterion and nyrkio
2025-05-23 01:32:16 -03:00
Pekka Enberg
a283de53a8
Merge 'Update Nyrkiö change detection to newest version' from Henrik Ingo
...
(Yes, I changed the name of the repo.)
Also switch back to 'cargo' for the parser, which is the original
upstream code. I created 'criterion' because I didn't realize cargo
bench spitz half of the text to stdout the other half to stderr.
Closes #1486
2025-05-16 13:35:00 +03:00
Henrik Ingo
ba9bab983e
Change Nyrkiö parameters to p=0.0001 and min=0%
...
This is my recommendation based on fiddling with your data. Seems
to roughly halve the number of change points.
2025-05-16 01:36:37 +03:00
Jussi Saurio
51b097fa3d
perf/ci: add basic tpc-h benchmark
2025-05-15 17:09:49 +03:00
Henrik Ingo
1029cf700b
Upstream 'cargo' parser doesn't work, go back to 'criterion'
2025-05-15 05:27:53 +03:00
Henrik Ingo
070b38d04f
Nyrkiö Github Action requires --output-format bencher
2025-05-15 05:06:24 +03:00
Henrik Ingo
e1330f5e62
fix: p-value is not a percentage
2025-05-15 04:17:40 +03:00
Henrik Ingo
b7ed531ef0
Update Nyrkiö change detection to newest version
...
(Yes, I changed the name of the repo.)
Also switch back to 'cargo' for the parser, which is the original
upstream code. I created 'criterion' because I didn't realize
cargo bench spitz half of the text to stdout the other half to stderr.
2025-05-15 03:54:38 +03:00
Pekka Enberg
4ccfdb1639
Kill test environment
...
...not sure why we added it in the first place, but it spams PRs all the
time.
2025-03-27 19:46:30 +02:00
Henrik Ingo
9c170b6ed3
rust_perf.yml. Re-enable benchmarks (make bench)
2025-02-27 02:00:06 +02:00
Henrik Ingo
e6ca5b60b4
rust_perf.yml: Remove duplicate lines from merge conflict
2025-02-27 01:56:36 +02:00
Henrik Ingo
811b6df64d
Add Nyrkiö to the new clickbench task
2025-02-18 20:46:20 +02:00
Henrik Ingo
633a56749a
Enable Nyrkiö also on PRs. (Non-blocking mode.)
...
- Rename push_only.yml workflow to rust_perf.yml
- Move the 'bench' task from rust.yml to rust_perf.yml
- More Nyrkio configuration options exposed:
Team support (everyone in gh/tursodatabase can access Nyrkiö)
Public results
Alerting options: Comment on PR, if change detected, don't fail task
2025-02-18 20:40:42 +02:00
Henrik Ingo
49a4d45c92
mv push_only.yml to another name in anticipation of adding PRs
2025-02-18 20:38:15 +02:00
Henrik Ingo
32e73d7fb5
Nyrkiö: Analyze limbo and sqlite3 clickbench results separately
2025-02-18 20:34:23 +02:00
Henrik Ingo
ff38d93d3e
fix yml
2025-02-18 04:54:59 +02:00
Henrik Ingo
24839e6f01
Add Nyrkiö to the new clickbench task
2025-02-18 02:36:39 +02:00
Henrik Ingo
cf971cb6c2
Maybe better to turn on never-fail immediately
...
This allows PRs to succeed regardless of who submitted them. Feels
friendlier that way.
2025-02-18 02:36:33 +02:00
Henrik Ingo
b356a84d69
Enable Nyrkiö also on PRs. (Non-blocking mode.)
...
- Rename push_only.yml workflow to rust_perf.yml
- Move the 'bench' task from rust.yml to rust_perf.yml
- More Nyrkio configuration options exposed:
Team support (everyone in gh/tursodatabase can access Nyrkiö)
Public results
Alerting options: Comment on PR, if change detected, don't fail task
2025-02-18 02:35:20 +02:00
Henrik Ingo
a79e75094f
Rename the push_only.yml workflow in anticipation of adding PRs
2025-02-18 02:32:14 +02:00
Henrik Ingo
ba479c892f
fix yml
2025-02-18 02:24:23 +02:00
Henrik Ingo
ca24400985
Without org
2025-02-18 02:21:45 +02:00
Henrik Ingo
83a7e2ec72
Add a sample cargo outputfile to use for faster testing
2025-02-18 02:21:41 +02:00
Henrik Ingo
4ae4706d34
Workflow: Use nyrkio-org
2025-02-18 02:19:48 +02:00
Henrik Ingo
3ff548b8c5
Add explicitly all alerting options to workflow yml
...
Set pvalue and threshold from workflow
2025-02-18 02:10:41 +02:00
Henrik Ingo
3ab99760d2
Enable Nyrkiö also for PR
2025-02-18 02:10:40 +02:00
Henrik Ingo
cdc7f0f3e9
mv push_only.yml to another name in anticipation of adding PRs
2025-02-18 02:10:40 +02:00