Commit Graph

37 Commits

Author SHA1 Message Date
PThorpe92
a35f8a427f Allow workflow_dispatch for all CI to allow for re-running individual jobs 2025-10-01 19:01:10 -04:00
Pekka Enberg
250ac66c36 github: Increase tpc-h-criterion timeout to 60 minutes 2025-09-28 14:16:18 +03:00
Pekka Enberg
f7bf60e856 github: Add 30 minute timeout to all jobs
We're getting hit by macOS runner concurrency limits whenever some jobs
get stuck (for example, because of a deadlock).
2025-09-26 17:45:42 +03:00
Diego Reis
e94f18610d workflow: Minor perf CI adjustments
- Use github's default runner due blacksmith's higher performance
variance - Always comment on PRs about perf variances (currently only
for people with write permissions)
2025-09-08 09:23:25 -03:00
Henrik Ingo
c4cba8b195 Fix: Rename clickbench output file limbo/turso 2025-08-12 04:56:17 +03:00
Henrik Ingo
8d9596ea41 Workflows: Update to newest Nyrkiö Github Action
I noticed on instance of the nyrkio github action was still
using the old name. Updating to nyrkio/change-detection@HEAD.
All other entries are already updaeted,
2025-07-10 17:40:34 +03:00
pedrocarlo
c5bed21dff fix python test import naming 2025-07-03 02:15:08 -03:00
Pekka Enberg
129713018c Bring back TPC-H benchmarks 2025-06-26 10:27:46 +03:00
Pekka Enberg
581d143595 github: Disable TPC-H benchmarks from CI
With indexing disabled, TPC-H benchmarks take forever to run. Disable
them for now.
2025-06-18 08:43:54 +03:00
blacksmith-sh[bot]
c08b6a8957 Migrate workflows to Blacksmith 2025-05-26 16:28:46 +00:00
pedrocarlo
66f82e47f5 tpc-h with criterion and nyrkio 2025-05-23 01:32:16 -03:00
Pekka Enberg
a283de53a8 Merge 'Update Nyrkiö change detection to newest version' from Henrik Ingo
(Yes, I changed the name of the repo.)
Also switch back to 'cargo' for the parser, which is the original
upstream code. I created 'criterion' because I didn't realize cargo
bench spitz half of the text to stdout the other half to stderr.

Closes #1486
2025-05-16 13:35:00 +03:00
Henrik Ingo
ba9bab983e Change Nyrkiö parameters to p=0.0001 and min=0%
This is my recommendation based on fiddling with your data. Seems
to roughly halve the number of change points.
2025-05-16 01:36:37 +03:00
Jussi Saurio
51b097fa3d perf/ci: add basic tpc-h benchmark 2025-05-15 17:09:49 +03:00
Henrik Ingo
1029cf700b Upstream 'cargo' parser doesn't work, go back to 'criterion' 2025-05-15 05:27:53 +03:00
Henrik Ingo
070b38d04f Nyrkiö Github Action requires --output-format bencher 2025-05-15 05:06:24 +03:00
Henrik Ingo
e1330f5e62 fix: p-value is not a percentage 2025-05-15 04:17:40 +03:00
Henrik Ingo
b7ed531ef0 Update Nyrkiö change detection to newest version
(Yes, I changed the name of the repo.)

Also switch back to 'cargo' for the parser, which is the original
upstream code. I created 'criterion' because I didn't realize
cargo bench spitz half of the text to stdout the other half to stderr.
2025-05-15 03:54:38 +03:00
Pekka Enberg
4ccfdb1639 Kill test environment
...not sure why we added it in the first place, but it spams PRs all the
time.
2025-03-27 19:46:30 +02:00
Henrik Ingo
9c170b6ed3 rust_perf.yml. Re-enable benchmarks (make bench) 2025-02-27 02:00:06 +02:00
Henrik Ingo
e6ca5b60b4 rust_perf.yml: Remove duplicate lines from merge conflict 2025-02-27 01:56:36 +02:00
Henrik Ingo
811b6df64d Add Nyrkiö to the new clickbench task 2025-02-18 20:46:20 +02:00
Henrik Ingo
633a56749a Enable Nyrkiö also on PRs. (Non-blocking mode.)
- Rename push_only.yml workflow to rust_perf.yml
- Move the 'bench' task from rust.yml to rust_perf.yml
- More Nyrkio configuration options exposed:
  Team support (everyone in gh/tursodatabase can access Nyrkiö)
  Public results
  Alerting options: Comment on PR, if change detected, don't fail task
2025-02-18 20:40:42 +02:00
Henrik Ingo
49a4d45c92 mv push_only.yml to another name in anticipation of adding PRs 2025-02-18 20:38:15 +02:00
Henrik Ingo
32e73d7fb5 Nyrkiö: Analyze limbo and sqlite3 clickbench results separately 2025-02-18 20:34:23 +02:00
Henrik Ingo
ff38d93d3e fix yml 2025-02-18 04:54:59 +02:00
Henrik Ingo
24839e6f01 Add Nyrkiö to the new clickbench task 2025-02-18 02:36:39 +02:00
Henrik Ingo
cf971cb6c2 Maybe better to turn on never-fail immediately
This allows PRs to succeed regardless of who submitted them. Feels
friendlier that way.
2025-02-18 02:36:33 +02:00
Henrik Ingo
b356a84d69 Enable Nyrkiö also on PRs. (Non-blocking mode.)
- Rename push_only.yml workflow to rust_perf.yml
- Move the 'bench' task from rust.yml to rust_perf.yml
- More Nyrkio configuration options exposed:
  Team support (everyone in gh/tursodatabase can access Nyrkiö)
  Public results
  Alerting options: Comment on PR, if change detected, don't fail task
2025-02-18 02:35:20 +02:00
Henrik Ingo
a79e75094f Rename the push_only.yml workflow in anticipation of adding PRs 2025-02-18 02:32:14 +02:00
Henrik Ingo
ba479c892f fix yml 2025-02-18 02:24:23 +02:00
Henrik Ingo
ca24400985 Without org 2025-02-18 02:21:45 +02:00
Henrik Ingo
83a7e2ec72 Add a sample cargo outputfile to use for faster testing 2025-02-18 02:21:41 +02:00
Henrik Ingo
4ae4706d34 Workflow: Use nyrkio-org 2025-02-18 02:19:48 +02:00
Henrik Ingo
3ff548b8c5 Add explicitly all alerting options to workflow yml
Set pvalue and threshold from workflow
2025-02-18 02:10:41 +02:00
Henrik Ingo
3ab99760d2 Enable Nyrkiö also for PR 2025-02-18 02:10:40 +02:00
Henrik Ingo
cdc7f0f3e9 mv push_only.yml to another name in anticipation of adding PRs 2025-02-18 02:10:40 +02:00