Commit Graph

144 Commits

Author SHA1 Message Date
Jussi Saurio
d06bb70514 Add simulator-docker-runner for running limbo-sim in a loop on AWS 2025-06-02 15:51:29 +03:00
Pere Diaz Bou
968eeea75d Merge 'add stress test with 1 thread 10k iterations to ci' from Pere Diaz Bou
Add simple stress test run with 10k iteration to test `Delete`, `Update`
and `Insert` together.

Reviewed-by: Jussi Saurio <jussi.saurio@gmail.com>

Closes #1585
2025-05-29 14:16:56 +02:00
Pekka Enberg
8870dc38aa github: Switch JavaScript publish to Github actions
With Blacksmith runners, it errors out as follows:

```
npm notice Publishing to https://registry.npmjs.org/ with tag next and public access
npm notice publish Signed provenance statement with source and build information from GitHub Actions
npm notice publish Provenance statement published to transparency log: https://search.sigstore.dev/?logIndex=221582002
npm error code E422
npm error 422 Unprocessable Entity - PUT https://registry.npmjs.org/@tursodatabase%2flimbo - Error verifying sigstore provenance bundle: Unsupported GitHub Actions runner environment: "self-hosted". Only "github-hosted" runners are supported when publishing with provenance.
npm error A complete log of this run can be found in: /home/runner/.npm/_logs/2025-05-28T08_42_29_830Z-debug-0.log
Error: Process completed with exit code 1.
```
2025-05-28 12:22:17 +03:00
Pere Diaz Bou
67cddb4164 use blacksmith python,cache stress 2025-05-27 12:37:23 +02:00
Pere Diaz Bou
650a5b8b1a skip writing to log on CI 2025-05-27 11:31:51 +02:00
Pere Diaz Bou
cf70b7c508 run stress on blacksmith-4vcpu-ubuntu-2404 2025-05-27 11:31:51 +02:00
Pere Diaz Bou
f2bc84e4ca add stress test with 1 thread 10k iterations to ci 2025-05-27 11:31:51 +02:00
Pekka Enberg
400fe6a4fe github: Switch release workflow to use Github Actions
...the file is auto-generated by `cargo-dist` and won't run if edited manually.
2025-05-26 20:28:48 +03:00
blacksmith-sh[bot]
c08b6a8957 Migrate workflows to Blacksmith 2025-05-26 16:28:46 +00:00
Jussi Saurio
09df7e0c48 Merge 'TPC-H with criterion and nyrkio' from Pedro Muniz
Added a benchmark to bench TPC-H with criterion and have it uploaded to
Nyrkio. I did not delete the other tpc-h job because maybe someone uses
it and I'm not aware of it.

Closes #1560
2025-05-24 21:54:48 +03:00
meteorgan
3bf0ce7fb3 Add some comments for values statement 2025-05-23 22:11:34 +08:00
pedrocarlo
66f82e47f5 tpc-h with criterion and nyrkio 2025-05-23 01:32:16 -03:00
Jussi Saurio
4c67bdd266 Fix labeler labeling everything as Extensions-Other 2025-05-22 12:03:28 +03:00
Jussi Saurio
1dc7518551 Fix labeler: checkout repo and add issues:write perm 2025-05-20 16:32:53 +03:00
Mohamed A. Salah
9b52e42fe6 feat: revert the labler workflow 2025-05-17 13:55:42 +03:00
Mohamed A. Salah
c7871e9e27 checkout first 2025-05-17 13:32:58 +03:00
Mohamed A. Salah
fe183e8956 fix labeler correct file name extension use .yml instead of .yaml 2025-05-17 13:27:32 +03:00
PThorpe92
92185f7ba8 Add macros to list of PR labels 2025-05-16 21:43:26 -04:00
PThorpe92
a4dca99bfc Add stress path to anthithesis label workflow 2025-05-16 11:20:14 -04:00
PThorpe92
426c1c6155 Add configuration file for labeler workflow 2025-05-16 11:20:14 -04:00
PThorpe92
f7f59b4c61 Add label workflow github action 2025-05-16 11:20:14 -04:00
Pekka Enberg
a283de53a8 Merge 'Update Nyrkiö change detection to newest version' from Henrik Ingo
(Yes, I changed the name of the repo.)
Also switch back to 'cargo' for the parser, which is the original
upstream code. I created 'criterion' because I didn't realize cargo
bench spitz half of the text to stdout the other half to stderr.

Closes #1486
2025-05-16 13:35:00 +03:00
Pekka Enberg
fa9da52bcc Merge 'long fuzz tests ci on btree changes' from Pere Diaz Bou
The idea is simple, if you modify the btree, we should verify fuzz tests
with long number of iterations to decrease the chance of a regression

Closes #1502
2025-05-16 13:30:55 +03:00
Pere Diaz Bou
12ebfc1fcf wip 2025-05-16 11:52:57 +02:00
Pere Diaz Bou
852cd48aa4 uses install sqlite 2025-05-16 11:30:58 +02:00
Pere Diaz Bou
82e5597b00 long fuzz tests ci on btree changes
The idea is simple, if you modify the btree, we should verify fuzz tests
with long number of iterations to decrease the chance of a regression
2025-05-16 11:26:00 +02:00
Henrik Ingo
ba9bab983e Change Nyrkiö parameters to p=0.0001 and min=0%
This is my recommendation based on fiddling with your data. Seems
to roughly halve the number of change points.
2025-05-16 01:36:37 +03:00
Jussi Saurio
51b097fa3d perf/ci: add basic tpc-h benchmark 2025-05-15 17:09:49 +03:00
Pekka Enberg
77cc78f7d2 github: Disable setup-node yarn cache
The setup-node fails sporadically with the following error:

```
Error: Could not get yarn cache folder path for /home/runner/work/limbo/limbo/bindings/javascript/docs
```

This seems to be a known issue that's not fixed despite the issue being closed: https://github.com/actions/setup-node/issues/887

Let's disable yarn caching for setup-node in an attempt to reduce CI
failing randomly.
2025-05-15 09:13:19 +03:00
Henrik Ingo
1029cf700b Upstream 'cargo' parser doesn't work, go back to 'criterion' 2025-05-15 05:27:53 +03:00
Henrik Ingo
070b38d04f Nyrkiö Github Action requires --output-format bencher 2025-05-15 05:06:24 +03:00
Henrik Ingo
e1330f5e62 fix: p-value is not a percentage 2025-05-15 04:17:40 +03:00
Henrik Ingo
b7ed531ef0 Update Nyrkiö change detection to newest version
(Yes, I changed the name of the repo.)

Also switch back to 'cargo' for the parser, which is the original
upstream code. I created 'criterion' because I didn't realize
cargo bench spitz half of the text to stdout the other half to stderr.
2025-05-15 03:54:38 +03:00
Pekka Enberg
da3815e1cb github: Ensure rustmft is installed 2025-05-14 09:12:35 +03:00
pedrocarlo
dd5310a85e adjust workflow to install uv 2025-04-15 12:45:46 -03:00
Pere Diaz Bou
b83b51e973 remove www. prefix 2025-04-08 11:16:32 +02:00
Pere Diaz Bou
03f531417c update sqlite download version to 2025 2025-04-08 11:12:20 +02:00
Hiroaki Yutani
3fa1cb56a5 Update cargo-dist and switch to Astral's version 2025-04-05 09:10:48 +09:00
Pekka Enberg
64bd0c141a github: Fix JavaScript publish workflow permissions
The workflow enables npm's provenance feature, which requires write
permissions to the "id-token" on Github actions:

https://tsmx.net/npmjs-built-and-signed-on-github-actions/
2025-04-03 12:38:01 +03:00
Pekka Enberg
c61063c697 github: Fix JavaScript workflow release parsing 2025-04-03 10:03:01 +03:00
Pekka Enberg
4ccfdb1639 Kill test environment
...not sure why we added it in the first place, but it spams PRs all the
time.
2025-03-27 19:46:30 +02:00
Pekka Enberg
96ab7938a8 github: Bump JavaScript workflow timeout to 20 minutes 2025-03-26 15:59:00 +02:00
Pekka Enberg
9ef729f81c Initial JavaScript bindings with napi-rs 2025-03-26 13:30:13 +02:00
Pekka Enberg
6798341b05 github: Don't close issues as stale so aggressively 2025-03-24 11:49:13 +02:00
Pekka Enberg
b24a8c875b github: Fix Python release workflow 2025-03-20 08:43:38 +02:00
Pekka Enberg
d0deff2d8b github: Attempt to fix Python release workflow 2025-03-19 18:46:48 +02:00
Henrik Ingo
9c170b6ed3 rust_perf.yml. Re-enable benchmarks (make bench) 2025-02-27 02:00:06 +02:00
Henrik Ingo
e6ca5b60b4 rust_perf.yml: Remove duplicate lines from merge conflict 2025-02-27 01:56:36 +02:00
Pekka Enberg
ddee76e0fd Merge 'Enable Nyrkiö on PRs and clickbench' from Henrik Ingo
- Rename push_only.yml workflow to rust_perf.yml
- Move the 'bench' task from rust.yml to rust_perf.yml
- More Nyrkio configuration options exposed:
  Team support (everyone in gh/tursodatabase can access Nyrkiö)
  Public results
  Alerting options: Comment on PR, if change detected, don't fail task
- Add Nyrkio also to analyse results from the clickbench task

Closes #959
2025-02-26 17:37:39 +02:00
Pekka Enberg
92d19e95e7 Attempt to fix stale bot not to close issues 2025-02-24 17:22:20 +02:00