Commit Graph

153 Commits

Author SHA1 Message Date
Pekka Enberg
129713018c Bring back TPC-H benchmarks 2025-06-26 10:27:46 +03:00
Pekka Enberg
2fc5c0ce5c Switch to runtime flag for enabling indexes
Makes it easier to test the feature:

```
$ cargo run --  --experimental-indexes
Limbo v0.0.22
Enter ".help" for usage hints.
Connected to a transient in-memory database.
Use ".open FILENAME" to reopen on a persistent database
limbo> CREATE TABLE t(x);
limbo> CREATE INDEX t_idx ON t(x);
limbo> DROP INDEX t_idx;
```
2025-06-26 10:07:28 +03:00
pedrocarlo
1e28e44e4e use uv run instead of uvx 2025-06-24 15:36:29 -03:00
Pekka Enberg
f01516378b Merge 'Add Pedro to email recipients for antithesis' from Pedro Muniz
I want to be notified on Antithesis test stuff. I want to understand
more how their stuff works and what fails and how in their platform.

Closes #1785
2025-06-24 16:12:31 +03:00
Nils Koch
4c7fcafe77 ci: fail on all clippy warnings 2025-06-23 19:52:13 +01:00
pedrocarlo
efc1516d7b add uv sync to all packages 2025-06-22 15:45:07 -03:00
pedrocarlo
46135e43ce use uv in github actions 2025-06-20 15:59:03 -03:00
pedrocarlo
61a102e620 add Pedro to email recipients for antithesis 2025-06-19 19:44:08 -03:00
Pekka Enberg
b2ee030846 github: Antithesis workflow fixes 2025-06-19 14:25:17 +03:00
Pekka Enberg
032a523d1d github: Add nightly Antithesis run 2025-06-19 14:22:24 +03:00
Pekka Enberg
a108f146dd github: Disable compat tests with indexes on
...failing currently.
2025-06-18 13:52:14 +03:00
Pekka Enberg
cf78479850 Merge 'github: Node 18 is EOL' from Pekka Enberg
Closes #1772
2025-06-18 13:38:50 +03:00
Pekka Enberg
581d143595 github: Disable TPC-H benchmarks from CI
With indexing disabled, TPC-H benchmarks take forever to run. Disable
them for now.
2025-06-18 08:43:54 +03:00
Pekka Enberg
5deaabb379 github: Node 18 is EOL 2025-06-18 08:38:04 +03:00
Pere Diaz Bou
34592b172c run index tests with flags instead of ignore 2025-06-17 19:33:23 +02:00
Pere Diaz Bou
de1f29dadf core_tester index fuzz tests with flag 2025-06-17 19:33:23 +02:00
Pere Diaz Bou
9ae4563bcd index_experimental flag to enable index usages
Currently indexes are the bulk of the problem with `UPDATE` and
`DELETE`, while we work on fixing those it makes sense to disable
indexing since they are not stable. We want to try to make everything
else stable before we continue with indexing.
2025-06-17 19:33:23 +02:00
Jussi Saurio
3265e0a789 adjust timeouts in ci 2025-06-10 14:16:26 +03:00
Jussi Saurio
844461d20b update and delete fixes 2025-06-10 14:16:26 +03:00
Jussi Saurio
d06bb70514 Add simulator-docker-runner for running limbo-sim in a loop on AWS 2025-06-02 15:51:29 +03:00
Pere Diaz Bou
968eeea75d Merge 'add stress test with 1 thread 10k iterations to ci' from Pere Diaz Bou
Add simple stress test run with 10k iteration to test `Delete`, `Update`
and `Insert` together.

Reviewed-by: Jussi Saurio <jussi.saurio@gmail.com>

Closes #1585
2025-05-29 14:16:56 +02:00
Pekka Enberg
8870dc38aa github: Switch JavaScript publish to Github actions
With Blacksmith runners, it errors out as follows:

```
npm notice Publishing to https://registry.npmjs.org/ with tag next and public access
npm notice publish Signed provenance statement with source and build information from GitHub Actions
npm notice publish Provenance statement published to transparency log: https://search.sigstore.dev/?logIndex=221582002
npm error code E422
npm error 422 Unprocessable Entity - PUT https://registry.npmjs.org/@tursodatabase%2flimbo - Error verifying sigstore provenance bundle: Unsupported GitHub Actions runner environment: "self-hosted". Only "github-hosted" runners are supported when publishing with provenance.
npm error A complete log of this run can be found in: /home/runner/.npm/_logs/2025-05-28T08_42_29_830Z-debug-0.log
Error: Process completed with exit code 1.
```
2025-05-28 12:22:17 +03:00
Pere Diaz Bou
67cddb4164 use blacksmith python,cache stress 2025-05-27 12:37:23 +02:00
Pere Diaz Bou
650a5b8b1a skip writing to log on CI 2025-05-27 11:31:51 +02:00
Pere Diaz Bou
cf70b7c508 run stress on blacksmith-4vcpu-ubuntu-2404 2025-05-27 11:31:51 +02:00
Pere Diaz Bou
f2bc84e4ca add stress test with 1 thread 10k iterations to ci 2025-05-27 11:31:51 +02:00
Pekka Enberg
400fe6a4fe github: Switch release workflow to use Github Actions
...the file is auto-generated by `cargo-dist` and won't run if edited manually.
2025-05-26 20:28:48 +03:00
blacksmith-sh[bot]
c08b6a8957 Migrate workflows to Blacksmith 2025-05-26 16:28:46 +00:00
Jussi Saurio
09df7e0c48 Merge 'TPC-H with criterion and nyrkio' from Pedro Muniz
Added a benchmark to bench TPC-H with criterion and have it uploaded to
Nyrkio. I did not delete the other tpc-h job because maybe someone uses
it and I'm not aware of it.

Closes #1560
2025-05-24 21:54:48 +03:00
meteorgan
3bf0ce7fb3 Add some comments for values statement 2025-05-23 22:11:34 +08:00
pedrocarlo
66f82e47f5 tpc-h with criterion and nyrkio 2025-05-23 01:32:16 -03:00
Jussi Saurio
1dc7518551 Fix labeler: checkout repo and add issues:write perm 2025-05-20 16:32:53 +03:00
PThorpe92
f7f59b4c61 Add label workflow github action 2025-05-16 11:20:14 -04:00
Pekka Enberg
a283de53a8 Merge 'Update Nyrkiö change detection to newest version' from Henrik Ingo
(Yes, I changed the name of the repo.)
Also switch back to 'cargo' for the parser, which is the original
upstream code. I created 'criterion' because I didn't realize cargo
bench spitz half of the text to stdout the other half to stderr.

Closes #1486
2025-05-16 13:35:00 +03:00
Pekka Enberg
fa9da52bcc Merge 'long fuzz tests ci on btree changes' from Pere Diaz Bou
The idea is simple, if you modify the btree, we should verify fuzz tests
with long number of iterations to decrease the chance of a regression

Closes #1502
2025-05-16 13:30:55 +03:00
Pere Diaz Bou
12ebfc1fcf wip 2025-05-16 11:52:57 +02:00
Pere Diaz Bou
852cd48aa4 uses install sqlite 2025-05-16 11:30:58 +02:00
Pere Diaz Bou
82e5597b00 long fuzz tests ci on btree changes
The idea is simple, if you modify the btree, we should verify fuzz tests
with long number of iterations to decrease the chance of a regression
2025-05-16 11:26:00 +02:00
Henrik Ingo
ba9bab983e Change Nyrkiö parameters to p=0.0001 and min=0%
This is my recommendation based on fiddling with your data. Seems
to roughly halve the number of change points.
2025-05-16 01:36:37 +03:00
Jussi Saurio
51b097fa3d perf/ci: add basic tpc-h benchmark 2025-05-15 17:09:49 +03:00
Pekka Enberg
77cc78f7d2 github: Disable setup-node yarn cache
The setup-node fails sporadically with the following error:

```
Error: Could not get yarn cache folder path for /home/runner/work/limbo/limbo/bindings/javascript/docs
```

This seems to be a known issue that's not fixed despite the issue being closed: https://github.com/actions/setup-node/issues/887

Let's disable yarn caching for setup-node in an attempt to reduce CI
failing randomly.
2025-05-15 09:13:19 +03:00
Henrik Ingo
1029cf700b Upstream 'cargo' parser doesn't work, go back to 'criterion' 2025-05-15 05:27:53 +03:00
Henrik Ingo
070b38d04f Nyrkiö Github Action requires --output-format bencher 2025-05-15 05:06:24 +03:00
Henrik Ingo
e1330f5e62 fix: p-value is not a percentage 2025-05-15 04:17:40 +03:00
Henrik Ingo
b7ed531ef0 Update Nyrkiö change detection to newest version
(Yes, I changed the name of the repo.)

Also switch back to 'cargo' for the parser, which is the original
upstream code. I created 'criterion' because I didn't realize
cargo bench spitz half of the text to stdout the other half to stderr.
2025-05-15 03:54:38 +03:00
Pekka Enberg
da3815e1cb github: Ensure rustmft is installed 2025-05-14 09:12:35 +03:00
pedrocarlo
dd5310a85e adjust workflow to install uv 2025-04-15 12:45:46 -03:00
Hiroaki Yutani
3fa1cb56a5 Update cargo-dist and switch to Astral's version 2025-04-05 09:10:48 +09:00
Pekka Enberg
64bd0c141a github: Fix JavaScript publish workflow permissions
The workflow enables npm's provenance feature, which requires write
permissions to the "id-token" on Github actions:

https://tsmx.net/npmjs-built-and-signed-on-github-actions/
2025-04-03 12:38:01 +03:00
Pekka Enberg
c61063c697 github: Fix JavaScript workflow release parsing 2025-04-03 10:03:01 +03:00