Pekka Enberg
c28544530e
Prepare for asynchronous I/O with page flags
...
We want to submit I/O asynchronously with io_uring, which means we can
have multiple concurrent lookups to the page that is under I/O.
Therefore, let's add three page flags: up-to-date, locked, and error, so
that the higher level layers can just look up a page, but wait if
there's I/O happening.
2023-11-18 12:19:44 +02:00
Pekka Enberg
509b322f8a
Fix build on Linux
2023-11-11 09:21:13 +02:00
Pekka Enberg
2267ee121b
Introduce Completion type
2023-11-09 21:11:48 +02:00
Pekka Enberg
76d16cb506
Fix I/O module compilation on wasm target
2023-10-24 19:05:34 +03:00
Pekka Enberg
dad0b6d627
Disable mimalloc for wasm target
2023-10-24 19:01:22 +03:00
Pekka Enberg
20eba95383
Fix get_next_record() for all pages with right-most pointer
...
The right-most pointer is always kept separate from the cells in an
interior page so let's traverse it in all cases.
2023-10-18 17:54:20 +03:00
Pekka Enberg
0e9cc6b21f
Fix full table scans
...
A full table scan missed some of the last rows because we don't consider
sibling pages when there is no parent.
2023-10-17 16:53:24 +03:00
Pekka Enberg
97185bfefc
Pin buffer into memory
...
Make sure the buffer is pinned into memory for I/O.
2023-09-30 19:24:09 +03:00
Pekka Enberg
9098744a37
Rename to Limbo
2023-09-30 15:40:35 +03:00
Pekka Enberg
de6f327a4a
Move raw buffer to I/O module
2023-09-30 14:19:55 +03:00
Pekka Enberg
1e1e096a48
Refactor I/O and storage layers
2023-09-16 09:34:17 +03:00
Pekka Enberg
b49c242266
Rename PageSource to File
2023-09-10 22:01:45 +03:00
Pekka Enberg
fe41f46bc0
I/O trait
2023-09-10 21:57:36 +03:00
Pekka Enberg
58eab38066
I/O layer cleanups
2023-09-10 21:02:23 +03:00
Pekka Enberg
72e92820d6
Share I/O ring across multiple files
2023-09-10 20:57:54 +03:00
Pekka Enberg
e08d23a008
Implement LIMIT clause
...
Note that we handle `LIMIT 0` a bit different from SQLite, which just
detects the case and generates an unconditional jump doing nothing.
Fixes #3
2023-09-10 13:42:57 +03:00
Pekka Enberg
a2202ed31e
Implement reading primary key columns
2023-09-10 13:19:17 +03:00
Pekka Enberg
28854b3606
Merge branch 'main' of github.com:penberg/lig
2023-09-10 12:43:21 +03:00
Pekka Enberg
25ab9afd65
Silence function not used warning
2023-09-10 12:43:08 +03:00
Pekka Enberg
031071d80e
Eliminate enum warning
2023-09-10 12:41:07 +03:00
Pekka Enberg
f6cbd9cd6c
Eliminate unused variables
2023-09-10 12:39:30 +03:00
Pekka Enberg
e38c816ee8
Move translate() into its own file
2023-09-10 12:37:17 +03:00
Pekka Enberg
a80fa36d1e
Fix compliation on Linux
2023-09-09 12:43:08 +03:00
Pekka Enberg
caf56bdc77
Fix build on macOS
2023-09-09 12:42:22 +03:00
Pekka Enberg
60abb68cef
io_uring support
2023-09-09 12:36:54 +03:00
Pekka Enberg
29a6c6b877
Fix benchmark compilation
2023-09-09 10:24:08 +03:00
Pekka Enberg
4a5c71ab7a
I/O interface refactoring
2023-09-09 10:22:26 +03:00
Pekka Enberg
49c19b55ab
Unify sync I/O
2023-09-08 20:27:32 +03:00
Pekka Enberg
0a942f0fd0
Implement full table scan
2023-09-07 21:59:33 +03:00
Pekka Enberg
e75fa010dc
Add tests for SerialType::try_from()
2023-09-06 22:06:29 +03:00
Pekka Enberg
7977b23ae5
Fix read_value() and read_varint() corner cases
2023-09-06 19:46:18 +03:00
Pekka Enberg
7c894f3b70
Parse BTree table interior cells
2023-09-04 21:59:00 +03:00
Pekka Enberg
0cdf54a8c7
Fix column affinity detection
...
As it turns out, column affinity is tricky in SQLite...
https://www.sqlite.org/datatype3.html#determination_of_column_affinity
2023-09-04 21:19:12 +03:00
Pekka Enberg
b113fa2d10
Fix read_varint() implementation
...
It was giving wrong results when reading a database file.
2023-09-04 21:11:11 +03:00
Pekka Enberg
9b268dcc6f
Compare performance to rusqlite
2023-09-02 21:22:38 +03:00
Pekka Enberg
f92a83d083
Switch to LRU page cache
...
Fixes #5
2023-09-02 21:12:41 +03:00
Pekka Enberg
f6f1f97171
Switch cursor lookup to use BTreeMap
...
We're storing integers into the HashMap, BTreeMap is faster because
it avoid the hash function. Furthermore, we expect only to have very few
cursors here anyway, so BTreeMap is perfect.
2023-09-02 20:59:22 +03:00
Pekka Enberg
942239fab1
Simplify ProgramState register allocation
...
...it's faster this way.
2023-09-02 20:55:20 +03:00
Pekka Enberg
f34ccb0f43
Simplify read_varint() function
...
It's in the hot path so let's get rid of the redundant `Result` return type.
2023-09-02 20:40:58 +03:00
Pekka Enberg
7784f4415d
Allocate vector with capacity in read_record()
...
...it's faster that way.
2023-09-02 20:39:15 +03:00
Pekka Enberg
9d2e7c89d7
Page cache
2023-09-02 19:32:49 +03:00
Pekka Enberg
0aca6a9caf
Improve micro-benchmarks
2023-09-02 19:24:24 +03:00
Pekka Enberg
ccee8c3336
Parse schema from database file
...
Fixes #1
2023-09-02 19:19:23 +03:00
Pekka Enberg
65d1d770b3
Switch to mimalloc
...
...it's faster.
2023-09-02 14:04:22 +03:00
Pekka Enberg
d33b70e3a8
Fix benchmark group name
2023-09-02 14:00:13 +03:00
Pekka Enberg
ef0c4f69cc
Allocate vector with capacity
...
...reduces memory allocations.
2023-09-02 13:59:41 +03:00
Pekka Enberg
2c84aae66d
Fix instruction tracing performance
2023-09-02 13:55:26 +03:00
Pekka Enberg
37baae3ed7
Benchmark
2023-09-02 13:43:07 +03:00
Pekka Enberg
ae709f04fe
Make some opcodes wait for completion
2023-09-02 13:26:44 +03:00
Pekka Enberg
60376ed3dd
Fix EXPLAIN when querying
2023-09-02 11:42:17 +03:00