aljaz/turso
1
0
Fork 0
mirror of https://github.com/aljazceru/turso.git synced 2025-12-21 02:14:18 +01:00
Code Issues Packages Projects Releases Wiki Activity
7,776 Commits 1 Branch 0 Tags
aa7f8fbfc485dd54545b84d82de1a173f3397cdb
Commit Graph

185 Commits

Author SHA1 Message Date
Piotr Sarna
d5eec5d528 cursor: add MVCCScanCursorPosition 2023-05-11 14:11:10 +02:00
Piotr Sarna
582bf14934 database: keep rows in BTreeMap 
We need ordering libSQL-side.
 2023-05-11 13:38:38 +02:00
Piotr Sarna
e8bdfc8e7a cursor, read: update pointers to *mut u8 2023-05-11 13:35:19 +02:00
Piotr Sarna
54ee330912 cursor: add closing cursor 
... which also terminates the read transaction open for scanning.
 2023-05-11 12:13:27 +02:00
Piotr Sarna
5bdcfc9924 cursor: handle current() graciously when there's no data 2023-05-11 11:08:43 +02:00
Piotr Sarna
ef097362ff mvcc, bindings: expose a scan cursor 2023-05-10 15:48:46 +02:00
Pekka Enberg
57b5919637 Merge pull request #35 from penberg/recovery 
Initial support for recovery
 2023-05-10 13:28:16 +03:00
Pekka Enberg
0cf7b787fd Merge pull request #36 from penberg/readimpl 
bindings: expose reading from the database
 2023-05-10 13:22:57 +03:00
Piotr Sarna
d047a24a32 bindings: expose reading from the database 
The results are returned as a CString for now.
 2023-05-10 12:09:06 +02:00
Pekka Enberg
08adf2118c Rename mutations.png to transactions.png 2023-05-10 13:01:33 +03:00
Pekka Enberg
ec336d5578 Initial support for recovery 
We have the transaction log in persistent storage so let's implement
recovery by replaying that.
 2023-05-10 12:56:19 +03:00
Pekka Enberg
8c56b381c0 Rename mutations to log records 
The Hekaton paper talks about "log records" so let's just run with that
terminology to avoid confusion.
 2023-05-09 21:32:36 +03:00
Pekka Enberg
cf31de5d41 Fix MVCCDatabaseInsert() type signature 
Values are opaque blobs so use "const void *" for C callers.
 2023-05-09 16:14:28 +03:00
Pekka Enberg
3d0c8a415e Add stdint.h include to mvcc.h 2023-05-09 13:49:31 +03:00
Piotr Sarna
d4da54b10b mvcc: build static library for C bindings 
That's how it's currently consumed by libSQL.
 2023-05-09 10:28:26 +02:00
Pekka Enberg
f47eea1a72 Move DESIGN.md to docs 2023-05-09 11:00:00 +03:00
Pekka Enberg
b9575c4375 Rename database directory to mvcc-rs 2023-05-09 10:56:46 +03:00
Pekka Enberg
41bed41544 Improve logging 2023-05-09 10:51:14 +03:00
Pekka Enberg
5ce2bc41f9 cargo fmt 2023-05-09 10:47:43 +03:00
Pekka Enberg
b2f46e156b Improve C binding error reporting 2023-05-09 10:47:40 +03:00
Pekka Enberg
3ecb0fb2a9 Mark MVCCDatabaseOpen() as unsafe 2023-05-09 10:44:06 +03:00
Pekka Enberg
db1e313aca Silence clippy 2023-05-09 10:43:42 +03:00
Pekka Enberg
1fc99181f1 Update README.md 2023-05-09 10:42:05 +03:00
Pekka Enberg
c94561a646 Add mvcc.h to the tree 2023-05-09 10:41:33 +03:00
Pekka Enberg
779ad3066a Add error codes to C bindings 2023-05-09 10:41:13 +03:00
Pekka Enberg
34a4f1a269 Improve generated C bindings 
Before:

```c
typedef LocalClock Clock;

typedef JsonOnDisk Storage;

typedef DatabaseInner<Clock, Storage> Inner;

typedef Database<Clock, Storage, Mutex<Inner>> Db;

typedef struct {
  Db db;
  Runtime runtime;
} DbContext;

extern "C" {

DbContext *mvccrs_new_database(const char *path);

void mvccrs_free_database(Db *db);

int32_t mvccrs_insert(DbContext *db, uint64_t id, const uint8_t *value_ptr, uintptr_t value_len);

} // extern "C"

```

After:

```c

typedef struct DbContext DbContext;

typedef const DbContext *MVCCDatabaseRef;

extern "C" {

MVCCDatabaseRef MVCCDatabaseOpen(const char *path);

void MVCCDatabaseClose(MVCCDatabaseRef db);

int32_t MVCCDatabaseInsert(MVCCDatabaseRef db, uint64_t id, const uint8_t *value_ptr, uintptr_t value_len);

} // extern "C"

```
 2023-05-09 10:34:11 +03:00
Pekka Enberg
124446f17c Generate C header file on cargo build 2023-05-09 10:34:11 +03:00
Pekka Enberg
d5b96d5edf Move C bindings to separate crate 2023-05-09 10:34:11 +03:00
Piotr Sarna
488201cab2 add c_bindings feature for exposing functions to C 
The library can now be compiled to a static or dynamic
native lib, with very basic functionality exposed.
 2023-05-08 14:20:34 +02:00
Pekka Enberg
aac835fce9 Document persistent storage design (#24) 2023-05-06 20:15:08 +02:00
Piotr Sarna
fb6ce70993 database: add dropping unused row versions 
When a row version is not visible by any transactions,
active or future ones, it should be dropped.
 2023-04-20 15:47:36 +02:00
Piotr Sarna
2a018ea9a3 fixup: move DatabaseError under a feature 2023-04-20 15:47:36 +02:00
Piotr Sarna
b6b36a0d94 fixup: implement Stream for JsonOnDiskStream under a feature 2023-04-20 14:46:14 +02:00
Piotr Sarna
04a78f73fb treewide: add persistent storage trait 
This draft adds a persistent storage trait that can be used
to store transaction logs and read the log for recovery purposes.
Work in heavy progress, because ideally the design should also
allow reading versions from the storage, so that data can be
spilled from memory to disk if there's not enough RAM available.
 2023-04-17 14:46:39 +02:00
Piotr Sarna
7ca68b3d96 errors: Add I/O error class 2023-04-17 12:06:34 +02:00
Piotr Sarna
db71c7e4e3 database: make transactions (de)serializable 2023-04-17 12:06:22 +02:00
Pekka Enberg
74a4d2d11a Garbage collect transactions 
Fixes #2
 2023-04-15 09:53:56 +03:00
Pekka Enberg
43544c9fb6 Update README.md 2023-04-14 21:32:31 +03:00
Pekka Enberg
c0881944e0 Update README.md 2023-04-14 21:31:19 +03:00
avi
87b9b27215 check if tx can see its own updates 2023-04-14 22:56:07 +05:30
avi
e006177480 fix typos 2023-04-14 22:06:55 +05:30
avi
aff901baea bugfix: make committed rows visibile (fixes #15) 2023-04-14 21:59:35 +05:30
Piotr Sarna
546db5a983 sync: add AsyncMutex trait 
With AsyncMutex, we can use different mutex mechanisms
in the database - e.g. tokio::sync::Mutex.
 2023-04-14 15:09:13 +02:00
Piotr Sarna
bfe3bcef71 asyncify 
In order to prepare for #3, the APIs are made asynchronous.
It also applies to tests and benches.
 2023-04-14 15:08:51 +02:00
Pekka Enberg
620b8c6362 Update README.md 2023-04-14 14:43:28 +03:00
Pekka Enberg
9247e44324 Minimize library binary size 
Shrinks binary size from 319K to 282K.
 2023-04-14 14:07:49 +03:00
Pekka Enberg
b8b8d3f746 Remove rustyline dependency 
It's not needed, likely leftover from some previous prototyping.
 2023-04-14 14:02:02 +03:00
Pekka Enberg
4a98d32ce1 Update README.md 2023-04-14 13:52:55 +03:00
Pekka Enberg
5f84604d67 Add some more micro-benchmarks 2023-04-14 13:50:24 +03:00
Pekka Enberg
f223615910 Merge pull request #12 from penberg/parking-lot 
Switch to parking_lot mutex
 2023-04-14 13:33:59 +03:00