Refactor json nodes lazy deserialization#782

Open

JohannesLichtenberger wants to merge 71 commits intomainfrom

refactor-json-nodes-lazy-deserialization

Commits on Aug 29, 2024

Commits on Sep 4, 2024

Commits on Sep 14, 2024

Commits on Sep 19, 2024

Minor updates regarding less memory usage, also fixing a resource leak
JohannesLichtenberger
committed

Commits on Sep 20, 2024

Minor simplifications
JohannesLichtenberger
committed

Commits on Sep 21, 2024

Minor simplifications
JohannesLichtenberger
committed

Commits on Sep 23, 2024

Commits on Jun 25, 2025

Add custom allocator and page pool
JohannesLichtenberger
committed

Commits on Aug 3, 2025

Several fixes for custom allocator and page pool
JohannesLichtenberger
committed

Commits on Oct 1, 2025

Refactor JSON nodes to use consistent lazy MemorySegment deserialization
Johannes Lichtenberger
committed

Commits on Oct 3, 2025

Refactor JSON node serialization with size prefix for efficient deserialization
Johannes Lichtenberger
committed

Commits on Oct 5, 2025

Add JVM arguments to allow hashing library access to internal JDK modules
Johannes Lichtenberger
committed
Fix ArrayNodeTest and ObjectNodeTest to use proper NodeKind byte + padding format
Johannes Lichtenberger
committed
Fix all JSON node tests to use proper NodeKind byte + size prefix + padding format
Johannes Lichtenberger
committed
Extract JSON node test serialization helpers to reduce duplication
Johannes Lichtenberger
committed
Refactor JSON node serialization utilities into shared JsonNodeSerializer class
Johannes Lichtenberger
committed
Fix JsonNodeFactoryImplTest serialization tests to use proper alignment
Johannes Lichtenberger
committed
Refactor: Move shared number serialization logic to NodeKind
Johannes Lichtenberger
committed
Change GrowingMemorySegment to use Arena.ofAuto() instead of Arena.global()
Johannes Lichtenberger
committed
Effectively remove the bin folder from version control
Johannes Lichtenberger
committed
Effectively remove the bin folder from version control
Johannes Lichtenberger
committed
Fix compilation errors: Update JsonNodeFactoryImpl to use NodeKind.serializeNumber()
Johannes Lichtenberger
committed
Fix RB node serialization: Use variable-length encoding for parent key offset
Johannes Lichtenberger
committed
Adapt .gitignore to ignore the sirix-core bin-directory
Johannes Lichtenberger
committed

Commits on Oct 6, 2025

Optimize memory management with hybrid Arena approach
Johannes Lichtenberger
committed
Attempt to change to single MemorySegment for slots

JohannesLichtenberger
authored and
Johannes Lichtenberger
committed
Remove some output

JohannesLichtenberger
authored and
Johannes Lichtenberger
committed
Update slotted page stuff...

JohannesLichtenberger
authored and
Johannes Lichtenberger
committed
Disable tests (shouldn't have been committed)

JohannesLichtenberger
authored and
Johannes Lichtenberger
committed
Update adding reference counting to the cached pages

JohannesLichtenberger
authored and
Johannes Lichtenberger
committed
Fix closing/clearing of pages

JohannesLichtenberger
authored and
Johannes Lichtenberger
committed
Fix closing/clearing of pages

JohannesLichtenberger
authored and
Johannes Lichtenberger
committed
Minor updates regarding less memory usage, also fixing a resource leak

JohannesLichtenberger
authored and
Johannes Lichtenberger
committed
Minor simplifications

JohannesLichtenberger
authored and
Johannes Lichtenberger
committed
Minor simplifications

JohannesLichtenberger
authored and
Johannes Lichtenberger
committed
Fix memory leak

JohannesLichtenberger
authored and
Johannes Lichtenberger
committed
Remove leftover stuff from reusing a byte-array for decompression

JohannesLichtenberger
authored and
Johannes Lichtenberger
committed
Add custom allocator and page pool

JohannesLichtenberger
authored and
Johannes Lichtenberger
committed
Several fixes for custom allocator and page pool

JohannesLichtenberger
authored and
Johannes Lichtenberger
committed
Refactor JSON nodes to use consistent lazy MemorySegment deserialization
Johannes Lichtenberger
committed
Refactor JSON node serialization with size prefix for efficient deserialization
Johannes Lichtenberger
committed
Add JVM arguments to allow hashing library access to internal JDK modules
Johannes Lichtenberger
committed
Fix ArrayNodeTest and ObjectNodeTest to use proper NodeKind byte + padding format
Johannes Lichtenberger
committed
Fix all JSON node tests to use proper NodeKind byte + size prefix + padding format
Johannes Lichtenberger
committed
Extract JSON node test serialization helpers to reduce duplication
Johannes Lichtenberger
committed
Refactor JSON node serialization utilities into shared JsonNodeSerializer class
Johannes Lichtenberger
committed
Fix JsonNodeFactoryImplTest serialization tests to use proper alignment
Johannes Lichtenberger
committed
Refactor: Move shared number serialization logic to NodeKind
Johannes Lichtenberger
committed
Change GrowingMemorySegment to use Arena.ofAuto() instead of Arena.global()
Johannes Lichtenberger
committed
Effectively remove the bin folder from version control
Johannes Lichtenberger
committed
Effectively remove the bin folder from version control
Johannes Lichtenberger
committed
Fix compilation errors: Update JsonNodeFactoryImpl to use NodeKind.serializeNumber()
Johannes Lichtenberger
committed
Fix RB node serialization: Use variable-length encoding for parent key offset
Johannes Lichtenberger
committed
Adapt .gitignore to ignore the sirix-core bin-directory
Johannes Lichtenberger
committed
Optimize memory management with hybrid Arena approach
Johannes Lichtenberger
committed
Merge remote-tracking branch 'origin/refactor-json-nodes-lazy-deserialization' into refactor-json-nodes-lazy-deserialization
Johannes Lichtenberger
committed

Commits on Oct 7, 2025

Refactor ElementNode to MemorySegment-backed storage with lazy deserialization
Johannes Lichtenberger
committed
Refactor AttributeNode to MemorySegment-backed storage with lazy deserialization
Johannes Lichtenberger
committed
Refactor NamespaceNode to MemorySegment-backed storage with lazy deserialization
Johannes Lichtenberger
committed
Refactor CommentNode to MemorySegment-backed storage with lazy deserialization
Johannes Lichtenberger
committed
Refactor PINode to MemorySegment-backed storage with lazy deserialization
Johannes Lichtenberger
committed
Refactor TextNode to MemorySegment-backed storage with lazy deserialization
Johannes Lichtenberger
committed
Add lazy decompression for TextNode values
Johannes Lichtenberger
committed
Rename JsonNodeTestHelper to NodeTestHelper and move to io.sirix.node package
Johannes Lichtenberger
committed
Remove unused imports from MemorySegment-backed XML nodes
Johannes Lichtenberger
committed

Commits on Oct 8, 2025

Refactor value nodes to remove redundant childCount/descendantCount storage
Johannes Lichtenberger
committed