Conversation
prtkgaur
force-pushed
the
gh540-alp-pseudoDecimal-encoding
branch
from
March 11, 2026 04:12
c738d2e to
48d5e73
Compare
prtkgaur
changed the title
prtkgaur
changed the title
prtkgaur
force-pushed
the
gh540-alp-pseudoDecimal-encoding
branch
from
October 4, 2026 00:31
48d5e73 to
6e96642
Compare
Implement decimal scaling, exception patching, frame-of-reference packing, sampling, and the little-endian page layout. Preserve bit-exact floating-point results and compatibility with the C++ reference blobs.
Buffer and encode page vectors through the Parquet values interfaces, then decode them lazily with constant-time skips. Validate page headers and retain allocator-backed output across vector boundaries.
Expose opt-in global and per-column settings and select ALP for floating-point columns in the writer factory. Keep the default disabled and leave unsupported physical types unchanged.
Read C++-generated float and double files against source values, and retain Java-generated fixtures for the reverse-language conformance workflow. Cover both datasets with bit-exact comparisons.
Measure codec and Parquet-pipeline throughput on synthetic patterns and Spotify columns, including comparisons with plain Zstandard and byte-stream split. Keep corpus loading shared with interoperability fixtures.
prtkgaur
force-pushed
the
gh540-alp-pseudoDecimal-encoding
branch
from
October 4, 2026 02:40
6e96642 to
a21cc47
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Rationale for this change
What changes are included in this PR?
Are these changes tested?
Are there any user-facing changes?