Commit 4fa8d2f
authored
fix(ipc): replace wildcard in skip_field with explicit DataType handling (#9822)
# Which issue does this PR close?
- Closes #9821 .
# Rationale for this change
`skip_field` currently uses a wildcard match (`_`) to skip remaining
`DataType` variants by assuming a two-buffer layout. This is not robust,
as new variants may have different buffer layouts, leading to incorrect
skipping and buffer misalignment.
Replacing the wildcard with explicit handling ensures the correct number
of buffers are skipped and avoids silent errors for future types.
# What changes are included in this PR?
* Removed the wildcard (`_`) match arm in `skip_field`
* Added explicit handling for all remaining fixed-width and boolean
`DataType` variants
* Each of these types now explicitly skips:
* null buffer
* values buffer
File updated:
* `arrow-ipc/src/reader.rs`
# Are these changes tested?
Yes.
* Added test: `test_projection_skip_fixed_width_types` in
`arrow-ipc/src/reader.rs`
* The test iterates over all fixed-width and boolean `DataType` variants
covered by this change
* For each type:
* writes a batch with `[skipped_column(type), values_column(Int32)]`
* reads only the second column (skipping the first)
* verifies whether the returned column exactly matches the original
`Int32` values
* This directly validates that skipping each of these types consumes the
correct number of buffers
* Also, all existing `arrow-ipc` tests pass (`cargo test -p arrow-ipc
--lib`)
# Are there any user-facing changes?
No.1 parent c4b2569 commit 4fa8d2f
1 file changed
Lines changed: 123 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
707 | 707 | | |
708 | 708 | | |
709 | 709 | | |
710 | | - | |
711 | | - | |
| 710 | + | |
| 711 | + | |
| 712 | + | |
| 713 | + | |
| 714 | + | |
| 715 | + | |
| 716 | + | |
| 717 | + | |
| 718 | + | |
| 719 | + | |
| 720 | + | |
| 721 | + | |
| 722 | + | |
| 723 | + | |
| 724 | + | |
| 725 | + | |
| 726 | + | |
| 727 | + | |
| 728 | + | |
| 729 | + | |
| 730 | + | |
| 731 | + | |
| 732 | + | |
| 733 | + | |
| 734 | + | |
| 735 | + | |
| 736 | + | |
712 | 737 | | |
713 | 738 | | |
714 | 739 | | |
| |||
3517 | 3542 | | |
3518 | 3543 | | |
3519 | 3544 | | |
| 3545 | + | |
| 3546 | + | |
| 3547 | + | |
| 3548 | + | |
| 3549 | + | |
| 3550 | + | |
| 3551 | + | |
| 3552 | + | |
| 3553 | + | |
| 3554 | + | |
| 3555 | + | |
| 3556 | + | |
| 3557 | + | |
| 3558 | + | |
| 3559 | + | |
| 3560 | + | |
| 3561 | + | |
| 3562 | + | |
| 3563 | + | |
| 3564 | + | |
| 3565 | + | |
| 3566 | + | |
| 3567 | + | |
| 3568 | + | |
| 3569 | + | |
| 3570 | + | |
| 3571 | + | |
| 3572 | + | |
| 3573 | + | |
| 3574 | + | |
| 3575 | + | |
| 3576 | + | |
| 3577 | + | |
| 3578 | + | |
| 3579 | + | |
| 3580 | + | |
| 3581 | + | |
| 3582 | + | |
| 3583 | + | |
| 3584 | + | |
| 3585 | + | |
| 3586 | + | |
| 3587 | + | |
| 3588 | + | |
| 3589 | + | |
| 3590 | + | |
| 3591 | + | |
| 3592 | + | |
| 3593 | + | |
| 3594 | + | |
| 3595 | + | |
| 3596 | + | |
| 3597 | + | |
| 3598 | + | |
| 3599 | + | |
| 3600 | + | |
| 3601 | + | |
| 3602 | + | |
| 3603 | + | |
| 3604 | + | |
| 3605 | + | |
| 3606 | + | |
| 3607 | + | |
| 3608 | + | |
| 3609 | + | |
| 3610 | + | |
| 3611 | + | |
| 3612 | + | |
| 3613 | + | |
| 3614 | + | |
| 3615 | + | |
| 3616 | + | |
| 3617 | + | |
| 3618 | + | |
| 3619 | + | |
| 3620 | + | |
| 3621 | + | |
| 3622 | + | |
| 3623 | + | |
| 3624 | + | |
| 3625 | + | |
| 3626 | + | |
| 3627 | + | |
| 3628 | + | |
| 3629 | + | |
| 3630 | + | |
| 3631 | + | |
| 3632 | + | |
| 3633 | + | |
| 3634 | + | |
| 3635 | + | |
| 3636 | + | |
| 3637 | + | |
| 3638 | + | |
| 3639 | + | |
| 3640 | + | |
3520 | 3641 | | |
0 commit comments