Skip to content

Backport 63102 branch 4.1#63740

Merged
yiguolei merged 2 commits into
apache:branch-4.1from
Gabriel39:backport-63102-branch-4.1
May 29, 2026
Merged

Backport 63102 branch 4.1#63740
yiguolei merged 2 commits into
apache:branch-4.1from
Gabriel39:backport-63102-branch-4.1

Conversation

@Gabriel39

@Gabriel39 Gabriel39 commented May 27, 2026 •
edited by yiguolei
Loading

Copy link
Copy Markdown
Contributor

What problem does this PR solve?

Issue Number: close #xxx
#63102
Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

Gabriel39 added 2 commits May 27, 2026 16:30
@Gabriel39
Fix parquet row group column lookup crash (apache#63100)
51effc7 
*** tablet id: 0 ***
*** Aborted at 1778254939 (unix time) try "date -d @1778254939" if you
are using GNU date ***
*** Current BE git commitID: c6e6ecc ***
*** SIGSEGV address not mapped to object (@0x13) received by PID 40355
(TID 77840 OR 0x7ef6079ff640) from PID 19; stack trace: ***
0# doris::signal::(anonymous namespace)::FailureSignalHandler(int,
siginfo_t*, void*) at
/home/zcp/repo_center/doris_branch-4.1/doris/be/src/common/signal_handler.h:420
1# PosixSignals::chained_handler(int, siginfo*, void*) [clone .part.0]
in /usr/lib/jvm/java-17-openjdk-amd64/lib/server/libjvm.so
2# JVM_handle_linux_signal in
/usr/lib/jvm/java-17-openjdk-amd64/lib/server/libjvm.so
 3# 0x00007F036C55C520 in /lib/x86_64-linux-gnu/libc.so.6
4# std::_Hash_bytes(void const*, unsigned long, unsigned long) in
/mnt/hdd01/PERFORMANCE_ENV/be/lib/doris_be
5# std::__detail::_Map_base<std::__cxx11::basic_string<char,
std::char_traits<char>, std::allocator<char> >,
std::pair<std::__cxx11::basic_string<char, std::char_traits<char>,
std::allocator<char> > const, unsigned int>,
std::allocator<std::pair<std::__cxx11::basic_string<char,
std::char_traits<char>, std::allocator<char> > const, unsigned int> >,
std::__detail::_Select1st,
std::equal_to<std::__cxx11::basic_string<char, std::char_traits<char>,
std::allocator<char> > >, std::hash<std::__cxx11::basic_string<char,
std::char_traits<char>, std::allocator<char> > >,
std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash,
std::__detail::_Prime_rehash_policy,
std::__detail::_Hashtable_traits<true, false, true>,
true>::operator[](std::__cxx11::basic_string<char,
std::char_traits<char>, std::allocator<char> > const&) in
/mnt/hdd01/PERFORMANCE_ENV/be/lib/doris_be
6# doris::RowGroupReader::_read_column_data(doris::Block*,
std::vector<std::__cxx11::basic_string<char, std::char_traits<char>,
std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char,
std::char_traits<char>, std::allocator<char> > > > const&, unsigned
long, unsigned long*, bool*, doris::FilterMap&) at
/home/zcp/repo_center/doris_branch-4.1/doris/be/src/format/parquet/vparquet_group_reader.cpp:496
7# doris::RowGroupReader::next_batch(doris::Block*, unsigned long,
unsigned long*, bool*) at
/home/zcp/repo_center/doris_branch-4.1/doris/be/src/format/parquet/vparquet_group_reader.cpp:404
8# doris::ParquetReader::get_next_block(doris::Block*, unsigned long*,
bool*) at
/home/zcp/repo_center/doris_branch-4.1/doris/be/src/format/parquet/vparquet_reader.cpp:724
9# doris::IcebergTableReader::get_next_block_inner(doris::Block*,
unsigned long*, bool*) at
/home/zcp/repo_center/doris_branch-4.1/doris/be/src/format/table/iceberg_reader.cpp:185
10# doris::TableFormatReader::get_next_block(doris::Block*, unsigned
long*, bool*) at
/home/zcp/repo_center/doris_branch-4.1/doris/be/src/format/table/table_format_reader.h:80
11# doris::FileScanner::_get_block_wrapped(doris::RuntimeState*,
doris::Block*, bool*) at
/home/zcp/repo_center/doris_branch-4.1/doris/be/src/exec/scan/file_scanner.cpp:474
12# doris::FileScanner::_get_block_impl(doris::RuntimeState*,
doris::Block*, bool*) at
/home/zcp/repo_center/doris_branch-4.1/doris/be/src/exec/scan/file_scanner.cpp:407
13# doris::Scanner::get_block(doris::RuntimeState*, doris::Block*,
bool*) in /mnt/hdd01/PERFORMANCE_ENV/be/lib/doris_be
14# doris::Scanner::get_block_after_projects(doris::RuntimeState*,
doris::Block*, bool*) at
/home/zcp/repo_center/doris_branch-4.1/doris/be/src/exec/scan/scanner.cpp:91
15#
doris::ScannerScheduler::_scanner_scan(std::shared_ptr<doris::ScannerContext>,
std::shared_ptr<doris::ScanTask>) at
/home/zcp/repo_center/doris_branch-4.1/doris/be/src/exec/scan/scanner_scheduler.cpp:186
16# std::_Function_handler<bool (),
doris::ScannerScheduler::submit(std::shared_ptr<doris::ScannerContext>,
std::shared_ptr<doris::ScanTask>)::$_0::operator()()
const::{lambda()apache#1}>::_M_invoke(std::_Any_data const&) at
/usr/local/ldb-toolchain-v0.26/bin/../lib/gcc/x86_64-pc-linux-gnu/15/include/g++-v15/bits/std_function.h:292
17# doris::ScannerSplitRunner::process_for(std::chrono::duration<long,
std::ratio<1l, 1000000000l> >) at
/home/zcp/repo_center/doris_branch-4.1/doris/be/src/exec/scan/scanner_scheduler.cpp:427
18# doris::PrioritizedSplitRunner::process() at
/home/zcp/repo_center/doris_branch-4.1/doris/be/src/exec/scan/task_executor/time_sharing/prioritized_split_runner.cpp:103
19# doris::TimeSharingTaskExecutor::_dispatch_thread() at
/home/zcp/repo_center/doris_branch-4.1/doris/be/src/exec/scan/task_executor/time_sharing/time_sharing_task_executor.cpp:558
20# doris::Thread::supervise_thread(void*) at
/home/zcp/repo_center/doris_branch-4.1/doris/be/src/util/thread.cpp:461
21# start_thread at ./nptl/pthread_create.c:442
22# 0x00007F036C6408D0 at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:83

- Test <!-- At least one of them must be included. -->
    - [ ] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [ ] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg:
apache/doris-website#1214 -->

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
@Gabriel39
Fix parquet row group reader lifetime issues (apache#63101)
d1717a1
@Gabriel39 Gabriel39 requested a review from yiguolei as a code owner May 27, 2026 08:37
@hello-stephen

hello-stephen commented May 27, 2026

Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@yiguolei

yiguolei commented May 28, 2026

Copy link
Copy Markdown
Contributor

run buildall

@yiguolei yiguolei merged commit 028a1f7 into apache:branch-4.1 May 29, 2026
27 of 32 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@yiguolei yiguolei yiguolei approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@Gabriel39 @hello-stephen @yiguolei