[C++] Failing arrow-flight-test when enabling opentelemetry

[h-vetinari]

Describe the bug, including details regarding any error messages, version, and platform.

In conda-forge/arrow-cpp-feedstock#1058, we finally enabled the test suite for libarrow in conda-forge. This has been running fine, even though @pitrou had noted in #35587:

Our async Flight support is unfortunately finicky, and noone is working on it anymore. So, yeah, there are sporadic failures on those tests...

However, while working on the opentelemetry integration (conda-forge/arrow-cpp-feedstock#1048; no windows due to #45033), I keep running into the following failure in arrow-flight-test; this time it doesn't appear to be a fluke, but has reproduced 3x in a row.

      Start 76: arrow-flight-test
76/98 Test #76: arrow-flight-test ............................***Failed    0.91 sec
Running arrow-flight-test, redirecting output into $SRC_DIR/cpp/build/build/test-logs/arrow-flight-test.txt (attempt 1/1)
$SRC_DIR/cpp/build-support/run-test.sh: line 88: 28863 Aborted                 (core dumped) $TEST_EXECUTABLE "$@" > $LOGFILE.raw 2>&1
Running main() from /home/conda/feedstock_root/build_artifacts/gtest-split_1722457657850/work/googletest/src/gtest_main.cc
[==========] Running 97 tests from 20 test suites.
[----------] Global test environment set-up.
[----------] 5 tests from GrpcConnectivityTest
[ RUN      ] GrpcConnectivityTest.GetPort
[       OK ] GrpcConnectivityTest.GetPort (14 ms)
[ RUN      ] GrpcConnectivityTest.BuilderHook
[       OK ] GrpcConnectivityTest.BuilderHook (2 ms)
[ RUN      ] GrpcConnectivityTest.Shutdown
[       OK ] GrpcConnectivityTest.Shutdown (21 ms)
[ RUN      ] GrpcConnectivityTest.ShutdownWithDeadline
[       OK ] GrpcConnectivityTest.ShutdownWithDeadline (1 ms)
[ RUN      ] GrpcConnectivityTest.BrokenConnection
[       OK ] GrpcConnectivityTest.BrokenConnection (4 ms)
[----------] 5 tests from GrpcConnectivityTest (44 ms total)

[----------] 18 tests from GrpcDataTest
[ RUN      ] GrpcDataTest.TestDoGetInts
[       OK ] GrpcDataTest.TestDoGetInts (7 ms)
[ RUN      ] GrpcDataTest.TestDoGetFloats
[       OK ] GrpcDataTest.TestDoGetFloats (4 ms)
[ RUN      ] GrpcDataTest.TestDoGetDicts
[       OK ] GrpcDataTest.TestDoGetDicts (5 ms)
[ RUN      ] GrpcDataTest.TestDoGetLargeBatch
[       OK ] GrpcDataTest.TestDoGetLargeBatch (149 ms)
[ RUN      ] GrpcDataTest.TestFlightDataStreamError
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20241229 06:18:49.797973 140144816412224 status.cc:155] Failed to close FlightDataStream: IOError: Expected error
[       OK ] GrpcDataTest.TestFlightDataStreamError (5 ms)
[ RUN      ] GrpcDataTest.TestOverflowServerBatch
[       OK ] GrpcDataTest.TestOverflowServerBatch (78 ms)
[ RUN      ] GrpcDataTest.TestOverflowClientBatch
[       OK ] GrpcDataTest.TestOverflowClientBatch (42 ms)
[ RUN      ] GrpcDataTest.TestDoExchange
[       OK ] GrpcDataTest.TestDoExchange (4 ms)
[ RUN      ] GrpcDataTest.TestDoExchangeNoData
[       OK ] GrpcDataTest.TestDoExchangeNoData (4 ms)
[ RUN      ] GrpcDataTest.TestDoExchangeWriteOnlySchema
[       OK ] GrpcDataTest.TestDoExchangeWriteOnlySchema (3 ms)
[ RUN      ] GrpcDataTest.TestDoExchangeGet
[       OK ] GrpcDataTest.TestDoExchangeGet (4 ms)
[ RUN      ] GrpcDataTest.TestDoExchangePut
[       OK ] GrpcDataTest.TestDoExchangePut (3 ms)
[ RUN      ] GrpcDataTest.TestDoExchangeEcho
[       OK ] GrpcDataTest.TestDoExchangeEcho (5 ms)
[ RUN      ] GrpcDataTest.TestDoExchangeTotal
[       OK ] GrpcDataTest.TestDoExchangeTotal (3 ms)
[ RUN      ] GrpcDataTest.TestDoExchangeError
[       OK ] GrpcDataTest.TestDoExchangeError (4 ms)
[ RUN      ] GrpcDataTest.TestDoExchangeConcurrency
[       OK ] GrpcDataTest.TestDoExchangeConcurrency (4 ms)
[ RUN      ] GrpcDataTest.TestDoExchangeUndrained
[       OK ] GrpcDataTest.TestDoExchangeUndrained (4 ms)
[ RUN      ] GrpcDataTest.TestIssue5095
[       OK ] GrpcDataTest.TestIssue5095 (4 ms)
[----------] 18 tests from GrpcDataTest (341 ms total)

[----------] 7 tests from GrpcDoPutTest
[ RUN      ] GrpcDoPutTest.TestInts
[       OK ] GrpcDoPutTest.TestInts (3 ms)
[ RUN      ] GrpcDoPutTest.TestFloats
[       OK ] GrpcDoPutTest.TestFloats (3 ms)
[ RUN      ] GrpcDoPutTest.TestEmptyBatch
[       OK ] GrpcDoPutTest.TestEmptyBatch (3 ms)
[ RUN      ] GrpcDoPutTest.TestDicts
[       OK ] GrpcDoPutTest.TestDicts (3 ms)
[ RUN      ] GrpcDoPutTest.TestLargeBatch
[       OK ] GrpcDoPutTest.TestLargeBatch (89 ms)
[ RUN      ] GrpcDoPutTest.TestSizeLimit
[       OK ] GrpcDoPutTest.TestSizeLimit (5 ms)
[ RUN      ] GrpcDoPutTest.TestUndrained
[       OK ] GrpcDoPutTest.TestUndrained (4 ms)
[----------] 7 tests from GrpcDoPutTest (114 ms total)

[----------] 5 tests from GrpcAppMetadataTest
[ RUN      ] GrpcAppMetadataTest.TestDoGet
[       OK ] GrpcAppMetadataTest.TestDoGet (3 ms)
[ RUN      ] GrpcAppMetadataTest.TestDoGetDictionaries
[       OK ] GrpcAppMetadataTest.TestDoGetDictionaries (4 ms)
[ RUN      ] GrpcAppMetadataTest.TestDoPut
[       OK ] GrpcAppMetadataTest.TestDoPut (4 ms)
[ RUN      ] GrpcAppMetadataTest.TestDoPutDictionaries
[       OK ] GrpcAppMetadataTest.TestDoPutDictionaries (4 ms)
[ RUN      ] GrpcAppMetadataTest.TestDoPutReadMetadata
[       OK ] GrpcAppMetadataTest.TestDoPutReadMetadata (4 ms)
[----------] 5 tests from GrpcAppMetadataTest (22 ms total)

[----------] 5 tests from GrpcIpcOptionsTest
[ RUN      ] GrpcIpcOptionsTest.TestDoGetReadOptions
[       OK ] GrpcIpcOptionsTest.TestDoGetReadOptions (3 ms)
[ RUN      ] GrpcIpcOptionsTest.TestDoPutWriteOptions
[       OK ] GrpcIpcOptionsTest.TestDoPutWriteOptions (3 ms)
[ RUN      ] GrpcIpcOptionsTest.TestDoExchangeClientWriteOptions
[       OK ] GrpcIpcOptionsTest.TestDoExchangeClientWriteOptions (3 ms)
[ RUN      ] GrpcIpcOptionsTest.TestDoExchangeClientWriteOptionsBegin
[       OK ] GrpcIpcOptionsTest.TestDoExchangeClientWriteOptionsBegin (3 ms)
[ RUN      ] GrpcIpcOptionsTest.TestDoExchangeServerWriteOptions
[       OK ] GrpcIpcOptionsTest.TestDoExchangeServerWriteOptions (4 ms)
[----------] 5 tests from GrpcIpcOptionsTest (19 ms total)

[----------] 3 tests from GrpcCudaDataTest
[ RUN      ] GrpcCudaDataTest.TestDoGet
$SRC_DIR/cpp/src/arrow/flight/test_definitions.cc:1418: Skipped
Arrow was built without ARROW_CUDA

[  SKIPPED ] GrpcCudaDataTest.TestDoGet (0 ms)
[ RUN      ] GrpcCudaDataTest.TestDoPut
$SRC_DIR/cpp/src/arrow/flight/test_definitions.cc:1419: Skipped
Arrow was built without ARROW_CUDA

[  SKIPPED ] GrpcCudaDataTest.TestDoPut (0 ms)
[ RUN      ] GrpcCudaDataTest.TestDoExchange
$SRC_DIR/cpp/src/arrow/flight/test_definitions.cc:1421: Skipped
Arrow was built without ARROW_CUDA

[  SKIPPED ] GrpcCudaDataTest.TestDoExchange (0 ms)
[----------] 3 tests from GrpcCudaDataTest (0 ms total)

[----------] 5 tests from GrpcErrorHandlingTest
[ RUN      ] GrpcErrorHandlingTest.TestAsyncGetFlightInfo
[       OK ] GrpcErrorHandlingTest.TestAsyncGetFlightInfo (42 ms)
[ RUN      ] GrpcErrorHandlingTest.TestGetFlightInfo
[       OK ] GrpcErrorHandlingTest.TestGetFlightInfo (37 ms)
[ RUN      ] GrpcErrorHandlingTest.TestGetFlightInfoMetadata
[       OK ] GrpcErrorHandlingTest.TestGetFlightInfoMetadata (3 ms)
[ RUN      ] GrpcErrorHandlingTest.TestDoPut
[       OK ] GrpcErrorHandlingTest.TestDoPut (6 ms)
[ RUN      ] GrpcErrorHandlingTest.TestDoExchange
[       OK ] GrpcErrorHandlingTest.TestDoExchange (4 ms)
[----------] 5 tests from GrpcErrorHandlingTest (95 ms total)

[----------] 3 tests from GrpcAsyncClientTest
[ RUN      ] GrpcAsyncClientTest.TestGetFlightInfo
[       OK ] GrpcAsyncClientTest.TestGetFlightInfo (4 ms)
[ RUN      ] GrpcAsyncClientTest.TestGetFlightInfoFuture
[       OK ] GrpcAsyncClientTest.TestGetFlightInfoFuture (4 ms)
[ RUN      ] GrpcAsyncClientTest.TestListenerLifetime
WARNING: All log messages before absl::InitializeLog() is called are written to STDERR
E0000 00:00:1735453130.232915   29468 thd.cc:184] pthread_join failed: Resource deadlock avoided
~/feedstock_root/build_artifacts/apache-arrow_1735449323515/work/cpp/build/src/arrow/flight

      Start 77: arrow-flight-sql-test

This is the only test that fails:

99% tests passed, 1 tests failed out of 98

Label Time Summary:
[...]

Total Test time (real) = 165.44 sec

The following tests FAILED:
	 76 - arrow-flight-test (Failed)                        arrow_flight unittest

Component(s)

C++, Continuous Integration, Packaging