Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[flaky test] TestSplunkHecExporter/* flakiness #37379

Open
pjanotti opened this issue Jan 21, 2025 · 2 comments
Open

[flaky test] TestSplunkHecExporter/* flakiness #37379

pjanotti opened this issue Jan 21, 2025 · 2 comments
Labels

Comments

@pjanotti
Copy link
Contributor

Component(s)

exporter/splunkhec

Describe the issue you're reporting

https://github.com/open-telemetry/opentelemetry-collector-contrib/actions/runs/12834416578/job/35791747000?pr=37289#:~:text=%3D%3D%3D%20FAIL%3A%20.%20TestSplunkHecExporter,392

=== FAIL: . TestSplunkHecExporter/Events_to_Splunk (0.01s)
    logger.go:146: 2025-01-17T18:12:55.097Z	INFO	Test -> Splunk running at:	{"host": "localhost", "uiPort": "32773", "hecPort": "32772", "managementPort": "32771"}
    integration_test.go:252: 
        	Error Trace:	/home/runner/work/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/splunkhecexporter/integration_test.go:252
        	            				/home/runner/work/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/splunkhecexporter/integration_test.go:382
        	Error:      	Received unexpected error:
        	            	Post "https://localhost:32772/services/collector": http: server gave HTTP response to HTTPS client
        	Test:       	TestSplunkHecExporter/Events_to_Splunk
        	Messages:   	Must not error while sending Logs data

=== FAIL: . TestSplunkHecExporter/Events_to_Splunk_-_Non_default_index (0.01s)
    logger.go:146: 2025-01-17T18:12:55.103Z	INFO	Test -> Splunk running at:	{"host": "localhost", "uiPort": "32773", "hecPort": "32772", "managementPort": "32771"}
    integration_test.go:252: 
        	Error Trace:	/home/runner/work/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/splunkhecexporter/integration_test.go:252
        	            				/home/runner/work/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/splunkhecexporter/integration_test.go:382
        	Error:      	Received unexpected error:
        	            	Post "https://localhost:32772/services/collector": http: server gave HTTP response to HTTPS client
        	Test:       	TestSplunkHecExporter/Events_to_Splunk_-_Non_default_index
        	Messages:   	Must not error while sending Logs data

=== FAIL: . TestSplunkHecExporter/Events_to_Splunk_-_metrics (0.01s)
    logger.go:146: 2025-01-17T18:12:55.111Z	INFO	Test -> Splunk running at:	{"host": "localhost", "uiPort": "32773", "hecPort": "32772", "managementPort": "32771"}
    integration_test.go:275: 
        	Error Trace:	/home/runner/work/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/splunkhecexporter/integration_test.go:275
        	            				/home/runner/work/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/splunkhecexporter/integration_test.go:384
        	Error:      	Received unexpected error:
        	            	Post "https://localhost:32772/services/collector": http: server gave HTTP response to HTTPS client
        	Test:       	TestSplunkHecExporter/Events_to_Splunk_-_metrics
        	Messages:   	Must not error while sending Metrics data

=== FAIL: . TestSplunkHecExporter/Events_to_Splunk_-_traces (0.01s)
    logger.go:146: 2025-01-17T18:12:55.117Z	INFO	Test -> Splunk running at:	{"host": "localhost", "uiPort": "32773", "hecPort": "32772", "managementPort": "32771"}
    integration_test.go:291: 
        	Error Trace:	/home/runner/work/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/splunkhecexporter/integration_test.go:291
        	            				/home/runner/work/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/splunkhecexporter/integration_test.go:386
make[2]: *** [../../Makefile.Common:162: mod-integration-test] Error 1
make[1]: *** [Makefile:200: exporter/splunkhecexporter] Error 2
make: *** [Makefile:149: gointegration-test] Error 2
        	Error:      	Received unexpected error:
        	            	Post "https://localhost:32772/services/collector": http: server gave HTTP response to HTTPS client
        	Test:       	TestSplunkHecExporter/Events_to_Splunk_-_traces
        	Messages:   	Must not error while sending Trace data

=== FAIL: . TestSplunkHecExporter (100.40s)
{"level":"info","ts":1737137575.0923371,"caller":"splunkhecexporter/integration_test.go:147","msg":"Splunk running at:","host":"localhost","uiPort":32773,"hecPort":32772,"managementPort":32771}
Host value updated successfully!
Host value updated successfully!
Host value updated successfully!
Host value updated successfully!
Tearing down...
Stopping container
Removed Docker image: splunk/splunk:9.1.2
Command output:
Untagged: splunk/splunk:9.1.2
Untagged: splunk/splunk@sha256:7eca42b8a7a777053e1d0420287a683167ed228ab09444b35b3f4a8f54cb6cd4
Deleted: sha256:54b3e88a4bc36556bec5a547b078e4a5ab49f19bc83fca8ad9fbf5b0cd5af0a8
Deleted: sha256:cad5dbccfc0639faa3d9600d4d171015c0b287ee316be182d578f36c9cd6373d
Deleted: sha256:266e594b38deda00584697b9e6f316a2307df7f63dfb334e1b4413448e91d3ef
Deleted: sha256:c6405c59c934c9375241353835c4f038eee4e3d26a1e6b4226accb2b7497ca36
Deleted: sha256:4f68d661d8ace933a19d087d15fa86597c3de9e2cbec6d829aa8597d0f79ca88
Deleted: sha256:[361](https://github.com/open-telemetry/opentelemetry-collector-contrib/actions/runs/12834416578/job/35791747000?pr=37289#step:5:362)a7590963fea4daf056ebe7c3f9e1cd6e0add0460b92986174d389ac5b2841
Deleted: sha256:6f8f8f17cfde47db0372a2a2753f1afcf10f715e2c88a16b2c163d411f17b5a8
Deleted: sha256:8880b26d0e2f7d79cafc8781e6e336bc2c58014edb7d85bafee6cc5623f2c964
Deleted: sha256:ac2046dbab26ae4387b511bcee0bb46fa4fdda0eedfddf2be4d2e379960b8ff7
Deleted: sha256:b7429c9ec83387e7fa7ee8d4c638f152e5ac67de20c323968874f8a508ce72aa
Deleted: sha256:9c12e5e32f3b2bf048ccacf09e0c790150819a5d15c71cdff37b40f35abaa526
Deleted: sha256:8f42ad26ccdae7ec04dac9501e3c011a88c8663559699974ecf1697999914f0d


=== FAIL: . TestSplunkHecExporter/Events_to_Splunk (re-run 1) (0.01s)
    logger.go:146: 2025-01-17T18:14:35.755Z	INFO	Test -> Splunk running at:	{"host": "localhost", "uiPort": "32777", "hecPort": "32776", "managementPort": "32775"}
    integration_test.go:252: 
        	Error Trace:	/home/runner/work/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/splunkhecexporter/integration_test.go:252
        	            				/home/runner/work/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/splunkhecexporter/integration_test.go:382
        	Error:      	Received unexpected error:
        	            	Post "https://localhost:32776/services/collector": http: server gave HTTP response to HTTPS client
        	Test:       	TestSplunkHecExporter/Events_to_Splunk
        	Messages:   	Must not error while sending Logs data

=== FAIL: . TestSplunkHecExporter (re-run 1) (99.36s)
{"level":"info","ts":1737137675.7503378,"caller":"splunkhecexporter/integration_test.go:147","msg":"Splunk running at:","host":"localhost","uiPort":32777,"hecPort":32776,"managementPort":32775}
Host value updated successfully!
Host value updated successfully!
Host value updated successfully!
Host value updated successfully!
Tearing down...
Stopping container
Removed Docker image: splunk/splunk:9.1.2
Command output:
Untagged: splunk/splunk:9.1.2
Untagged: splunk/splunk@sha256:7eca42b8a7a777053e1d0420287a683167ed228ab09444b35b3f4a8f54cb6cd4
Deleted: sha256:54b3e88a4bc[365](https://github.com/open-telemetry/opentelemetry-collector-contrib/actions/runs/12834416578/job/35791747000?pr=37289#step:5:366)56bec5a547b078e4a5ab49f19bc83fca8ad9fbf5b0cd5af0a8
Deleted: sha256:cad5dbccfc0639faa3d9600d4d171015c0b287ee316be182d578f36c9cd6373d
Deleted: sha256:266e594b38deda00584697b9e6f316a2307df7f63dfb334e1b4413448e91d3ef
Deleted: sha256:c6405c59c934c9375241353835c4f038eee4e3d26a1e6b4226accb2b7497ca36
Deleted: sha256:4f68d661d8ace933a19d087d15fa86597c3de9e2cbec6d829aa8597d0f79ca88
Deleted: sha256:361a7590963fea4daf056ebe7c3f9e1cd6e0add0460b92986174d389ac5b2841
Deleted: sha256:6f8f8f17cfde47db0372a2a2753f1afcf10f715e2c88a16b2c163d411f17b5a8
Deleted: sha256:8880b26d0e2f7d79cafc8781e6e336bc2c58014edb7d85bafee6cc5623f2c964
Deleted: sha256:ac2046dbab26ae4387b511bcee0bb46fa4fdda0eedfddf2be4d2e379960b8ff7
Deleted: sha256:b7429c9ec83387e7fa7ee8d4c638f152e5ac67de20c323968874f8a508ce72aa
Deleted: sha256:9c12e5e32f3b2bf048ccacf09e0c790150819a5d15c71cdff37b40f35abaa526
Deleted: sha256:8f42ad26ccdae7ec04dac9501e3c011a88c8663559699974ecf1697999914f0d


=== FAIL: . TestSplunkHecExporter/Events_to_Splunk_-_Non_default_index (re-run 1) (0.01s)
    logger.go:146: 2025-01-17T18:16:15.808Z	INFO	Test -> Splunk running at:	{"host": "localhost", "uiPort": "32781", "hecPort": "32780", "managementPort": "32779"}
    integration_test.go:252: 
        	Error Trace:	/home/runner/work/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/splunkhecexporter/integration_test.go:252
        	            				/home/runner/work/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/splunkhecexporter/integration_test.go:382
        	Error:      	Received unexpected error:
        	            	Post "https://localhost:32780/services/collector": http: server gave HTTP response to HTTPS client
        	Test:       	TestSplunkHecExporter/Events_to_Splunk_-_Non_default_index
        	Messages:   	Must not error while sending Logs data

=== FAIL: . TestSplunkHecExporter (re-run 1) (99.26s)
{"level":"info","ts":17[371](https://github.com/open-telemetry/opentelemetry-collector-contrib/actions/runs/12834416578/job/35791747000?pr=37289#step:5:372)37775.802653,"caller":"splunkhecexporter/integration_test.go:147","msg":"Splunk running at:","host":"localhost","uiPort":32781,"hecPort":32780,"managementPort":32779}
Host value updated successfully!
Host value updated successfully!
Host value updated successfully!
Host value updated successfully!
Tearing down...
Stopping container
Removed Docker image: splunk/splunk:9.1.2
Command output:
Untagged: splunk/splunk:9.1.2
Untagged: splunk/splunk@sha256:7eca42b8a7a777053e1d0420287a683167ed228ab09444b35b3f4a8f54cb6cd4
Deleted: sha256:54b3e88a4bc36556bec5a547b078e4a5ab49f19bc83fca8ad9fbf5b0cd5af0a8
Deleted: sha256:cad5dbccfc0639faa3d9600d4d171015c0b287ee316be182d578f36c9cd6373d
Deleted: sha256:266e594b38deda00584697b9e6f316a2307df7f63dfb334e1b4413448e91d3ef
Deleted: sha256:c6405c59c934c9375241353835c4f038eee4e3d26a1e6b4226accb2b7497ca36
Deleted: sha256:4f68d661d8ace933a19d087d15fa86597c3de9e2cbec6d829aa8597d0f79ca88
Deleted: sha256:361a7590963fea4daf056ebe7c3f9e1cd6e0add0460b92986174d389ac5b2841
Deleted: sha256:6f8f8f17cfde47db0[372](https://github.com/open-telemetry/opentelemetry-collector-contrib/actions/runs/12834416578/job/35791747000?pr=37289#step:5:373)a2a2753f1afcf10f715e2c88a16b2c163d411f17b5a8
Deleted: sha256:8880b26d0e2f7d79cafc8781e6e336bc2c58014edb7d85bafee6cc5623f2c964
Deleted: sha256:ac2046dbab26ae4387b511bcee0bb46fa4fdda0eedfddf2be4d2e379960b8ff7
Deleted: sha256:b7429c9ec83387e7fa7ee8d4c638f152e5ac67de20c323968874f8a508ce72aa
Deleted: sha256:9c12e5e32f3b2bf048ccacf09e0c790150819a5d15c71cdff37b40f35abaa526
Deleted: sha256:8f42ad26ccdae7ec04dac9501e3c011a88c8663559699974ecf1697999914f0d


=== FAIL: . TestSplunkHecExporter/Events_to_Splunk_-_metrics (re-run 1) (0.01s)
    logger.go:146: 2025-01-17T18:17:55.985Z	INFO	Test -> Splunk running at:	{"host": "localhost", "uiPort": "32785", "hecPort": "32784", "managementPort": "32783"}
    integration_test.go:275: 
        	Error Trace:	/home/runner/work/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/splunkhecexporter/integration_test.go:275
        	            				/home/runner/work/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/splunkhecexporter/integration_test.go:384
        	Error:      	Received unexpected error:
        	            	Post "https://localhost:32784/services/collector": http: server gave HTTP response to HTTPS client
        	Test:       	TestSplunkHecExporter/Events_to_Splunk_-_metrics
        	Messages:   	Must not error while sending Metrics data

=== FAIL: . TestSplunkHecExporter (re-run 1) (98.87s)
{"level":"info","ts":1737137875.9798286,"caller":"splunkhecexporter/integration_test.go:147","msg":"Splunk running at:","host":"localhost","uiPort":32785,"hecPort":32784,"managementPort":32783}
Host value updated successfully!
Host value updated successfully!
Host value updated successfully!
Host value updated successfully!
Tearing down...
Stopping container
Removed Docker image: splunk/splunk:9.1.2
Command output:
Untagged: splunk/splunk:9.1.2
Untagged: splunk/splunk@sha256:7eca42b8a7a777053e1d0420287a683167ed228ab09444b35b3f4a8f54cb6cd4
Deleted: sha256:54b3e88a4bc36556bec5a547b078e4a5ab49f19bc83fca8ad9fbf5b0cd5af0a8
Deleted: sha256:cad5dbccfc0639faa3d9600d4d171015c0b287ee316be182d578f36c9cd6[373](https://github.com/open-telemetry/opentelemetry-collector-contrib/actions/runs/12834416578/job/35791747000?pr=37289#step:5:374)d
Deleted: sha256:266e594b38deda00584697b9e6f316a2307df7f63dfb334e1b4413448e91d3ef
Deleted: sha256:c6405c59c934c9375241353835c4f038eee4e3d26a1e6b4226accb2b7497ca36
Deleted: sha256:4f68d661d8ace933a19d087d15fa86597c3de9e2cbec6d829aa8597d0f79ca88
Deleted: sha256:361a7590963fea4daf056ebe7c3f9e1cd6e0add0460b92986174d389ac5b2841
Deleted: sha256:6f8f8f17cfde47db0372a2a2753f1afcf10f715e2c88a16b2c163d411f17b5a8
Deleted: sha256:8880b26d0e2f7d79cafc8781e6e336bc2c58014edb7d85bafee6cc5623f2c964
Deleted: sha256:ac2046dbab26ae4387b511bcee0bb46fa4fdda0eedfddf2be4d2e379960b8ff7
Deleted: sha256:b7429c9ec83387e7fa7ee8d4c638f152e5ac67de20c323968874f8a508ce72aa
Deleted: sha256:9c12e5e32f3b2bf048ccacf09e0c790150819a5d15c71cdff37b40f35abaa526
Deleted: sha256:8f42ad26ccdae7ec04dac9501e3c011a88c8663559699974ecf1697999914f0d


=== FAIL: . TestSplunkHecExporter/Events_to_Splunk_-_traces (re-run 1) (0.01s)
    logger.go:146: 2025-01-17T18:19:36.600Z	INFO	Test -> Splunk running at:	{"host": "localhost", "uiPort": "32789", "hecPort": "32788", "managementPort": "32787"}
    integration_test.go:291: 
        	Error Trace:	/home/runner/work/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/splunkhecexporter/integration_test.go:291
        	            				/home/runner/work/opentelemetry-collector-contrib/opentelemetry-collector-contrib/exporter/splunkhecexporter/integration_test.go:386
        	Error:      	Received unexpected error:
        	            	Post "https://localhost:32788/services/collector": http: server gave HTTP response to HTTPS client
        	Test:       	TestSplunkHecExporter/Events_to_Splunk_-_traces
        	Messages:   	Must not error while sending Trace data

=== FAIL: . TestSplunkHecExporter (re-run 1) (99.46s)
{"level":"info","ts":1737137976.5953984,"caller":"splunkhecexporter/integration_test.go:147","msg":"Splunk running at:","host":"localhost","uiPort":32789,"hecPort":32788,"managementPort":32787}
Host value updated successfully!
Host value updated successfully!
Host value updated successfully!
Host value updated successfully!
Tearing down...
Stopping container
Removed Docker image: splunk/splunk:9.1.2
Command output:
Untagged: splunk/splunk:9.1.2
Untagged: splunk/splunk@sha256:7eca42b8a7a777053e1d0420287a683167ed228ab09444b35b3f4a8f54cb6cd4
Deleted: sha256:54b3e88a4bc36556bec5a547b078e4a5ab49f19bc83fca8ad9fbf5b0cd5af0a8
Deleted: sha256:cad5dbccfc0639faa3d9600d4d171015c0b287ee316be182d578f36c9cd6373d
Deleted: sha256:266e594b38deda00584697b9e6f316a2307df7f63dfb334e1b4413448e91d3ef
Deleted: sha256:c6405c59c934c9[375](https://github.com/open-telemetry/opentelemetry-collector-contrib/actions/runs/12834416578/job/35791747000?pr=37289#step:5:376)241353835c4f038eee4e3d26a1e6b4226accb2b7497ca36
Deleted: sha256:4f68d661d8ace933a19d087d15fa86597c3de9e2cbec6d829aa8597d0f79ca88
Deleted: sha256:361a7590963fea4daf056ebe7c3f9e1cd6e0add0460b92986174d389ac5b2841
Deleted: sha256:6f8f8f17cfde47db0372a2a2753f1afcf10f715e2c88a16b2c163d411f17b5a8
Deleted: sha256:8880b26d0e2f7d79cafc8781e6e336bc2c58014edb7d85bafee6cc5623f2c964
Deleted: sha256:ac2046dbab26ae4387b511bcee0bb46fa4fdda0eedfddf2be4d2e[379](https://github.com/open-telemetry/opentelemetry-collector-contrib/actions/runs/12834416578/job/35791747000?pr=37289#step:5:380)960b8ff7
Deleted: sha256:b7429c9ec83387e7fa7ee8d4c638f152e5ac67de20c323968874f8a508ce72aa
Deleted: sha256:9c12e5e32f3b2bf048ccacf09e0c790150819a5d15c71cdff37b40f35abaa526
Deleted: sha256:8f42ad26ccdae7ec04dac9501e3c011a88c8663559699974ecf1697999914f0d


DONE 2 runs, 202 tests, 13 failures in 554.092s
@pjanotti pjanotti added needs triage New item requiring triage flaky test a test is flaky exporter/splunkhec and removed needs triage New item requiring triage labels Jan 21, 2025
Copy link
Contributor

Pinging code owners:

See Adding Labels via Comments if you do not have permissions to add labels yourself.

Copy link
Contributor

Pinging code owners for exporter/splunkhec: @atoulme @dmitryax. See Adding Labels via Comments if you do not have permissions to add labels yourself. For example, comment '/label priority:p2 -needs-triaged' to set the priority and remove the needs-triaged label.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant