fluent-bit:3.2.5-debug container is not a debug-variant but a minimal one

[jeepee]

The debug-container corresponding with release 3.2.5 is not actually a container image with debug-tools, but a minimal container without any binaries except the ones needed to run the fluent-bit and fluent-bit-watchers.

Inspecting the layers it seems like the debug variant only differs in the last two layers from the non-debug variant, which only contain the configuration-files and the binaries.

3.2.5:

IMAGE          CREATED       CREATED BY                                      SIZE      COMMENT
ac4926cfa527   4 weeks ago   ENTRYPOINT ["/fluent-bit/bin/fluent-bit-watc…   0B        buildkit.dockerfile.v0
<missing>      4 weeks ago   COPY /fluent-bit/fluent-bit /fluent-bit/bin/…   2.17MB    buildkit.dockerfile.v0
<missing>      4 weeks ago   COPY conf/fluent-bit.conf conf/fluent-bit.ya…   5.42kB    buildkit.dockerfile.v0
<missing>      4 weeks ago   LABEL Description=Fluent Bit docker image Ve…   0B        buildkit.dockerfile.v0
<missing>      6 weeks ago   CMD ["/fluent-bit/bin/fluent-bit" "-c" "/flu…   0B        buildkit.dockerfile.v0
<missing>      6 weeks ago   ENTRYPOINT ["/fluent-bit/bin/fluent-bit"]       0B        buildkit.dockerfile.v0
<missing>      6 weeks ago   EXPOSE map[2020/tcp:{}]                         0B        buildkit.dockerfile.v0
<missing>      6 weeks ago   COPY /fluent-bit /fluent-bit # buildkit         50.4MB    buildkit.dockerfile.v0
<missing>      6 weeks ago   COPY /etc/ssl/certs /etc/ssl/certs # buildkit   228kB     buildkit.dockerfile.v0
<missing>      6 weeks ago   COPY /dpkg / # buildkit                         16.6MB    buildkit.dockerfile.v0
<missing>      6 weeks ago   LABEL description=Fluent Bit multi-architect…   0B        buildkit.dockerfile.v0
<missing>      6 weeks ago   ENV FLUENT_BIT_VERSION=3.2.5                    0B        buildkit.dockerfile.v0
<missing>      6 weeks ago   ARG RELEASE_VERSION=3.2.5                       0B        buildkit.dockerfile.v0
<missing>      N/A                                                           126kB
<missing>      N/A                                                           2.31MB
<missing>      N/A                                                           291kB
<missing>      N/A                                                           5.9MB
<missing>      N/A                                                           12.8MB
<missing>      N/A                                                           233kB
<missing>      N/A                                                           346B
<missing>      N/A                                                           497B
<missing>      N/A                                                           0B
<missing>      N/A                                                           64B
<missing>      N/A                                                           0B
<missing>      N/A                                                           149B
<missing>      N/A                                                           0B
<missing>      N/A                                                           1.46MB
<missing>      N/A                                                           22.9kB
<missing>      N/A                                                           271kB

3.2.5-debug:

IMAGE          CREATED       CREATED BY                                      SIZE      COMMENT
baa14fa4e5e9   6 weeks ago   CMD ["/fluent-bit/bin/fluent-bit" "-c" "/flu…   0B        buildkit.dockerfile.v0
<missing>      6 weeks ago   ENTRYPOINT ["/fluent-bit/bin/fluent-bit"]       0B        buildkit.dockerfile.v0
<missing>      6 weeks ago   EXPOSE map[2020/tcp:{}]                         0B        buildkit.dockerfile.v0
<missing>      6 weeks ago   COPY /fluent-bit /fluent-bit # buildkit         50.4MB    buildkit.dockerfile.v0
<missing>      6 weeks ago   COPY /etc/ssl/certs /etc/ssl/certs # buildkit   228kB     buildkit.dockerfile.v0
<missing>      6 weeks ago   COPY /dpkg / # buildkit                         16.6MB    buildkit.dockerfile.v0
<missing>      6 weeks ago   LABEL description=Fluent Bit multi-architect…   0B        buildkit.dockerfile.v0
<missing>      6 weeks ago   ENV FLUENT_BIT_VERSION=3.2.5                    0B        buildkit.dockerfile.v0
<missing>      6 weeks ago   ARG RELEASE_VERSION=3.2.5                       0B        buildkit.dockerfile.v0
<missing>      N/A                                                           126kB
<missing>      N/A                                                           2.31MB
<missing>      N/A                                                           291kB
<missing>      N/A                                                           5.9MB
<missing>      N/A                                                           12.8MB
<missing>      N/A                                                           233kB
<missing>      N/A                                                           346B
<missing>      N/A                                                           497B
<missing>      N/A                                                           0B
<missing>      N/A                                                           64B
<missing>      N/A                                                           0B
<missing>      N/A                                                           149B
<missing>      N/A                                                           0B
<missing>      N/A                                                           1.46MB
<missing>      N/A                                                           22.9kB
<missing>      N/A                                                           271kB

The previous debug-container 3.1.8-debug was built as expected though:

IMAGE          CREATED        CREATED BY                                      SIZE      COMMENT
6c5fb758e0c9   5 months ago   ENTRYPOINT ["/fluent-bit/bin/fluent-bit-watc…   0B        buildkit.dockerfile.v0
<missing>      5 months ago   COPY /fluent-bit/fluent-bit /fluent-bit/bin/…   2.06MB    buildkit.dockerfile.v0
<missing>      5 months ago   COPY conf/fluent-bit.conf conf/fluent-bit.ya…   5.42kB    buildkit.dockerfile.v0
<missing>      5 months ago   LABEL Description=Fluent Bit docker image Ve…   0B        buildkit.dockerfile.v0
<missing>      5 months ago   CMD ["/fluent-bit/bin/fluent-bit" "-c" "/flu…   0B        buildkit.dockerfile.v0
<missing>      5 months ago   EXPOSE map[2020/tcp:{}]                         0B        buildkit.dockerfile.v0
<missing>      5 months ago   COPY /fluent-bit /fluent-bit # buildkit         49.1MB    buildkit.dockerfile.v0
<missing>      5 months ago   RUN |1 RELEASE_VERSION=3.1.8 /bin/sh -c rm -…   0B        buildkit.dockerfile.v0
<missing>      5 months ago   RUN |1 RELEASE_VERSION=3.1.8 /bin/sh -c echo…   1.39GB    buildkit.dockerfile.v0
<missing>      5 months ago   ENV DEBIAN_FRONTEND=noninteractive              0B        buildkit.dockerfile.v0
<missing>      5 months ago   COPY /usr/bin/qemu-aarch64-static /usr/bin/ …   10.4MB    buildkit.dockerfile.v0
<missing>      5 months ago   COPY /usr/bin/qemu-arm-static /usr/bin/ # bu…   9.04MB    buildkit.dockerfile.v0
<missing>      5 months ago   LABEL description=Fluent Bit multi-architect…   0B        buildkit.dockerfile.v0
<missing>      5 months ago   ENV FLUENT_BIT_VERSION=3.1.8                    0B        buildkit.dockerfile.v0
<missing>      5 months ago   ARG RELEASE_VERSION=3.1.8                       0B        buildkit.dockerfile.v0
<missing>      6 months ago   /bin/sh -c #(nop)  CMD ["bash"]                 0B
<missing>      6 months ago   /bin/sh -c #(nop) ADD file:d13afefcc2b0b02b5…   74.8MB

[github-actions]

@jeepee this issue was automatically closed because it did not follow the issue template

[joshuabaird]

Hi @jeepee! This workflow shows that our fluent-bit:3.2.5-debug image was built from our Dockerfile.debug which is based on the upstream fluent/fluent-bit:3.2.5-debug image.

I'm not super familiar with these "debug" images -- but if you pull fluent/fluent-bit:3.2.5-debug, are you seeing what you would expect?

[jeepee]

Hi @jeepee! This workflow shows that our fluent-bit:3.2.5-debug image was built from our Dockerfile.debug which is based on the upstream fluent/fluent-bit:3.2.5-debug image.

I'm not super familiar with these "debug" images -- but if you pull fluent/fluent-bit:3.2.5-debug, are you seeing what you would expect?

After some more digging I came to the same conclusion.
You are right that the bug is in the fluent/fluent-bit:3.2.5-debug base-image.

Both the previous and the next tags are both working as expected, but that one does not.
Unfortunately, that is exactly the tag chosen to be released in the fluentbit-operator project.

This issue will be resolved once a new release is made of the fluentbit package that is based on any other base-image besides 3.2.5-debug.
I'm currently not blocked on this, I have downgraded to the 3.1.8-debug image for now.

[joshuabaird]

Thanks for confirming. You may want to open an upstream issue so that the fluent-bit team is aware.

While fluent-operator, by default, will use the 3.2.5 image -- you are free to override this image tag in the Helm values or in the fluent-bit CR directly.

[cw-Guo]

we can bump fluent-bit version to the latest.