Cross compiling for MUSL on Ubuntu 24.10 encountered undefined symbol: __ubsan_handle_type_mismatch_v1

[songday]

The errors were:

   Compiling sqlx v0.8.3
error: /home/a/dialogflow/target/debug/deps/libsqlx_macros-8a0d401e67bf7705.so: undefined symbol: __ubsan_handle_type_mismatch_v1
  --> /home/a/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/sqlx-0.8.3/src/lib.rs:64:1
   |
64 | pub extern crate sqlx_macros;
   | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

error[E0432]: unresolved imports `self::encode::Encode`, `self::decode::Decode`, `super::Decode`, `super::Encode`, `super::FromRow`, `super::Type`
   --> /home/a/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/sqlx-0.8.3/src/lib.rs:133:9
    |
133 | pub use self::encode::Encode;
    |         ^^^^^^^^^^^^^^^^^^^^
...
144 | pub use self::decode::Decode;
    |         ^^^^^^^^^^^^^^^^^^^^
...
158 |     pub use super::Decode;
    |             ^^^^^^^^^^^^^
159 |     pub use super::Encode;
    |             ^^^^^^^^^^^^^
160 |     pub use super::Executor;
161 |     pub use super::FromRow;
    |             ^^^^^^^^^^^^^^
...
165 |     pub use super::Type;
    |             ^^^^^^^^^^^

I compiled with zig

I ran apt-cache show libubsan1 got this:

Package: libubsan1
Architecture: amd64
Version: 14.2.0-4ubuntu2
Multi-Arch: same
Priority: optional
Build-Essential: yes
Section: libs
Source: gcc-14
Origin: Ubuntu
Maintainer: Ubuntu Core developers <ubuntu-devel-discuss@lists.ubuntu.com>
Original-Maintainer: Debian GCC Maintainers <debian-gcc@lists.debian.org>
Bugs: https://bugs.launchpad.net/ubuntu/+filebug
Installed-Size: 3364
Depends: gcc-14-base (= 14.2.0-4ubuntu2), libc6 (>= 2.34), libgcc-s1 (>= 3.3), libstdc++6 (>= 4.1.1)
Filename: pool/main/g/gcc-14/libubsan1_14.2.0-4ubuntu2_amd64.deb
Size: 1177964
MD5sum: 2cee789e3feca5cfc5e2fdece436ef01
SHA1: 5141da4d34b598d3f5bd6ebcb7e53a07faf9831b
SHA256: 79a6a7471dccda7cdc23efde5d4bf1feb219ef95b909bb8fa01e4a5ca3949f07
SHA512: 9cb9df2ff89d1e228b76d1b7b940432ebc800b68e936302fae85b596a778d0639b47ff1897338d8a82a0240c789d559d193d0355c8f6bfb36554b3ec767aaca5
Homepage: http://gcc.gnu.org/
Description-en: UBSan -- undefined behaviour sanitizer (runtime)
 UndefinedBehaviorSanitizer can be enabled via -fsanitize=undefined.
 Various computations will be instrumented to detect undefined behavior
 at runtime. Available for C and C++.
Description-md5: 0d50b6d1808d18442db720f04627b846
Task: xubuntu-desktop, ubuntustudio-desktop, ubuntukylin-desktop, ubuntukylin-desktop, ubuntukylin-desktop-minimal, ubuntu-mate-core, ubuntu-mate-desktop, ubuntu-unity-desktop, edubuntu-desktop-gnome-minimal, edubuntu-desktop-gnome, edubuntu-desktop-gnome-raspi, ubuntucinnamon-desktop-minimal, ubuntucinnamon-desktop

and I found libubsan library:

 gcc -print-file-name=libubsan.so
/usr/lib/gcc/x86_64-linux-gnu/14/libubsan.so

ll /usr/lib/gcc/x86_64-linux-gnu/14/libubsan.so
lrwxrwxrwx 1 root root 39 Sep  8  2024 /usr/lib/gcc/x86_64-linux-gnu/14/libubsan.so -> ../../../x86_64-linux-gnu/libubsan.so.1

I compiled successfully on WSL with Ubuntu image.
But this Ubuntu 24.10 ran on VirtualBox, not sure if this cause this problem.

[CorvusPrudens]

This should probably be an issue, not a discussion.

I've also run into this issue specifically on GitHub runners (ubuntu-24.04, with Rust nightly pinned to 2024-11-01), and I've been completely unable to work around it, let alone solve it.

[sszabo11]

Same issue here, keep re-running it every day to see if bug is fixed. I am building on GitHub actions. Tried other ubuntu versions but same error.

[CorvusPrudens]

I compiled with zig

Ah, yes this seems to be a common factor. I happened to be using Zig via cargo-lambda to compile for an AWS lambda function. Luckily, I'm not deploying to arm runners, so I can just use the Rust toolchain, which indeed solved my problem.

As for why Zig fails, I have no leads. ubsan is, as far as I understand, an undefined behavior sanitizer tool in the LLVM suite. I'm not sure why one of sqlx's dependencies wants to link to the ubsan runtime in the first place. I read that this was discouraged, probably in part for the trouble it's caused us here. Maybe it's a C/C++ dependency.

I did not pin my Zig version, so I'm guessing the latest version of the Zig toolchain caused the problem. If you can't compile without Zig, I'd bet pinning the version to one a few months ago will serve as a temporary solution.

[songday]

I compiled my project with this tool: https://github.com/rust-cross/cargo-zigbuild, it worked, and it used the same version of Zig I tried before, strange.

[sszabo11]

I am building with zig version 0.13.0 and it is working. I am using cargo-lambda through cargo install cargo-lambda instead of originally pip install cargo-lambda, that way I can control the zig version. When I use zig version 0.14.0 it doesn't work throwing the error above. However zig version 0.13.0 does work. I am building on Github Actions. Make sure to explicitly install zig version 0.13.0