Yes, you can download the APK from the Signal website (https://signal.org/android/apk/) and install it with adb. If you have trust issues then you should think about compiling the source code yourself—it's very easy in Android Studio—and installing with adb.
Can one still side load Signal via adb install?