xcodebuild経由だとこのあたりの環境変数が追加されてることが確認できました

DYLD_FALLBACK_FRAMEWORK_PATH=/Applications/Xcode-12.5.app/Contents/SharedFrameworks:/Applications/Xcode-12.5.app/Contents/Developer/Platforms/MacOSX.platform/Developer/Library/Frameworks DYLD_FALLBACK_LIBRARY_PATH=/Applications/Xcode-12.5.app/Contents/Developer/Platforms/MacOSX.platform/Developer/usr/lib DYLD_FRAMEWORK_PATH=/Users/kateinoigakukun/Library/Developer/Xcode/DerivedData/Example-dcyedciowpcsqebafcorbracmhpk/Build/Products/Debug DYLD_LIBRARY_PATH=/Users/kateinoigakukun/Library/Developer/Xcode/DerivedData/Example-dcyedciowpcsqebafcorbracmhpk/Build/Products/Debug