macOS 10.14 tracking issue

[mistydemeo]

macOS 10.14 beta 1 is out, along with betas of Xcode and the CLT.

Homebrew

• CLT doesn't have a traditional header layout, breaking some builds - Mojave: require CLT header package brew#4334 / Mojave: use the CLT SDK where necessary brew#4335. We merged Mojave: require CLT header package brew#4334, but may circle back to the other branch later.
• ruby-macho didn't understand new load commands - Add new load commands ruby-macho#90

Formulae

• exa's cmake scripts try to call clang with --target=x86_64-apple-darwin, which is broken - macOS 10.14 tracking issue #28817 (comment)
• Go's linker is confused by the new load commands - Go: support all load commands #29090
• Nettle's make check is confused by ___chkstk_darwin - macOS 10.14 tracking issue #28817 (comment)
• Node's compiler version and Xcode version regexes don't support multi-digit major versions - node: fix compiler/Xcode detection for upcoming versions #28832
• Node's bundled npm has the same version detection bug as node itself
• Python can't find tkinter - Python: set flags for CLT on 10.14 #28733. Fixed by Mojave: require CLT header package brew#4334.
• texi2html's tarball cannot be extracted by the system tar or GNU tar - Update texi2html for 10.14 compatibility #29340

[DomT4]

I can't get subversion to build on 10.14. It craps out during the swig bindings stage IIRC. I'll try and produce a full build log whenever I work out why my VM has suddenly lost the ability to connect to the internet 🙃.

[ilovezfs]

did you install /Library/Developer/CommandLineTools/Packages/macOS_SDK_headers_for_macOS_10.14.pkg yet?

[DomT4]

No. I'll do that & see how it goes. (I really can't work out what they're trying to achieve with the CLT changes in 10.14 but 🤷‍♂️)

[DomT4]

Yeah, that resolved the issue.

[ilovezfs]

does Homebrew/brew#4299 also resolve it without macOS_SDK_headers_for_macOS_10.14.pkg ?

[DomT4]

Is there a clean way to uninstall macOS_SDK_headers_for_macOS_10.14.pkg without having to disable system integrity & manually wipe out /usr/include?

[ilovezfs]

I don't know whether pkgutil --unlink still works despite having been made undocumented. Maybe?

[ilovezfs]

btw csrutil enable --without fs can ease testing without complete SIPlessness

[DomT4]

sudo pkgutil --unlink com.apple.pkg.CLTools_Executables seems to do nothing at least, and apparently that's the right one to aim for:

pkgutil --file-info /Library/Developer/CommandLineTools/Packages/macOS_SDK_headers_for_macOS_10.14.pkg

pkgid: com.apple.pkg.CLTools_Executables
pkg-version: 10.0.0.0.1.1527767617
install-time: 1528420005
uid: 0
gid: 80
mode: 644

I don't mind disabling SIP entirely/partially as it's only a VM; was just wondering if I could avoid rebooting the thing really, heh.

[DomT4]

Somehow subversion is now building fine, without that PR & with /usr/include killed. Cue confusion.

[DomT4]

nettle fails to build on the make check stage:

PASS: ecdh
PASS: eddsa-compress
PASS: eddsa-sign
PASS: eddsa-verify
PASS: ed25519
PASS: cxx
PASS: sexp-conv
PASS: pkcs1-conv
PASS: nettle-pbkdf2
Exported symbols in libnettle.a, lacking the nettle prefix:
00000000000001b0 T ____chkstk_darwin
0000000000000230 T ____chkstk_darwin
0000000000000350 T ____chkstk_darwin
0000000000000360 T ____chkstk_darwin
0000000000000380 T ____chkstk_darwin
FAIL: symbols
PASS: dlopen
====================
1 of 94 tests failed
====================
make[1]: *** [check] Error 1
make: *** [check] Error 2

[mistydemeo]

00000000000001b0 T ____chkstk_darwin
0000000000000230 T ____chkstk_darwin
0000000000000350 T ____chkstk_darwin
0000000000000360 T ____chkstk_darwin
0000000000000380 T ____chkstk_darwin

This may be from the new LLVM version; it looks like the ___chkstk_darwin function was added as a part of stack checking. Essentially every binary compiled with Xcode 10 has ___chkstk_darwin.

I found a reference to this in this LLVM code review: https://reviews.llvm.org/D40857

[DomT4]

Thanks! That does indeed seem to be the case, poking around with nm. It looks like it only creeps into most rather than all libraries/binaries; I'm not sure why it doesn't appear completely consistently.

I've opened a PR with a tested fix in #28958. Are we reporting this stuff upstream yet or waiting to see what happens over time?

[mistydemeo]

Are we reporting this stuff upstream yet or waiting to see what happens over time?

I'm reporting things that have been documented in release notes or otherwise seem to be intentional, and stuff that might not be I'm going to let sit for a few betas to see what happens. Not sure where this one falls, tbh!

[uyjulian]

There is an issue with tar archives containing multiple files with different cases on APFS case-insensitive filesystems, such as gobject-introspection (gobject-introspection-1.56.1/docs/reference/html/gi-gitypelib.html). It will fail with "Can't unlink already-existing object".

EASY WAY OUT for users: brew install <formulae_name> --force-bottle

FIX for developers/build-from-source: Install 10.14 Beta 6.

HACK for developers/build-from-source for 10.14 Beta 5 and lower: Install libarchive, then in /usr/local/Homebrew/Library/Homebrew/unpack_strategy/tar.rb in line 17 change "xf" to "xfk" and in line 17 change "tar" to "/usr/local/opt/libarchive/bin/tar".

[lukeberry99]

Hi @uyjulian I'm trying to install emacs-plus from d12frosted/emacs-plus cask... I'm getting gobject-introspection-1.56.1/docs/reference/html/gi-gitypelib.html: Can't unlink already-existing object

How wouid I go about fixing this? Where do I find download_strategy.rb? I'm really new to homebrew, any help would be greatly appreciated. Cheers!

[uyjulian]

@lukeberry99 /usr/local/Homebrew/Library/Homebrew/download_strategy.rb

You could have also found it yourself by running mdfind download_strategy.rb

[theeternalsw0rd]

I've noticed a few weird issues. Files and directories are installing with weird permissions. Sometimes 0444, sometimes 0555. I've also had a similar issue to Homebrew/legacy-homebrew#40653 when trying to compile exa and the same workaround worked.

Exa also won't reinstall if its bin directory is not empty and won't install if it's bin directory does not exist. I had to uninstall exa and manually create the /usr/local/Cellar/exa/0.8.0/bin directory and then use brew reinstall instead of install because I guess the existence of the /usr/local/Cellar/exa/0.8.0 is enough to make brew think it is already installed.

I've also had issues where a package will fail to reinstall only to work the next time without changing anything.

Figured maybe something was wrong with my environment but brew doctor only gives a few warnings about some third party libraries present and the fact I'm running 10.14. I'm not sure what else to check.

[mistydemeo]

I've also had a similar issue to Homebrew/legacy-homebrew#40653 when trying to compile exa and the same workaround worked.

Filed a radar: rdar://41651999. It looks like libgcc_s.10.4 and libgcc_s.10.5 are missing. Certain clang flags causes it to try to link against them - specifically values for --target. Namely:

• --target=x86_64-apple-darwin - tries to link against libgcc_s.10.4
• --target=x86_64-apple-darwin4 through --target=x86_64-apple-darwin8 - tries to link against libgcc_s.10.4
• --target=x86_64-apple-darwin9 - tries to link against libgcc_s.10.5

This makes sense since Mac OS X 10.0 was Darwin 4, 10.4 was Darwin 8, 10.5 was Darwin 9, etc. It tracks that it tries to link against those specific libgcc_s versions for those targets. exa trying to pass --target=x86_64-apple-darwin is probably having the unexpected effect of it ending up targeting a very old OS X libc version, which is not obvious. It works as long as the stub libgcc_s files exist, and fails if they're gone.

[mistydemeo]

@uyjulian @lukeberry99 This is the same issue as the texi2html bug we've got in the list. I've filed a radar already, so I expect to see it fixed in an upcoming beta.

[mistydemeo]

@theeternalsw0rd I can't reproduce your permissions issues. I'll need your brew gist-logs exa and some more info about your setup to diagnose.

[karanmartian]

Hi @uyjulian regarding the gobject-introspection-1.56.1/docs/reference/html/gi-gitypelib.html). It will fail with "Can't unlink already-existing object issue, i am facing this error too and trying to edit the .rb file. When you say add "k" at line 236 you are saying "xk" or replace the "x" with "k" or some << k. I did not get that part. I am stuck at this error.

[uyjulian]

@karanmartian Set it to "xk"

[theeternalsw0rd]

@mistydemeo my other permissions issues didn't show up after the latest Xcode beta update. Still have the issue with exa though https://gist.github.com/theeternalsw0rd/d714c0935c32ef4a15516cca52e4e9cd (I get the same error whether installing or reinstalling so I'm only including an attempted reinstall)

[theeternalsw0rd]

exiftool won't build due to a lack of config.h for the system perl. I'm waiting on filing a bug with Apple until I've installed the latest OS build.

[karanmartian]

@uyjulian I made the required change using nano editor on the two lines in homebrew’s download_strategy.rb. nano allows me to save it but somehow the file is reverted back to the original version when the error shows up again on bash. Its not sticking..

[ilovezfs]

You have to set HOMEBREW_DEVELOPER=1 in the environment or have used any brew developer command ever to suppress that behavior.

[karanmartian]

Ok I set the that env variable to 1 and edited and now I get all sorts of errors in the syntax on bash:

/System/Library/Frameworks/Ruby.framework/Versions/2.3/usr/lib/ruby/2.3.0/rubygems/core_ext/kernel_require.rb:55:in require': /usr/local/Homebrew/Library/Homebrew/download_strategy.rb:194: syntax error, unexpected << (SyntaxError) <<<<<<< Updated upstream

[DomT4]

postgresql and family are fixed, at the cost of the Mojave bottles lacking installed documentation for now.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.

[fxcoudert]

An update on the remaining Mojave / Xcode 10 issues, with links to the upstream bug reports. By order of install counts:

More than 100 installs per month

• carthage carthage 0.31.0 #32544
• phantomjs phantomjs: remove and migrate to cask #32538
• docker-machine-driver-xhyve Failure to build with Xcode 10 / macOS 10.14 Mojave machine-drivers/docker-machine-driver-xhyve#210
• qt@5.5 qt@5.5: delete #32565
• pypy pypy: fix build for Xcode 10 #32574
• xctool xctool 0.3.5 #32539
• unar unar: fix build for Xcode 10 #33176
• pgloader pgloader 3.5.2 fails to compile from source: Undefined instruction: MOVZXD dimitri/pgloader#832
• cockroach Cockroach fails to build on macOS 10.14 Mojave cockroachdb/cockroach#30765
• chisel Chisel fails to build with macOS 10.14 SDK facebook/chisel#249
• infer infer 0.15.0 fails to build on macOS with ocaml 4.07.0 and opam 2.0.0 facebook/infer#1001
• duti duti 1.5.4 fails to build on macOS 10.14 Mojave moretension/duti#31
• perl-build
• salt salt: fix build on Mojave #33239
• percona-toolkit percona-toolkit 3.0.12 #33240
• uwsgi uwsgi: fix build with 10.14 SDK #33235
• pypy3 pypy: fix build for Xcode 10 #32574
• graph-tool graph-tool 2.27: upstream fix and with-expat option added #32851
• swift swift 4.2 #32223
• crosstool-ng
• fpc
• crf++ crf++: update URL #33232
• mapnik mapnik 3.0.21 #33077
• irrlicht https://sourceforge.net/p/irrlicht/bugs/442/
• makensis Failure to unpack and verify ZIP file brew#4910

10 to 100 installs per month

• clozure-cl ccl failed in OS X 10.14 Mojave. Clozure/ccl#150
• ngspice
• perl@5.18
• opencascade opencascade 7.3.0 #32454
• podofo podofo 0.9.6 #33237
• bluepill bluepill does not compile with Xcode 10 MobileNativeFoundation/bluepill#279 bluepill 3.1.0 #33322
• gforth
• mytop
• snap7
• dc3dd dc3dd: fix build #33234
• percona-xtrabackup
• innotop
• vice
• ejabberd
• tcc
• afsctool
• tcptrack
• riak
• sngrep
• mapserver mapserver 7.2.1 #33276
• pxz deleted, pxz: delete #33243
• libvoikko
• freeipmi
• platypus
• libmxml Please tag a new release michaelrsweet/mxml#231
• postgrest postgrest 0.5.0.0 fails to build on macOS Mojave PostgREST/postgrest#1187
• osc
• kibana@4.4
• taylor
• gpa gpa 0.10.0 #33381
• nethack4
• bup
• puzzles
• ppl ppl: fix build with Xcode 10 #32577
• chuck
• apib
• wesnoth wesnoth 1.14.5 #33277
• trafficserver
• exiftran
• sfk sfk 1.9.3.2 #33315
• mariadb-connector-odbc
• blink1
• bigloo bigloo 4.3c #32044
• wellington New release? wellington/wellington#213
• siril
• fstar
• fragroute
• easyrpg-player
• dante
• cpansearch
• pcapplusplus
• tracebox
• reposurgeon
• auditbeat license issue, see kibana 6.3.0 #28995

Less than 10 installs per month

• xmoto
• rswift Official version for Xcode 10 mac-cain13/R.swift#449
• mlkit
• cspice
• wordplay
• rom-tools
• libmonome
• clutter-gst
• np2
• dnsdist dnsdist: revision for mojave #33712
• fdroidserver
• corebird corebird: delete #33278
• ape
• yacas
• regex-opt
• apache-brooklyn-cli
• mosml
• luvit
• coccinelle
• serialosc
• open-vcdiff
• lasso
• fizmo
• opensyobon
• nesemu2
• libetonyek
• sync_gateway
• sary
• lsh
• le

[PhilCai1993]

@fxcoudert facebook/chisel#249 (comment)
facebook/chisel
Some compiler errors are caused by Xcode new build system.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.

[MikeMcQuaid]

Closing as Mojave has been released for a while now and thinks are working well. Great work everyone 🎉

[nurey]

I am getting the postgresql/perl issue still, when running brew install postgresql --with-python on Mojave.

checking for perl.h... no
configure: error: header file <perl.h> is required for Perl