quickemu as AppImage

[zen0bit]

Continuation of

quickemu

• qe-junest
• qe AppImage
• missed dependencies
• debug

quickget

• qg-junest
• qg AppImage
• missed dependencies
• debug

q

• q-junest - partialy
• q AppImage
• missed dependencies
• debug

For debugging was divided into two parts for now.

• quickget
• quickemu

After debug I can add my TUI to easily manage both quickemu and quickget from one script

• q

[zen0bit]

@ivan-hc

[ivan-hc]

To find missing dependeces, run the AppRun into the *.AppDir directory and read the messages.

If they say something like "tar not installed" or "libcapocchia.so not found, no such file or directory":

• check the files available in junest-backups;
• drag/drop the files/directories in the same path in *.AppDir/.junest/ (the directory structure is the same, you know, /usr/lib, /usr/bin...);
• run the AppRun again and watch if the message changes. If yes, add a keyword in the $BINSAVED/$SHARESAVED/$LIBSAVED variable;
• do all the steps listed above until no eror message appear anymore.

As I have said when I have added the script for you, I have found a missing dependence that was not listed in the PKGBUILD (liburing), so I added it in the $DEPENDENCES variable and repeated the script run again... and all I had was the "help" message of you program.

You can try to create an Archimage script again, without my manual changes, to see how I have found missing libraries (my only tools are Thunar (filemanager), Mousepad (texteditor) and Catfish (file finder), on XFCE.

You can perform a deeper debug by learnin more about LD_DEBUG usage, at https://bnikolic.co.uk/blog/linux-ld-debug.html

Also read all messages and perfor all tests using LD_DEBUG.

It is not easy, you have to work more and learn even more about Linux and how libraries/scripts/files work. I'm still learning (this is why I have not uploaded Hypnotix, Bottles and Gnome-boxes AppImages on AM/AppMan... still too much to learn).

[zen0bit]

I have q-junest which pull q for arch but I want include my file (https://github.com/oSoWoSo/DistroHopper/blob/q/q) instead..
q is main program which will AppImage run

#!/bin/sh

# NAME OF THE APP BY REPLACING "SAMPLE"
APP=q
BIN=q #CHANGE THIS IF THE NAME OF THE BINARY IS DIFFERENT FROM "$APP" (for example, the binary of "obs-studio" is "obs")
DEPENDENCES="ca-certificates qemu coreutils grep jq procps python3 cdrtools usbutils util-linux sed spice-gtk swtpm wget xorg-xrandr zsync edk2-ovmf xdg-user-dirs socat liburing"
BASICSTUFF="binutils gzip"
COMPILERS="base-devel"

# CREATE THE APPDIR (DON'T TOUCH THIS)...
wget -q https://github.com/AppImage/AppImageKit/releases/download/continuous/appimagetool-x86_64.AppImage -O appimagetool
chmod a+x appimagetool
mkdir $APP.AppDir

# ENTER THE APPDIR
cd $APP.AppDir

# SET APPDIR AS A TEMPORARY $HOME DIRECTORY, THIS WILL DO ALL WORK INTO THE APPDIR
HOME="$(dirname "$(readlink -f $0)")"

# DOWNLOAD AND INSTALL JUNEST (DON'T TOUCH THIS)
git clone https://github.com/fsquillace/junest.git ~/.local/share/junest
wget -q --show-progress https://github.com/ivan-hc/junest/releases/download/continuous/junest-x86_64.tar.gz
./.local/share/junest/bin/junest setup -i junest-x86_64.tar.gz
rm -f junest-x86_64.tar.gz

# ENABLE MULTILIB (optional)
#echo "
#[multilib]
#Include = /etc/pacman.d/mirrorlist" >> ./.junest/etc/pacman.conf

# ENABLE CHAOTIC-AUR
###./.local/share/junest/bin/junest -- sudo pacman-key --recv-key 3056513887B78AEB --keyserver keyserver.ubuntu.com
###./.local/share/junest/bin/junest -- sudo pacman-key --lsign-key 3056513887B78AEB
###./.local/share/junest/bin/junest -- sudo pacman --noconfirm -U 'https://cdn-mirror.chaotic.cx/chaotic-aur/chaotic-keyring.pkg.tar.zst' 'https://cdn-mirror.chaotic.cx/chaotic-aur/chaotic-mirrorlist.pkg.tar.zst'
###echo "
###[chaotic-aur]
###Include = /etc/pacman.d/chaotic-mirrorlist" >> ./.junest/etc/pacman.conf

# CUSTOM MIRRORLIST, THIS SHOULD SPEEDUP THE INSTALLATION OF THE PACKAGES IN PACMAN (COMMENT EVERYTHING TO USE THE DEFAULT MIRROR)
_custom_mirrorlist(){
    #COUNTRY=$(curl -i ipinfo.io | grep country | cut -c 15- | cut -c -2)
    rm -R ./.junest/etc/pacman.d/mirrorlist
    wget -q https://archlinux.org/mirrorlist/all/ -O - | awk NR==2 RS= | sed 's/#Server/Server/g' >> ./.junest/etc/pacman.d/mirrorlist # ENABLES WORLDWIDE MIRRORS
    #wget -q https://archlinux.org/mirrorlist/?country="$(echo $COUNTRY)" -O - | sed 's/#Server/Server/g' >> ./.junest/etc/pacman.d/mirrorlist # ENABLES MIRRORS OF YOUR COUNTY
}
_custom_mirrorlist

# BYPASS SIGNATURE CHECK LEVEL
sed -i 's/#SigLevel/SigLevel/g' ./.junest/etc/pacman.conf
sed -i 's/Required DatabaseOptional/Never/g' ./.junest/etc/pacman.conf

# UPDATE ARCH LINUX IN JUNEST
./.local/share/junest/bin/junest -- sudo pacman -Syy
./.local/share/junest/bin/junest -- sudo pacman --noconfirm -Syu

# INSTALL THE PROGRAM USING YAY
./.local/share/junest/bin/junest -- yay -Syy
./.local/share/junest/bin/junest -- gpg --keyserver keyserver.ubuntu.com --recv-key C01E1CAD5EA2C4F0B8E3571504C367C218ADD4FF # UNCOMMENT IF YOU USE THE AUR
./.local/share/junest/bin/junest -- yay --noconfirm -S gnu-free-fonts $(echo "$BASICSTUFF $COMPILERS $DEPENDENCES $APP")

# SET THE LOCALE (DON'T TOUCH THIS)
#sed "s/# /#>/g" ./.junest/etc/locale.gen | sed "s/#//g" | sed "s/>/#/g" >> ./locale.gen # UNCOMMENT TO ENABLE ALL THE LANGUAGES
#sed "s/#$(echo $LANG)/$(echo $LANG)/g" ./.junest/etc/locale.gen >> ./locale.gen # ENABLE ONLY YOUR LANGUAGE, COMMENT IF YOU NEED MORE THAN ONE
#rm ./.junest/etc/locale.gen
#mv ./locale.gen ./.junest/etc/locale.gen
rm ./.junest/etc/locale.conf
#echo "LANG=$LANG" >> ./.junest/etc/locale.conf
sed -i 's/LANG=${LANG:-C}/LANG=$LANG/g' ./.junest/etc/profile.d/locale.sh
#./.local/share/junest/bin/junest -- sudo pacman --noconfirm -S glibc gzip
#./.local/share/junest/bin/junest -- sudo locale-gen

# ...ADD THE ICON...
wget -q https://raw.githubusercontent.com/oSoWoSo/quickemu/new-master/.github/logo.png -O ./$APP.png 2>/dev/null

# ...ADD A LAUNCHER
echo "[Desktop Entry]
Version=1.0
Type=Application
Name=q
Comment=
Exec=$BIN
Icon=$APP
Categories=Utility;System;
Terminal=true
StartupNotify=true" >> ./$APP.desktop

# ...AND FINALLY CREATE THE APPRUN, IE THE MAIN SCRIPT TO RUN THE APPIMAGE!
# EDIT THE FOLLOWING LINES IF YOU THINK SOME ENVIRONMENT VARIABLES ARE MISSING
rm -R -f ./AppRun
cat >> ./AppRun << 'EOF'
#!/bin/sh
HERE="$(dirname "$(readlink -f $0)")"
export UNION_PRELOAD=$HERE
export JUNEST_HOME=$HERE/.junest
export PATH=$PATH:$HERE/.local/share/junest/bin
mkdir -p $HOME/.cache
if test -f /etc/resolv.conf; then
    ETC_RESOLV=' --bind /etc/resolv.conf /etc/resolv.conf ' # NEEDED TO CONNECT THE INTERNET
fi
EXEC=$(grep -e '^Exec=.*' "${HERE}"/*.desktop | head -n 1 | cut -d "=" -f 2- | sed -e 's|%.||g')
$HERE/.local/share/junest/bin/junest -n -b "$ETC_RESOLV" -- $EXEC "$@"
EOF
chmod a+x ./AppRun

# REMOVE "READ-ONLY FILE SYSTEM" ERRORS
sed -i 's#${JUNEST_HOME}/usr/bin/junest_wrapper#${HOME}/.cache/junest_wrapper.old#g' ./.local/share/junest/lib/core/wrappers.sh
sed -i 's/rm -f "${JUNEST_HOME}${bin_path}_wrappers/#rm -f "${JUNEST_HOME}${bin_path}_wrappers/g' ./.local/share/junest/lib/core/wrappers.sh
sed -i 's/ln/#ln/g' ./.local/share/junest/lib/core/wrappers.sh
sed -i 's#--bind "$HOME" "$HOME"#--bind /opt /opt --bind /usr/lib/locale /usr/lib/locale --bind /usr/share/fonts /usr/share/fonts --bind /usr/share/themes /usr/share/themes --bind /mnt /mnt --bind /media /media --bind /home /home --bind /run/user /run/user#g' .local/share/junest/lib/core/namespace.sh
sed -i 's/rm -f "$file"/test -f "$file"/g' ./.local/share/junest/lib/core/wrappers.sh

# EXIT THE APPDIR
cd ..

# EXTRACT PACKAGE CONTENT
mkdir base
tar fx $(find ./$APP.AppDir -name $APP-[0-9]*zst | head -1) -C ./base/
VERSION=$(cat ./base/.PKGINFO | grep pkgver | cut -c 10- | sed 's@.*:@@')
mkdir deps

ARGS=$(echo "$DEPENDENCES" | tr " " "\n")
for arg in $ARGS; do
    for var in $arg; do
        tar fx $(find ./$APP.AppDir -name $arg-[0-9]*zst) -C ./deps/
        cat ./deps/.PKGINFO | grep "depend = " | grep -v "makedepend = " | cut -c 10- | grep -v "=\|>\|<" > depdeps
    done
done

DEPS=$(cat ./base/.PKGINFO | grep "depend = " | grep -v "makedepend = " | cut -c 10- | grep -v "=\|>\|<")
for arg in $DEPS; do
    for var in "$arg"; do
        tar fx $(find ./$APP.AppDir -name $arg-[0-9]*zst) -C ./deps/
        cat ./deps/.PKGINFO | grep "depend = " | grep -v "makedepend = " | cut -c 10- | grep -v "=\|>\|<" > depdeps
    done
done

DEPS2=$(cat ./depdeps | uniq)
for arg in $DEPS2; do
    for var in "$arg"; do
        tar fx $(find ./$APP.AppDir -name $arg-[0-9]*zst) -C ./deps/
        cat ./deps/.PKGINFO | grep "depend = " | grep -v "makedepend = " | cut -c 10- | grep -v "=\|>\|<" > depdeps2
    done
done

DEPS3=$(cat ./depdeps2 | uniq)
for arg in $DEPS3; do
    for var in "$arg"; do
        tar fx $(find ./$APP.AppDir -name $arg-[0-9]*zst) -C ./deps/
        cat ./deps/.PKGINFO | grep "depend = " | grep -v "makedepend = " | cut -c 10- | grep -v "=\|>\|<" > depdeps3
    done
done

DEPS4=$(cat ./depdeps3 | uniq)
for arg in $DEPS4; do
    for var in "$arg"; do
        tar fx $(find ./$APP.AppDir -name $arg-[0-9]*zst) -C ./deps/
        cat ./deps/.PKGINFO | grep "depend = " | grep -v "makedepend = " | cut -c 10- | grep -v "=\|>\|<" > depdeps4
    done
done

# REMOVE SOME BLOATWARES
echo Y | rm -R .f ./$APP.AppDir/.cache/yay/*
find ./$APP.AppDir/.junest/usr/share/doc/* -not -iname "*$BIN*" -a -not -name "." -delete #REMOVE ALL DOCUMENTATION NOT RELATED TO THE APP
find ./$APP.AppDir/.junest/usr/share/locale/*/*/* -not -iname "*$BIN*" -a -not -name "." -delete #REMOVE ALL ADDITIONAL LOCALE FILES
rm -R -f ./$APP.AppDir/.junest/etc/makepkg.conf
rm -R -f ./$APP.AppDir/.junest/etc/pacman.conf
rm -R -f ./$APP.AppDir/.junest/usr/include #FILES RELATED TO THE COMPILER
rm -R -f ./$APP.AppDir/.junest/usr/man #APPIMAGES ARE NOT MENT TO HAVE MAN COMMAND
rm -R -f ./$APP.AppDir/.junest/var/* #REMOVE ALL PACKAGES DOWNLOADED WITH THE PACKAGE MANAGER

# IN THE NEXT 4 STEPS WE WILL TRY TO LIGHTEN THE FINAL APPIMAGE PACKAGE
# WE WILL MOVE EXCESS CONTENT TO BACKUP FOLDERS (STEP 1)
# THE AFFECTED DIRECTORIES WILL BE /usr/bin (STEP 2), /usr/lib (STEP 3) AND /usr/share (STEP 4)

BINSAVED="certificates qemu" # Enter here keywords to find and save in /usr/bin
SHARESAVED="certificates SAVESHAREPLEASE" # Enter here keywords or file/folder names to save in both /usr/share and /usr/lib
LIBSAVED="pk p11 alsa jack pipewire pulse libcapstone libfdt libsnappy liblz libdaxctl libnuma libslirp libvdeplug libxdp libbpf liburing" # Enter here keywords or file/folder names to save in /usr/lib

# STEP 1, CREATE A BACKUP FOLDER WHERE TO SAVE THE FILES TO BE DISCARDED (USEFUL FOR TESTING PURPOSES)
mkdir -p ./junest-backups/usr/bin
mkdir -p ./junest-backups/usr/lib/dri
mkdir -p ./junest-backups/usr/share

# STEP 2, FUNCTION TO SAVE THE BINARIES IN /usr/bin THAT ARE NEEDED TO MADE JUNEST WORK, PLUS THE MAIN BINARY/BINARIES OF THE APP
# IF YOU NEED TO SAVE MORE BINARIES, LIST THEM IN THE "BINSAVED" VARIABLE. COMMENT THE LINE "_savebins" IF YOU ARE NOT SURE.
_savebins(){
    mkdir save
    mv ./$APP.AppDir/.junest/usr/bin/*$BIN* ./save/
    mv ./$APP.AppDir/.junest/usr/bin/bash ./save/
    mv ./$APP.AppDir/.junest/usr/bin/bwrap ./save/
    mv ./$APP.AppDir/.junest/usr/bin/env ./save/
    mv ./$APP.AppDir/.junest/usr/bin/sh ./save/
    mv ./$APP.AppDir/.junest/usr/bin/tr ./save/
    mv ./$APP.AppDir/.junest/usr/bin/tty ./save/
    for arg in $BINSAVED; do
        for var in $arg; do
            mv ./$APP.AppDir/.junest/usr/bin/*"$arg"* ./save/
        done
    done
    mv ./$APP.AppDir/.junest/usr/bin/* ./junest-backups/usr/bin/
    mv ./save/* ./$APP.AppDir/.junest/usr/bin/
    rmdir save
}
_savebins 2> /dev/null

# STEP 3, MOVE UNNECESSARY LIBRARIES TO A BACKUP FOLDER (FOR TESTING PURPOSES)
mkdir save

_binlibs(){
    readelf -d ./$APP.AppDir/.junest/usr/bin/* | grep .so | sed 's:.* ::' | cut -c 2- | sed 's/\(^.*so\).*$/\1/' | uniq >> ./list
    mv ./$APP.AppDir/.junest/usr/lib/ld-linux-x86-64.so* ./save/
    mv ./$APP.AppDir/.junest/usr/lib/*$APP* ./save/
    mv ./$APP.AppDir/.junest/usr/lib/*$BIN* ./save/
    mv ./$APP.AppDir/.junest/usr/lib/libdw* ./save/
    mv ./$APP.AppDir/.junest/usr/lib/libelf* ./save/
    for arg in $SHARESAVED; do
        for var in $arg; do
            mv ./$APP.AppDir/.junest/usr/lib/*"$arg"* ./save/
        done
    done
    ARGS=$(tail -n +2 ./list | sort -u | uniq)
    for arg in $ARGS; do
        for var in $arg; do
            mv ./$APP.AppDir/.junest/usr/lib/$arg* ./save/
            find ./$APP.AppDir/.junest/usr/lib/ -name $arg -exec cp -r --parents -t save/ {} +
        done
    done
    rm -R -f $(find ./save/ | sort | grep ".AppDir" | head -1)
    rm list
}

_include_swrast_dri(){
    mkdir ./save/dri
    mv ./$APP.AppDir/.junest/usr/lib/dri/swrast_dri.so ./save/dri/
}

_libkeywords(){
    for arg in $LIBSAVED; do
        for var in $arg; do
            mv ./$APP.AppDir/.junest/usr/lib/*"$arg"* ./save/
        done
    done
}

_liblibs(){
    readelf -d ./save/* | grep .so | sed 's:.* ::' | cut -c 2- | sed 's/\(^.*so\).*$/\1/' | uniq >> ./list
    readelf -d ./save/*/* | grep .so | sed 's:.* ::' | cut -c 2- | sed 's/\(^.*so\).*$/\1/' | uniq >> ./list
    readelf -d ./save/*/*/* | grep .so | sed 's:.* ::' | cut -c 2- | sed 's/\(^.*so\).*$/\1/' | uniq >> ./list
    readelf -d ./save/*/*/*/* | grep .so | sed 's:.* ::' | cut -c 2- | sed 's/\(^.*so\).*$/\1/' | uniq >> ./list
    readelf -d ./save/*/*/*/*/* | grep .so | sed 's:.* ::' | cut -c 2- | sed 's/\(^.*so\).*$/\1/' | uniq >> ./list
    readelf -d ./base/* | grep .so | sed 's:.* ::' | cut -c 2- | sed 's/\(^.*so\).*$/\1/' | uniq >> ./list
    readelf -d ./base/*/* | grep .so | sed 's:.* ::' | cut -c 2- | sed 's/\(^.*so\).*$/\1/' | uniq >> ./list
    readelf -d ./base/*/*/* | grep .so | sed 's:.* ::' | cut -c 2- | sed 's/\(^.*so\).*$/\1/' | uniq >> ./list
    readelf -d ./base/*/*/*/* | grep .so | sed 's:.* ::' | cut -c 2- | sed 's/\(^.*so\).*$/\1/' | uniq >> ./list
    readelf -d ./base/*/*/*/*/* | grep .so | sed 's:.* ::' | cut -c 2- | sed 's/\(^.*so\).*$/\1/' | uniq >> ./list
    readelf -d ./deps/* | grep .so | sed 's:.* ::' | cut -c 2- | sed 's"/\(^.*so\).*$/\1/' | uniq >> ./list
    readelf -d ./deps/*/* | grep .so | sed 's:.* ::' | cut -c 2- | sed 's/\(^.*so\).*$/\1/' | uniq >> ./list
    readelf -d ./deps/*/*/* | grep .so | sed 's:.* ::' | cut -c 2- | sed 's/\(^.*so\).*$/\1/' | uniq >> ./list
    readelf -d ./deps/*/*/*/* | grep .so | sed 's:.* ::' | cut -c 2- | sed 's/\(^.*so\).*$/\1/' | uniq >> ./list
    readelf -d ./deps/*/*/*/*/* | grep .so | sed 's:.* ::' | cut -c 2- | sed 's/\(^.*so\).*$/\1/' | uniq >> ./list
    ARGS=$(tail -n +2 ./list | sort -u | uniq)
    for arg in $ARGS; do
        for var in $arg; do
            mv ./$APP.AppDir/.junest/usr/lib/$arg* ./save/
            find ./$APP.AppDir/.junest/usr/lib/ -name $arg -exec cp -r --parents -t save/ {} +
        done
    done
    rsync -av ./save/$APP.AppDir/.junest/usr/lib/* ./save/
    rm -R -f $(find ./save/ | sort | grep ".AppDir" | head -1)
    rm list
}

_mvlibs(){
    mv ./$APP.AppDir/.junest/usr/lib/* ./junest-backups/usr/lib/
    mv ./save/* ./$APP.AppDir/.junest/usr/lib/
}

_binlibs 2> /dev/null

#_include_swrast_dri 2> /dev/null

_libkeywords 2> /dev/null

_liblibs 2> /dev/null
_liblibs 2> /dev/null
_liblibs 2> /dev/null
_liblibs 2> /dev/null
_liblibs 2> /dev/null

_mvlibs 2> /dev/null

rmdir save

# STEP 4, SAVE ONLY SOME DIRECTORIES CONTAINED IN /usr/share
# IF YOU NEED TO SAVE MORE FOLDERS, LIST THEM IN THE "SHARESAVED" VARIABLE. COMMENT THE LINE "_saveshare" IF YOU ARE NOT SURE.
_saveshare(){
    mkdir save
    mv ./$APP.AppDir/.junest/usr/share/*$APP* ./save/
    mv ./$APP.AppDir/.junest/usr/share/*$BIN* ./save/
    mv ./$APP.AppDir/.junest/usr/share/fontconfig ./save/
    mv ./$APP.AppDir/.junest/usr/share/glib-* ./save/
    mv ./$APP.AppDir/.junest/usr/share/locale ./save/
    mv ./$APP.AppDir/.junest/usr/share/mime ./save/
    mv ./$APP.AppDir/.junest/usr/share/wayland ./save/
    mv ./$APP.AppDir/.junest/usr/share/X11 ./save/
    for arg in $SHARESAVED; do
        for var in $arg; do
            mv ./$APP.AppDir/.junest/usr/share/*"$arg"* ./save/
        done
    done
    mv ./$APP.AppDir/.junest/usr/share/* ./junest-backups/usr/share/
    mv ./save/* ./$APP.AppDir/.junest/usr/share/
    rmdir save
}
_saveshare 2> /dev/null

# RSYNC THE CONTENT OF THE APP'S PACKAGE
rm -R -f ./base/.*
rsync -av ./base/* ./$APP.AppDir/.junest/

# RSYNC DEPENDENCES
rm -R -f ./deps/.*
rsync -av ./deps/* ./$APP.AppDir/.junest/

# ADDITIONAL REMOVALS
#mv ./$APP.AppDir/.junest/usr/lib/libLLVM-* ./junest-backups/usr/lib/ #INCLUDED IN THE COMPILATION PHASE, CAN SOMETIMES BE EXCLUDED FOR DAILY USE
rm -R -f ./$APP.AppDir/.junest/usr/lib/python*/__pycache__/* #IF PYTHON IS INSTALLED, REMOVING THIS DIRECTORY CAN SAVE SEVERAL MEGABYTES

# REMOVE THE INBUILT HOME
rm -R -f ./$APP.AppDir/.junest/home

# ENABLE MOUNTPOINTS
mkdir -p ./$APP.AppDir/.junest/home
mkdir -p ./$APP.AppDir/.junest/media
mkdir -p ./$APP.AppDir/.junest/usr/lib/locale
mkdir -p ./$APP.AppDir/.junest/usr/share/fonts
mkdir -p ./$APP.AppDir/.junest/usr/share/themes
mkdir -p ./$APP.AppDir/.junest/run/user

# CREATE THE APPIMAGE
ARCH=x86_64 ./appimagetool -n ./$APP.AppDir
mv ./*AppImage ./"$(cat ./$APP.AppDir/*.desktop | grep 'Name=' | head -1 | cut -c 6- | sed 's/ /-/g')"_"$VERSION"-archimage3.2-x86_64.AppImage

debugging dependencies you described well 👍

[zen0bit]

You WAS none, before you created something for all of us. 💕
For free. 💫
Thats the soul 👑

[zen0bit]

Are you using some Instant Messenger (open source) where we can talk better?

[zen0bit]

SimpleX?

[ivan-hc]

I'm on Reddit, https://www.reddit.com/u/am-ivan/

[zen0bit]

I see but thats not really IM

[zen0bit]

42

I said to myself, if this project I'm writing takes off... maybe I'll have left some signs of my passage. My name written in some script on the internet. A sign of my passing, however small it is. Even when I'm no longer here.

🤭 Same here