Bootloader Build_Clover.command, another Script to build standard Clover (or customized)

Micky1979 · September 25, 2016

Ok I'll send you a PM later

Matgen84 · September 25, 2016

only wonder how this can be happen without show any error:

echo "Build_Clover need these things to be installed:"

echo "${tasksARRAY[@]}"

echo "but they were not found."

echo "would you allow to install it/them? (Y/N)"

read answer

case $answer in

Y | y)

if [[ "$USER" != root ]]; then echo "type your password to install:" && sudo -s; fi

apt-get update

for stuff in "${tasksARRAY[@]}"

do

apt-get install $stuff

done

sudo -k

;;

*)

printError "Build_Clover cannot go ahead without it/them, process aborted!\n"

exit 1

;;

esac

..not sure, only bash can make this happen if is a lot buggie

Hi Micky1979

I have the same problem as Fljagd , which is why I installed manually. Sorry.

burkett375 · September 25, 2016

Fljagd, was enough to type "Y" as requested by the script? ..please clarify, I need to understad if we have a bug...

I also was never prompted to install nasm, subversion, or anything. I had to manually install everything as well. There's definitely a bug there. Also, I get stuck where it says a script needs to be run on the edk2 for linux, but don't have any options to do so.

Fljagd · September 25, 2016

Micky has done tests on my computer
Apparently Ubuntu is buggy
Micky researched now

Micky1979 · September 25, 2016

Yep I just see that in Fljagd's installation via teamviewer. But is stupid.

So the only possible explanations is that your installation miss all the Ubuntu repository i.e. main, universe, multiverse and restricted.

that can enabled by:

sudo add-apt-repository main
sudo add-apt-repository universe
sudo add-apt-repository restricted
sudo add-apt-repository multiverse

I have to find which of these contains nasm, subversion and uuid-dev respectively.

Maybe during the installation I have enabled the devolopers option, and you not instead?

But the bug is that the script exit if the package does not exist (after apt-get update/install), with no error. Really stupid.

Matgen84 · September 25, 2016

Yep I just see that in Fljagd's installations via teamviewer. But is stupid.

So the only possible explanations is that your installation miss all the Ubuntu repository i.e. main, universe, multiverse and restricted.

that can enabled by:
sudo add-apt-repository main
sudo add-apt-repository universe
sudo add-apt-repository restricted
sudo add-apt-repository multiverse
I have to find which of these contains nasm, subversion and uuid-dev respectively.

Maybe during the installation I have enabled the devolopers option, and you not instead?

But the bug is that the script exit if the package does not exist (after apt-get), with no error. Really stupid.

Ok. Thanks

Edit: main, universe, restricted, multiverse already actived on my Ubuntu installation.

Fljagd · September 25, 2016

Everything is already activated

Micky1979 · September 25, 2016

Ok will find a solution if any

Fljagd · September 25, 2016

Ok will find a solution if any

have confidence!

LockDown · September 25, 2016

make the script check for the repo and add if does not exist imo

Micky1979 · September 25, 2016

Seeing as how the script can update itself, it maybe idea to move all your user selectable settings to a config file.

e.g

MODE="S"

I use MODE="R"

So if I update script at present it is in "S" mode

If you use a config file it will read it and remain as "R" etc...

Good job so far, OH I haven't tried it in Ubuntu yet, but will try it in Windows Bash!

Yep tha's why tells you to re-run the script after apply back your changes. Yes, can be done in $HOME/Library/Preferences, but if you run again from a different OS this will not work. Or can add a file to "$(basename $0)/script.config" storing this preference.

have confidence!

have confidence!

make the script check for the repo and add if does not exist imo

1° problem:

the script need to 'export LC_ALL="en_US.UTF-8"' because Ubuntu did not set this (var is empty), and we need this to be equal for all.

2° problem

I realize that apt-get exit the script. Solution explained here: http://askubuntu.com/questions/436908/how-can-i-check-for-apt-get-errors-in-a-bash-script

Only I can't understand why for me work. maybe because is already set in en_US (I'm Italian .. but I have this vice )

example:

if [[ "$(dpkg -s uuid-dev | grep Status)" =~ 'install ok installed' ]]; then

if the reponse of what should be 'install ok installed' ...is in French ... will never work :hysterical:

Micky1979 · September 25, 2016

"re run the new script, and apply your changes (if any)"

should be

"apply your changes (if any) and re run the new script"

not tested (I'm working on it):

selfUpdate() {
    printHeader "SELF UPDATE"
    local SELF_PATH="${0}"
    local GITHUB='https://raw.githubusercontent.com/Micky1979/Build_Clover/master/Build_Clover.command'
    local cmd=""
    local newScriptRev=""
    local currScriptRev=$(echo $SCRIPTVER | tr -cd [:digit:]) # in case of beta suffix
    local newScript=""

    case $1 in
    wget)
        cmd='$1 $GITHUB -q -O -'
    ;;
    curl)
        cmd='$1 -L $GITHUB'
    ;;
    *)
        printError "selfUpdate(): invalid cmd!\n"
        return
    ;;
    esac

    newScript=$(eval $cmd)

    # don't fail if no script is avail
    if [ -n "${newScript}" ]; then
        echo "${newScript}" > /tmp/Build_Clover.txt
        newScript=$(cat /tmp/Build_Clover.txt)
        newScriptRev=$(cat /tmp/Build_Clover.txt | grep 'SCRIPTVER=' | tr -cd [:digit:])

        if IsNumericOnly $currScriptRev && IsNumericOnly $newScriptRev; then
            if [ "$newScriptRev" -gt "$currScriptRev" ]; then
                # we have a new script, prompt the user
                printf "\na new Build_Clover.command is available,\n"
                echo "do you want to overwrite the script? (Y/n)\n"
                read answer

                case $answer in
                Y | y)
                    # get the line containing MODE variable and replace with what is currently in old script:
                    local lineVarNum=$(echo $newScriptRev | grep -n '^MODE="' | awk -F ":" '{print $1}'
                    if [[ "$MODE" == "R" ]] && IsNumericOnly lineVarNum; then
                        if IsNumericOnly lineVarNum; then
                            if [[ "$SYSNAME" == Linux ]]; then
                                sed -i "" '${lineVarNum}s/.*/MODE="R"/' /tmp/Build_Clover.txt
                            else
                                sed -i '${lineVarNum}s/.*/MODE="R"/' /tmp/Build_Clover.txt
                            fi
                            cat /tmp/Build_Clover.txt > "${SELF_PATH}"
                            echo "done!"
                            rm -f /tmp/Build_Clover.txt
                            exec "${SELF_PATH}"
                        else
                            cat /tmp/Build_Clover.txt > "${SELF_PATH}"
                            echo "Warning: was not possible to replace MODE var to the current one,"
                            echo "apply your changes (if any) and re run the new script"
                            rm -f /tmp/Build_Clover.txt
                            exit 0
                        fi
                    else
                        cat /tmp/Build_Clover.txt > "${SELF_PATH}"
                        echo "done!"
                        rm -f /tmp/Build_Clover.txt
                        exec "${SELF_PATH}"
                    fi
                ;;
                esac
            else
                pressAnyKey 'your script is up to date,\n'
            fi
        fi
    else
        pressAnyKey 'was not possible to retrieve updates for Build_Clover.command,'
    fi
    rm -f /tmp/Build_Clover.txt
}

..automatic update + auto re-execution of the script (if all goes well)

MacUser2525 · September 25, 2016

Yep tha's why tells you to re-run the script after apply back your changes. Yes, can be done in $HOME/Library/Preferences, but if you run again from a different OS this will not work. Or can add a file to "$(basename $0)/script.config" storing this preference.

example:
if [[ "$(dpkg -s uuid-dev | grep Status)" =~ 'install ok installed' ]]; then
if the reponse of what should be 'install ok installed' ...is in French ... will never work

For the config do it the *nix way all config files are usually .build_clover.config in this case if you want that for the name stored in the users home directory as a hidden file. For your checking problem.

dpkg --list |grep bash
ii  bash                                  4.2+dfsg-0.1+deb7u3               amd64        GNU Bourne Again SHell
ii  bash-completion                       1:2.0-1                           all          programmable completion for the bash shell

You always get the ii at the start of the line if it is installed. If different in other languages an apt-cache policy package will have an Installed line there listing its status to dpkg.

 
apt-cache policy bash
bash:
  Installed: 4.2+dfsg-0.1+deb7u3
  Candidate: 4.2+dfsg-0.1+deb7u3
  Version table:
 *** 4.2+dfsg-0.1+deb7u3 0
        500 http://ftp.de.debian.org/debian/wheezy/main amd64 Packages 
        500 http://security.debian.org/wheezy/updates/main amd64 Packages 
        100 /var/lib/dpkg/status
 
apt-cache policy bash |grep 100
        100 /var/lib/dpkg/status
 
apt-cache policy ffmpeg 
ffmpeg:
  Installed: (none)
  Candidate: 6:0.8.17-2+deb7u2
  Version table:
     6:0.8.17-2+deb7u2 0
        500 http://security.debian.org/wheezy/updates/main amd64 Packages 
     6:0.8.17-2 0
        500 http://ftp.de.debian.org/debian/wheezy/main amd64 Packages 
 apt-cache policy ffmpeg |grep 100

If the |grep 100 returns nothing it is not installed.

Micky1979 · September 25, 2016

apt-cache policy

already done. We read probably the same article , but Ubuntu should be 16.04 + so that bash has already a minimum good version.

Otherwise any command can be old or not installed.... not sure I want fight with this.. (debian do a release each 2 years, stable but old)

export LC_ALL=C fix the output so that now is equal for all.

apt-cache show me if the pkg is installed... and voilà: all ok on a fresh installation of Ubuntu just made.

MacUser2525 · September 25, 2016

already done. We read probably the same article , but Ubuntu should be 16.04 + so that bash has already a minimum good version.

Otherwise any command can be old or not installed.... not sure I want fight with this.. (debian do a release each 2 years, stable but old)

export LC_ALL=C fix the output so that now is equal for all.

apt-cache show me if the pkg is installed... and voilà: all ok on a fresh installation of Ubuntu just made.

Possible we did me being years ago as those were off the top of my head asking myself how would I get that information for me. Bash was just example I used knowing it was installed the ffmpeg similar knowing it was not. If you ever need version number installed of package then this will get it for you.

apt-cache policy bash |cut -d ":" -f3
 
 
 
 
 *** 4.2+dfsg-0.1+deb7u3 0
 
 
        100 /var/lib/dpkg/status

Micky1979 · September 25, 2016

I did this way:

if [[ "$SYSNAME" == Linux ]]; then
    if [[ "$(uname -m)" != x86_64 ]]; then
        printError "\nBuild_Clover.command is tested only on x86_64 architecture, aborting..\n"
        exit 1
    fi

    # check if the Universally Unique ID library - headers are installed
    if [[ "$(apt-cache policy uuid-dev | grep 'Installed: (none)')" =~ 'Installed: (none)' ]]; then
        aptInstall uuid-dev
    fi
    # check if subversion is installed
    if [[ -z $(which svn) ]]; then 
        aptInstall subversion
    fi
fi

New v4.0.7

changed how the script upgrade the working copy (switch from svn 1.7 to svn 1.9 like after upgrading to Sierra from an old OSes)
the auto up-date function also set now the old $MODE on the new script (MODE="R" mean src anywhere the script is located instead of ~/src)
fixed bugs in Ubuntu (or at least here )

Build_Clover.command_v4.0.7.zip

Fljagd · September 25, 2016

I've tested and here

0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 0 B/26.5 kB of archives.
After this operation, 154 kB of additional disk space will be used.
Selecting previously unselected package uuid-dev:amd64.
(Reading database ... 214293 files and directories currently installed.)
Preparing to unpack .../uuid-dev_2.27.1-6ubuntu3.1_amd64.deb ...
Unpacking uuid-dev:amd64 (2.27.1-6ubuntu3.1) ...
Processing triggers for man-db (2.7.5-1) ...
Setting up uuid-dev:amd64 (2.27.1-6ubuntu3.1) ...
Remote revision: 3769 Local revision: 0
<----------------------------------------------------
Please enter your choice:
1) update Build_Clover.command
2) update Clover only (no building)
3) update & build Clover
4) run my script on the source
5) build existing revision (no update, for testing only)
6) build existing revision for release (no update, standard build)
7) build existing revision with custom macros enabled
8) info and limitations about this script
9) enter Developers mode (only for devs)
10) Exit
#? 3

===============================================================================
Select the desired architecture
<----------------------------------------------------
1) Standard with both ia32 and x64
2) x64 only
3) ia32 only
2
===============================================================================
Running from: Linux
<----------------------------------------------------
Using built-in specs.
COLLECT_GCC=gcc
COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/5/lto-wrapper
Target: x86_64-linux-gnu
Configured with: ../src/configure -v --with-pkgversion='Ubuntu 5.4.0-6ubuntu1~16.04.2' --with-bugurl=file:///usr/share/doc/gcc-5/README.Bugs --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --prefix=/usr --program-suffix=-5 --enable-shared --enable-linker-build-id --libexecdir=/usr/lib --without-included-gettext --enable-threads=posix --libdir=/usr/lib --enable-nls --with-sysroot=/ --enable-clocale=gnu --enable-libstdcxx-debug --enable-libstdcxx-time=yes --with-default-libstdcxx-abi=new --enable-gnu-unique-object --disable-vtable-verify --enable-libmpx --enable-plugin --with-system-zlib --disable-browser-plugin --enable-java-awt=gtk --enable-gtk-cairo --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-5-amd64/jre --enable-java-home --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-5-amd64 --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-5-amd64 --with-arch-directory=amd64 --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --enable-objc-gc --enable-multiarch --disable-werror --with-arch-32=i686 --with-abi=m64 --with-multilib-list=m32,m64,mx32 --enable-multilib --with-tune=generic --enable-checking=release --build=x86_64-linux-gnu --host=x86_64-linux-gnu --target=x86_64-linux-gnu
Thread model: posix
gcc version 5.4.0 20160609 (Ubuntu 5.4.0-6ubuntu1~16.04.2)
===============================================================================

<----------------------------------------------------

===============================================================================
Updating edk2
<----------------------------------------------------
checking..available, continuing..
D edksetup.sh
Checked out revision 22628.

edksetup.sh:
checking..available, continuing..
Updating 'edksetup.sh':
A edksetup.sh
Updated to revision 22628.
BaseTools:
checking..available, continuing..
Updating '.':

Fetching external item into 'Bin/Win32':
External at revision 191.

At revision 22628.
MdePkg:
checking..available, continuing..
Updating '.':
At revision 22628.
DuetPkg:
checking..available, continuing..
Updating '.':
At revision 22628.
EdkCompatibilityPkg:
checking..available, continuing..
Updating '.':
At revision 22628.
IntelFrameworkModulePkg:
checking..available, continuing..
Updating '.':
At revision 22628.
IntelFrameworkPkg:
checking..available, continuing..
Updating '.':
At revision 22628.
MdeModulePkg:
checking..available, continuing..
Updating '.':
At revision 22628.
OvmfPkg:
checking..available, continuing..
Updating '.':
At revision 22628.
PcAtChipsetPkg:
checking..available, continuing..
Updating '.':
At revision 22628.
ShellPkg:
checking..available, continuing..
Updating '.':
At revision 22628.
UefiCpuPkg:
checking..available, continuing..
Updating '.':
At revision 22628.

BaseTools before update was: r22628
now is: r22628
checking..available, continuing..

===============================================================================
Updating Clover
<----------------------------------------------------
Updating '.':
At revision 22688.
===============================================================================
Apply Edk2 patches
<----------------------------------------------------
cp: cannot stat '/home/fljagd/src/edk2/Clover/Patches_for_EDK2/*': No such file or directory
===============================================================================
BUILDTOOL is GCC53
<----------------------------------------------------

===============================================================================
nasm check:
<----------------------------------------------------
NASM version 2.12.02 compiled on Sep 25 2016
===============================================================================
boot6
<----------------------------------------------------
/home/fljagd/Téléchargements/Build_Clover.command_v4.0.7/Build_Clover.command: line 1511: ./ebuild.sh: No such file or directory

doSomething: "--run-script" option require you to add a "/home/fljagd/CloverPatches/Linux/distribution" script..

===============================================================================
build started at:
Sun Sep 25 22:47:06 CEST 2016
finished at
Sun Sep 25 22:47:06 CEST 2016

Done!
<----------------------------------------------------

Micky1979 · September 25, 2016

Ok thanks. Can you delete the src folder and do all from scratch?

EDIT

errors because ebuld.sh and Clover patches are not present. This I guess due to the previous script

Fljagd · September 26, 2016

Ok thanks. Can you delete the src folder and do all from scratch?

EDIT

errors because ebuld.sh and Clover patches are not present. This I guess due to the previous script

There's better

But not completely

Remote revision: 3769 Local revision: 3769

<----------------------------------------------------

Please enter your choice:

1) update Build_Clover.command

2) update Clover only (no building)

3) update & build Clover

4) run my script on the source

5) build existing revision (no update, for testing only)

6) build existing revision for release (no update, standard build)

7) build existing revision with custom macros enabled

8) info and limitations about this script

9) enter Developers mode (only for devs)

10) Exit

#? 3

===============================================================================

Select the desired architecture

<----------------------------------------------------

1) Standard with both ia32 and x64

2) x64 only

3) ia32 only

2

===============================================================================

Running from: Linux

<----------------------------------------------------

Using built-in specs.

COLLECT_GCC=gcc

COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/5/lto-wrapper

Target: x86_64-linux-gnu

Configured with: ../src/configure -v --with-pkgversion='Ubuntu 5.4.0-6ubuntu1~16.04.2' --with-bugurl=file:///usr/share/doc/gcc-5/README.Bugs --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --prefix=/usr --program-suffix=-5 --enable-shared --enable-linker-build-id --libexecdir=/usr/lib --without-included-gettext --enable-threads=posix --libdir=/usr/lib --enable-nls --with-sysroot=/ --enable-clocale=gnu --enable-libstdcxx-debug --enable-libstdcxx-time=yes --with-default-libstdcxx-abi=new --enable-gnu-unique-object --disable-vtable-verify --enable-libmpx --enable-plugin --with-system-zlib --disable-browser-plugin --enable-java-awt=gtk --enable-gtk-cairo --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-5-amd64/jre --enable-java-home --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-5-amd64 --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-5-amd64 --with-arch-directory=amd64 --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --enable-objc-gc --enable-multiarch --disable-werror --with-arch-32=i686 --with-abi=m64 --with-multilib-list=m32,m64,mx32 --enable-multilib --with-tune=generic --enable-checking=release --build=x86_64-linux-gnu --host=x86_64-linux-gnu --target=x86_64-linux-gnu

Thread model: posix

gcc version 5.4.0 20160609 (Ubuntu 5.4.0-6ubuntu1~16.04.2)

===============================================================================

<----------------------------------------------------

===============================================================================

Updating edk2

<----------------------------------------------------