aboriginal: include.sh annotate

annotate include.sh @ 396:63dae3cd1163

Minor cleanups.

author	Rob Landley <rob@landley.net>
date	Tue, 23 Sep 2008 13:02:18 -0500
parents	becb1084a427
children	a7daae215647

rev	line source
173 8b4c243a212e Add better debug info to a status report, and stop fighting ubuntu so much Rob Landley <rob@landley.net> parents: 170 diff changeset	1 #!/bin/bash
138 7dffe9648a56 Installing bash but not using it. Yeah, there's a political agenda at work Rob Landley <rob@landley.net> parents: 125 diff changeset	2
351 7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	3 # Setup
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	4
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	5 # If this is set, mini-native won't include development tools, just uClibc
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	6 # and busybox. (Set it to "headers" to include kernel headers if you'd like
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	7 # to add your own toolchain, such as tinycc.)
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	8
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	9 # export BUILD_SHORT=1
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	10
352 1782b77fae15 Add command logging. Set RECORD_COMMANDS=1 to log every command line run Rob Landley <rob@landley.net> parents: 351 diff changeset	11 # If this is set, the build records the command lines run by each build into
1782b77fae15 Add command logging. Set RECORD_COMMANDS=1 to log every command line run Rob Landley <rob@landley.net> parents: 351 diff changeset	12 # log files in the build directory, ala "build/cmdlines.$PACKAGENAME"
1782b77fae15 Add command logging. Set RECORD_COMMANDS=1 to log every command line run Rob Landley <rob@landley.net> parents: 351 diff changeset	13
1782b77fae15 Add command logging. Set RECORD_COMMANDS=1 to log every command line run Rob Landley <rob@landley.net> parents: 351 diff changeset	14 # export RECORD_COMMANDS=1
1782b77fae15 Add command logging. Set RECORD_COMMANDS=1 to log every command line run Rob Landley <rob@landley.net> parents: 351 diff changeset	15
363 80f520811ed6 Teach cross-compiler.sh how to produce static binaries when BUILD_STATIC=1 Rob Landley <rob@landley.net> parents: 362 diff changeset	16 # If this is set, the cross-compiler stage is compiled with --static.
80f520811ed6 Teach cross-compiler.sh how to produce static binaries when BUILD_STATIC=1 Rob Landley <rob@landley.net> parents: 362 diff changeset	17
80f520811ed6 Teach cross-compiler.sh how to produce static binaries when BUILD_STATIC=1 Rob Landley <rob@landley.net> parents: 362 diff changeset	18 # export BUILD_STATIC=1
80f520811ed6 Teach cross-compiler.sh how to produce static binaries when BUILD_STATIC=1 Rob Landley <rob@landley.net> parents: 362 diff changeset	19
378 739a56397f32 Document PREFERRED_MIRROR in include.sh Rob Landley <rob@landley.net> parents: 363 diff changeset	20 # If this is set, try downloading packages from this location first.
739a56397f32 Document PREFERRED_MIRROR in include.sh Rob Landley <rob@landley.net> parents: 363 diff changeset	21
739a56397f32 Document PREFERRED_MIRROR in include.sh Rob Landley <rob@landley.net> parents: 363 diff changeset	22 # export PREFERRED_MIRROR=http://landley.net/code/firmware/mirror
739a56397f32 Document PREFERRED_MIRROR in include.sh Rob Landley <rob@landley.net> parents: 363 diff changeset	23
389 becb1084a427 Add USE_TOYBOX option (enabled by default), to use toybox commands where Rob Landley <rob@landley.net> parents: 387 diff changeset	24 # If this is set, the toybox utilities will take precedence over busybox ones.
becb1084a427 Add USE_TOYBOX option (enabled by default), to use toybox commands where Rob Landley <rob@landley.net> parents: 387 diff changeset	25
396 63dae3cd1163 Minor cleanups. Rob Landley <rob@landley.net> parents: 389 diff changeset	26 # export USE_TOYBOX=1
389 becb1084a427 Add USE_TOYBOX option (enabled by default), to use toybox commands where Rob Landley <rob@landley.net> parents: 387 diff changeset	27
351 7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	28 # What host compiler should we use?
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	29
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	30 [ -z "$CC" ] && CC=gcc
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	31
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	32 # How many processors should make -j use?
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	33
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	34 if [ -z "$CPUS" ]
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	35 then
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	36 export CPUS=$[$(echo /sys/devices/system/cpu/cpu[0-9]* \| wc -w)+0]
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	37 [ "$CPUS" -lt 1 ] && CPUS=1
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	38 fi
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	39
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	40 umask 022
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	41 unset CFLAGS CXXFLAGS
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	42
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	43 # This tells gcc to aggressively garbage collect its internal data
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	44 # structures. Without this, gcc triggers the OOM killer trying to rebuild
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	45 # itself in 128 megs of ram, which is the QEMU default size. Don't do
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	46 # this on a 64 bit host or gcc will slow to a crawl due to insufficient memory.
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	47 [ "$(uname -m)" != "x86_64" ] &&
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	48 export CFLAGS="--param ggc-min-expand=0 --param ggc-min-heapsize=8192"
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	49
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	50 # Find/create directories
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	51
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	52 TOP=`pwd`
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	53 export SOURCES="${TOP}/sources"
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	54 export SRCDIR="${SOURCES}/packages"
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	55 export FROMSRC=../packages
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	56 export BUILD="${TOP}/build"
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	57 export HOSTTOOLS="${BUILD}/host"
352 1782b77fae15 Add command logging. Set RECORD_COMMANDS=1 to log every command line run Rob Landley <rob@landley.net> parents: 351 diff changeset	58
357 5c61d556fe0c Make forkbomb.sh --fork work with RECORD_COMMANDS. Rob Landley <rob@landley.net> parents: 352 diff changeset	59 [ -z "$WRAPPY_LOGDIR" ] && WRAPPY_LOGDIR="$BUILD"
5c61d556fe0c Make forkbomb.sh --fork work with RECORD_COMMANDS. Rob Landley <rob@landley.net> parents: 352 diff changeset	60
352 1782b77fae15 Add command logging. Set RECORD_COMMANDS=1 to log every command line run Rob Landley <rob@landley.net> parents: 351 diff changeset	61 # Adjust $PATH
1782b77fae15 Add command logging. Set RECORD_COMMANDS=1 to log every command line run Rob Landley <rob@landley.net> parents: 351 diff changeset	62
1782b77fae15 Add command logging. Set RECORD_COMMANDS=1 to log every command line run Rob Landley <rob@landley.net> parents: 351 diff changeset	63 if [ "$PATH" != "$HOSTTOOLS" ]
1782b77fae15 Add command logging. Set RECORD_COMMANDS=1 to log every command line run Rob Landley <rob@landley.net> parents: 351 diff changeset	64 then
1782b77fae15 Add command logging. Set RECORD_COMMANDS=1 to log every command line run Rob Landley <rob@landley.net> parents: 351 diff changeset	65 if [ -f "$HOSTTOOLS/busybox" ]
1782b77fae15 Add command logging. Set RECORD_COMMANDS=1 to log every command line run Rob Landley <rob@landley.net> parents: 351 diff changeset	66 then
1782b77fae15 Add command logging. Set RECORD_COMMANDS=1 to log every command line run Rob Landley <rob@landley.net> parents: 351 diff changeset	67 PATH="$HOSTTOOLS"
1782b77fae15 Add command logging. Set RECORD_COMMANDS=1 to log every command line run Rob Landley <rob@landley.net> parents: 351 diff changeset	68 else
1782b77fae15 Add command logging. Set RECORD_COMMANDS=1 to log every command line run Rob Landley <rob@landley.net> parents: 351 diff changeset	69 PATH="${HOSTTOOLS}:$PATH"
1782b77fae15 Add command logging. Set RECORD_COMMANDS=1 to log every command line run Rob Landley <rob@landley.net> parents: 351 diff changeset	70 fi
1782b77fae15 Add command logging. Set RECORD_COMMANDS=1 to log every command line run Rob Landley <rob@landley.net> parents: 351 diff changeset	71 fi
1782b77fae15 Add command logging. Set RECORD_COMMANDS=1 to log every command line run Rob Landley <rob@landley.net> parents: 351 diff changeset	72
1782b77fae15 Add command logging. Set RECORD_COMMANDS=1 to log every command line run Rob Landley <rob@landley.net> parents: 351 diff changeset	73 STAGE_NAME=`echo $0 \| sed 's@./$.$\.sh@\1@'`
357 5c61d556fe0c Make forkbomb.sh --fork work with RECORD_COMMANDS. Rob Landley <rob@landley.net> parents: 352 diff changeset	74 export WRAPPY_LOGPATH="$WRAPPY_LOGDIR/cmdlines.${STAGE_NAME}.setupfor"
352 1782b77fae15 Add command logging. Set RECORD_COMMANDS=1 to log every command line run Rob Landley <rob@landley.net> parents: 351 diff changeset	75 if [ -f "$BUILD/wrapdir/wrappy" ]
1782b77fae15 Add command logging. Set RECORD_COMMANDS=1 to log every command line run Rob Landley <rob@landley.net> parents: 351 diff changeset	76 then
1782b77fae15 Add command logging. Set RECORD_COMMANDS=1 to log every command line run Rob Landley <rob@landley.net> parents: 351 diff changeset	77 export WRAPPY_REALPATH="$PATH"
1782b77fae15 Add command logging. Set RECORD_COMMANDS=1 to log every command line run Rob Landley <rob@landley.net> parents: 351 diff changeset	78 PATH="$BUILD/wrapdir"
1782b77fae15 Add command logging. Set RECORD_COMMANDS=1 to log every command line run Rob Landley <rob@landley.net> parents: 351 diff changeset	79 fi
1782b77fae15 Add command logging. Set RECORD_COMMANDS=1 to log every command line run Rob Landley <rob@landley.net> parents: 351 diff changeset	80
351 7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	81 mkdir -p "${SRCDIR}"
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	82
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	83 # Tell bash not to cache the $PATH because we modify it. Without this, bash
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	84 # won't find new executables added after startup.
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	85 set +h
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	86
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	87 # Get target platform from first command line argument.
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	88
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	89 if [ -z "$NO_ARCH" ]
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	90 then
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	91 ARCH_NAME="$1"
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	92 ARCH="$(echo "$1" \| sed 's@.*/@@')"
387 f0ceae67ebd0 Convert sources/configs/$ARCH files to sources/targets/$ARCH directories. Rob Landley <rob@landley.net> parents: 378 diff changeset	93 if [ ! -f "${TOP}/sources/targets/${ARCH}/details" ]
351 7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	94 then
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	95 echo "Supported architectures: "
387 f0ceae67ebd0 Convert sources/configs/$ARCH files to sources/targets/$ARCH directories. Rob Landley <rob@landley.net> parents: 378 diff changeset	96 (cd "${TOP}/sources/targets" && ls)
351 7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	97 exit 1
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	98 fi
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	99
387 f0ceae67ebd0 Convert sources/configs/$ARCH files to sources/targets/$ARCH directories. Rob Landley <rob@landley.net> parents: 378 diff changeset	100 # Read the relevant config file.
f0ceae67ebd0 Convert sources/configs/$ARCH files to sources/targets/$ARCH directories. Rob Landley <rob@landley.net> parents: 378 diff changeset	101
f0ceae67ebd0 Convert sources/configs/$ARCH files to sources/targets/$ARCH directories. Rob Landley <rob@landley.net> parents: 378 diff changeset	102 CONFIG_DIR="${TOP}/sources/targets/${ARCH}"
f0ceae67ebd0 Convert sources/configs/$ARCH files to sources/targets/$ARCH directories. Rob Landley <rob@landley.net> parents: 378 diff changeset	103 source "${CONFIG_DIR}/details"
f0ceae67ebd0 Convert sources/configs/$ARCH files to sources/targets/$ARCH directories. Rob Landley <rob@landley.net> parents: 378 diff changeset	104
351 7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	105 # Which platform are we building for?
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	106
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	107 export WORK="${BUILD}/temp-$ARCH"
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	108 mkdir -p "${WORK}"
387 f0ceae67ebd0 Convert sources/configs/$ARCH files to sources/targets/$ARCH directories. Rob Landley <rob@landley.net> parents: 378 diff changeset	109
351 7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	110 # Say "unknown" in two different ways so it doesn't assume we're NOT
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	111 # cross compiling when the host and target are the same processor. (If host
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	112 # and target match, the binutils/gcc/make builds won't use the cross compiler
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	113 # during mini-native.sh, and the host compiler links binaries against the
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	114 # wrong libc.)
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	115 [ -z "$CROSS_HOST" ] && export CROSS_HOST=`uname -m`-walrus-linux
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	116 [ -z "$CROSS_TARGET" ] && export CROSS_TARGET=${ARCH}-unknown-linux
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	117
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	118 # Setup directories and add the cross compiler to the start of the path.
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	119
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	120 export CROSS="${BUILD}/cross-compiler-$ARCH"
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	121 export NATIVE="${BUILD}/mini-native-$ARCH"
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	122 export PATH="${CROSS}/bin:$PATH"
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	123 else
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	124 export WORK="${BUILD}/host-temp"
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	125 mkdir -p "${WORK}"
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	126 fi
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	127
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	128 [ $? -ne 0 ] && dienow
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	129
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	130 # Everything after here is utility functions used by the other scripts.
7f529baf0b57 Reorganize include.sh to put config options at the top, minor cleanups. Rob Landley <rob@landley.net> parents: 340 diff changeset	131
236 9c48cf5b65f6 Teach extract to check patch files for changes, not just tarballs. Rob Landley <rob@landley.net> parents: 222 diff changeset	132 # Strip the version number off a tarball
9c48cf5b65f6 Teach extract to check patch files for changes, not just tarballs. Rob Landley <rob@landley.net> parents: 222 diff changeset	133
301 309b574a5059 Redo the $CLEANUP logic to a cleanup function in include.sh (meaning if a Rob Landley <rob@landley.net> parents: 290 diff changeset	134 function cleanup()
309b574a5059 Redo the $CLEANUP logic to a cleanup function in include.sh (meaning if a Rob Landley <rob@landley.net> parents: 290 diff changeset	135 {
309b574a5059 Redo the $CLEANUP logic to a cleanup function in include.sh (meaning if a Rob Landley <rob@landley.net> parents: 290 diff changeset	136 if [ $? -ne 0 ]
309b574a5059 Redo the $CLEANUP logic to a cleanup function in include.sh (meaning if a Rob Landley <rob@landley.net> parents: 290 diff changeset	137 then
309b574a5059 Redo the $CLEANUP logic to a cleanup function in include.sh (meaning if a Rob Landley <rob@landley.net> parents: 290 diff changeset	138 dienow
309b574a5059 Redo the $CLEANUP logic to a cleanup function in include.sh (meaning if a Rob Landley <rob@landley.net> parents: 290 diff changeset	139 else
309b574a5059 Redo the $CLEANUP logic to a cleanup function in include.sh (meaning if a Rob Landley <rob@landley.net> parents: 290 diff changeset	140 rm -rf "$@"
309b574a5059 Redo the $CLEANUP logic to a cleanup function in include.sh (meaning if a Rob Landley <rob@landley.net> parents: 290 diff changeset	141 fi
309b574a5059 Redo the $CLEANUP logic to a cleanup function in include.sh (meaning if a Rob Landley <rob@landley.net> parents: 290 diff changeset	142 }
309b574a5059 Redo the $CLEANUP logic to a cleanup function in include.sh (meaning if a Rob Landley <rob@landley.net> parents: 290 diff changeset	143
222 8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	144 function noversion()
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	145 {
256 e1d156c264bc Ok, the non-sed -r version is noticeably uglier than my first guess at it. Rob Landley <rob@landley.net> parents: 255 diff changeset	146 echo "$1" \| sed -e 's/-$\([0-9\.]$$[_-]rc$$-pre$$[0-9][a-zA-Z]$\)$\.tar\..z2*$$/\6/'
222 8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	147 }
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	148
236 9c48cf5b65f6 Teach extract to check patch files for changes, not just tarballs. Rob Landley <rob@landley.net> parents: 222 diff changeset	149 # output the sha1sum of a file
9c48cf5b65f6 Teach extract to check patch files for changes, not just tarballs. Rob Landley <rob@landley.net> parents: 222 diff changeset	150 function sha1file()
9c48cf5b65f6 Teach extract to check patch files for changes, not just tarballs. Rob Landley <rob@landley.net> parents: 222 diff changeset	151 {
237 735ee8a5ca35 Fix the path to calculate the tarball sha1sum, use the sha1file function more Rob Landley <rob@landley.net> parents: 236 diff changeset	152 sha1sum "$@" \| awk '{print $1}'
236 9c48cf5b65f6 Teach extract to check patch files for changes, not just tarballs. Rob Landley <rob@landley.net> parents: 222 diff changeset	153 }
9c48cf5b65f6 Teach extract to check patch files for changes, not just tarballs. Rob Landley <rob@landley.net> parents: 222 diff changeset	154
9c48cf5b65f6 Teach extract to check patch files for changes, not just tarballs. Rob Landley <rob@landley.net> parents: 222 diff changeset	155 # Extract tarball named in $1 and apply all relevant patches into
9c48cf5b65f6 Teach extract to check patch files for changes, not just tarballs. Rob Landley <rob@landley.net> parents: 222 diff changeset	156 # "$BUILD/sources/$1". Record sha1sum of tarball and patch files in
9c48cf5b65f6 Teach extract to check patch files for changes, not just tarballs. Rob Landley <rob@landley.net> parents: 222 diff changeset	157 # sha1-for-source.txt. Re-extract if tarball or patches change.
9c48cf5b65f6 Teach extract to check patch files for changes, not just tarballs. Rob Landley <rob@landley.net> parents: 222 diff changeset	158
220 8d2d0feff1ef The "caller" built-in isn't available in bash 2.x. Rob Landley <rob@landley.net> parents: 214 diff changeset	159 function extract()
8d2d0feff1ef The "caller" built-in isn't available in bash 2.x. Rob Landley <rob@landley.net> parents: 214 diff changeset	160 {
222 8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	161 SRCTREE="${BUILD}/sources"
256 e1d156c264bc Ok, the non-sed -r version is noticeably uglier than my first guess at it. Rob Landley <rob@landley.net> parents: 255 diff changeset	162 BASENAME="$(noversion "$1")"
222 8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	163 BASENAME="${BASENAME/%\.tar\.*/}"
236 9c48cf5b65f6 Teach extract to check patch files for changes, not just tarballs. Rob Landley <rob@landley.net> parents: 222 diff changeset	164 SHA1FILE="$(echo "${SRCTREE}/${BASENAME}/sha1-for-source.txt")"
237 735ee8a5ca35 Fix the path to calculate the tarball sha1sum, use the sha1file function more Rob Landley <rob@landley.net> parents: 236 diff changeset	165 SHA1TAR="$(sha1file "${SRCDIR}/$1")"
222 8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	166
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	167 # Sanity check: don't ever "rm -rf /". Just don't.
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	168
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	169 if [ -z "$BASENAME" ] \|\| [ -z "$SRCTREE" ]
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	170 then
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	171 dienow
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	172 fi
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	173
236 9c48cf5b65f6 Teach extract to check patch files for changes, not just tarballs. Rob Landley <rob@landley.net> parents: 222 diff changeset	174 # If it's already extracted and up to date (including patches), do nothing.
9c48cf5b65f6 Teach extract to check patch files for changes, not just tarballs. Rob Landley <rob@landley.net> parents: 222 diff changeset	175 SHALIST=$(cat "$SHA1FILE" 2> /dev/null)
9c48cf5b65f6 Teach extract to check patch files for changes, not just tarballs. Rob Landley <rob@landley.net> parents: 222 diff changeset	176 if [ ! -z "$SHALIST" ]
222 8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	177 then
237 735ee8a5ca35 Fix the path to calculate the tarball sha1sum, use the sha1file function more Rob Landley <rob@landley.net> parents: 236 diff changeset	178 for i in "$SHA1TAR" $(sha1file "${SOURCES}/patches/$BASENAME"* 2>/dev/null)
236 9c48cf5b65f6 Teach extract to check patch files for changes, not just tarballs. Rob Landley <rob@landley.net> parents: 222 diff changeset	179 do
9c48cf5b65f6 Teach extract to check patch files for changes, not just tarballs. Rob Landley <rob@landley.net> parents: 222 diff changeset	180 # Is this sha1 in the file?
248 f32b23bbf83a Properly detect a short sha1list during tarball extraction (I.E. notice if Rob Landley <rob@landley.net> parents: 246 diff changeset	181 if [ -z "$(echo "$SHALIST" \| sed -n "s/$i/$i/p" )" ]
f32b23bbf83a Properly detect a short sha1list during tarball extraction (I.E. notice if Rob Landley <rob@landley.net> parents: 246 diff changeset	182 then
f32b23bbf83a Properly detect a short sha1list during tarball extraction (I.E. notice if Rob Landley <rob@landley.net> parents: 246 diff changeset	183 SHALIST=missing
f32b23bbf83a Properly detect a short sha1list during tarball extraction (I.E. notice if Rob Landley <rob@landley.net> parents: 246 diff changeset	184 break
f32b23bbf83a Properly detect a short sha1list during tarball extraction (I.E. notice if Rob Landley <rob@landley.net> parents: 246 diff changeset	185 fi
236 9c48cf5b65f6 Teach extract to check patch files for changes, not just tarballs. Rob Landley <rob@landley.net> parents: 222 diff changeset	186 # Remove it
9c48cf5b65f6 Teach extract to check patch files for changes, not just tarballs. Rob Landley <rob@landley.net> parents: 222 diff changeset	187 SHALIST="$(echo "$SHALIST" \| sed "s/$i//" )"
9c48cf5b65f6 Teach extract to check patch files for changes, not just tarballs. Rob Landley <rob@landley.net> parents: 222 diff changeset	188 done
9c48cf5b65f6 Teach extract to check patch files for changes, not just tarballs. Rob Landley <rob@landley.net> parents: 222 diff changeset	189 # If we matched all the sha1sums, nothing more to do.
9c48cf5b65f6 Teach extract to check patch files for changes, not just tarballs. Rob Landley <rob@landley.net> parents: 222 diff changeset	190 [ -z "$SHALIST" ] && return 0
222 8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	191 fi
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	192
236 9c48cf5b65f6 Teach extract to check patch files for changes, not just tarballs. Rob Landley <rob@landley.net> parents: 222 diff changeset	193 echo -n "Extracting '${BASENAME}'"
9c48cf5b65f6 Teach extract to check patch files for changes, not just tarballs. Rob Landley <rob@landley.net> parents: 222 diff changeset	194 # Delete the old tree (if any). Create new empty working directories.
222 8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	195 rm -rf "${BUILD}/temp" "${SRCTREE}/${BASENAME}" 2>/dev/null
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	196 mkdir -p "${BUILD}"/{temp,sources} \|\| dienow
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	197
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	198 # Is it a bzip2 or gzip tarball?
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	199 DECOMPRESS=""
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	200 [ "$1" != "${1/%\.tar\.bz2/}" ] && DECOMPRESS="j"
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	201 [ "$1" != "${1/%\.tar\.gz/}" ] && DECOMPRESS="z"
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	202
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	203 cd "${WORK}" &&
252 aa03feec947a Minor tweaks: one error check was missed, use hard links instead of Rob Landley <rob@landley.net> parents: 248 diff changeset	204 { tar -xv${DECOMPRESS} -f "${SRCDIR}/$1" -C "${BUILD}/temp" \|\| dienow
222 8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	205 } \| dotprogress
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	206
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	207 mv "${BUILD}/temp/"* "${SRCTREE}/${BASENAME}" &&
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	208 rmdir "${BUILD}/temp" &&
236 9c48cf5b65f6 Teach extract to check patch files for changes, not just tarballs. Rob Landley <rob@landley.net> parents: 222 diff changeset	209 echo "$SHA1TAR" > "$SHA1FILE"
222 8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	210
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	211 [ $? -ne 0 ] && dienow
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	212
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	213 # Apply any patches to this package
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	214
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	215 ls "${SOURCES}/patches/$BASENAME"* 2> /dev/null \| sort \| while read i
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	216 do
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	217 if [ -f "$i" ]
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	218 then
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	219 echo "Applying $i"
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	220 (cd "${SRCTREE}/${BASENAME}" && patch -p1 -i "$i") \|\| dienow
237 735ee8a5ca35 Fix the path to calculate the tarball sha1sum, use the sha1file function more Rob Landley <rob@landley.net> parents: 236 diff changeset	221 sha1file "$i" >> "$SHA1FILE"
222 8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	222 fi
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	223 done
220 8d2d0feff1ef The "caller" built-in isn't available in bash 2.x. Rob Landley <rob@landley.net> parents: 214 diff changeset	224 }
8d2d0feff1ef The "caller" built-in isn't available in bash 2.x. Rob Landley <rob@landley.net> parents: 214 diff changeset	225
362 06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	226 function try_download()
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	227 {
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	228 # Return success if we have a valid copy of the file
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	229
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	230 # Test first (so we don't re-download a file we've already got).
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	231
396 63dae3cd1163 Minor cleanups. Rob Landley <rob@landley.net> parents: 389 diff changeset	232 SUM=`cat "$SRCDIR/$FILENAME" 2>/dev/null \| sha1sum \| awk '{print $1}'`
362 06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	233 if [ x"$SUM" == x"$SHA1" ] \|\| [ -z "$SHA1" ] && [ -f "$SRCDIR/$FILENAME" ]
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	234 then
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	235 touch "$SRCDIR/$FILENAME"
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	236 if [ -z "$SHA1" ]
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	237 then
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	238 echo "No SHA1 for $FILENAME ($SUM)"
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	239 else
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	240 echo "Confirmed $FILENAME"
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	241 fi
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	242 if [ ! -z "$EXTRACT_ALL" ]
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	243 then
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	244 extract "$FILENAME"
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	245 fi
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	246 return $?
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	247 fi
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	248
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	249 # If there's a corrupted file, delete it. In theory it would be nice
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	250 # to resume downloads, but wget creates "*.1" files instead.
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	251
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	252 rm "$SRCDIR/$FILENAME" 2> /dev/null
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	253
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	254 # If we have another source, try to download file.
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	255
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	256 if [ -n "$1" ]
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	257 then
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	258 wget -t 2 -T 20 -P "$SRCDIR" "$1"
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	259 fi
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	260
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	261 return 1
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	262 }
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	263
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	264 # Confirm a file matches sha1sum, else try to download it from mirror list.
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	265
34 ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	266 function download()
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	267 {
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	268 FILENAME=`echo "$URL" \| sed 's .*/ '`
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	269
396 63dae3cd1163 Minor cleanups. Rob Landley <rob@landley.net> parents: 389 diff changeset	270 # If environment variable specifies a preferred mirror, try that first.
362 06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	271
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	272 [ -z "$PREFERRED_MIRROR" ] \|\| try_download "$PREFERRED_MIRROR/$FILENAME"
06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	273
34 ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	274 # The extra "" is so we test the sha1sum after the last download.
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	275
340 595332f94fea Add timeout to wget, and add another mirror (impactlinux.com) so there's a Rob Landley <rob@landley.net> parents: 329 diff changeset	276 for i in "$URL" http://impactlinux.com/firmware/mirror/"$FILENAME" \
352 1782b77fae15 Add command logging. Set RECORD_COMMANDS=1 to log every command line run Rob Landley <rob@landley.net> parents: 351 diff changeset	277 http://landley.net/code/firmware/mirror/"$FILENAME" ""
34 ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	278 do
362 06f29c81ac8e Teach download to fetch from $PREFERRED_MIRROR first, if set. Rob Landley <rob@landley.net> parents: 357 diff changeset	279 try_download "$i" && return 0
34 ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	280 done
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	281
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	282 # Return failure.
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	283
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	284 echo "Could not download $FILENAME"
81 6dd38c925bc4 Upgrade some packages, and other cleanups. Rob Landley <rob@landley.net> parents: 62 diff changeset	285 echo -en "\e[0m"
34 ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	286 return 1
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	287 }
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	288
41 3baa8ab7ee6d Largeish update. Rob Landley <rob@landley.net> parents: 36 diff changeset	289 # Clean obsolete files out of the source directory
3baa8ab7ee6d Largeish update. Rob Landley <rob@landley.net> parents: 36 diff changeset	290
3baa8ab7ee6d Largeish update. Rob Landley <rob@landley.net> parents: 36 diff changeset	291 START_TIME=`date +%s`
3baa8ab7ee6d Largeish update. Rob Landley <rob@landley.net> parents: 36 diff changeset	292
3baa8ab7ee6d Largeish update. Rob Landley <rob@landley.net> parents: 36 diff changeset	293 function cleanup_oldfiles()
3baa8ab7ee6d Largeish update. Rob Landley <rob@landley.net> parents: 36 diff changeset	294 {
3baa8ab7ee6d Largeish update. Rob Landley <rob@landley.net> parents: 36 diff changeset	295 for i in "${SRCDIR}"/*
3baa8ab7ee6d Largeish update. Rob Landley <rob@landley.net> parents: 36 diff changeset	296 do
3baa8ab7ee6d Largeish update. Rob Landley <rob@landley.net> parents: 36 diff changeset	297 if [ -f "$i" ] && [ "$(date +%s -r "$i")" -lt "${START_TIME}" ]
3baa8ab7ee6d Largeish update. Rob Landley <rob@landley.net> parents: 36 diff changeset	298 then
3baa8ab7ee6d Largeish update. Rob Landley <rob@landley.net> parents: 36 diff changeset	299 echo Removing old file "$i"
3baa8ab7ee6d Largeish update. Rob Landley <rob@landley.net> parents: 36 diff changeset	300 rm -rf "$i"
3baa8ab7ee6d Largeish update. Rob Landley <rob@landley.net> parents: 36 diff changeset	301 fi
3baa8ab7ee6d Largeish update. Rob Landley <rob@landley.net> parents: 36 diff changeset	302 done
3baa8ab7ee6d Largeish update. Rob Landley <rob@landley.net> parents: 36 diff changeset	303 }
3baa8ab7ee6d Largeish update. Rob Landley <rob@landley.net> parents: 36 diff changeset	304
34 ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	305 function dienow()
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	306 {
220 8d2d0feff1ef The "caller" built-in isn't available in bash 2.x. Rob Landley <rob@landley.net> parents: 214 diff changeset	307 echo -e "\e[31mExiting due to errors\e[0m"
34 ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	308 exit 1
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	309 }
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	310
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	311 function dotprogress()
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	312 {
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	313 x=0
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	314 while read i
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	315 do
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	316 x=$[$x + 1]
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	317 if [[ "$x" -eq 25 ]]
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	318 then
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	319 x=0
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	320 echo -n .
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	321 fi
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	322 done
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	323 echo
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	324 }
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	325
222 8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	326 # Extract package $1, use out-of-tree build directory $2 (or $1 if no $2)
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	327 # Use symlink directory $3 (or $1 if no $3)
34 ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	328
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	329 function setupfor()
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	330 {
357 5c61d556fe0c Make forkbomb.sh --fork work with RECORD_COMMANDS. Rob Landley <rob@landley.net> parents: 352 diff changeset	331 export WRAPPY_LOGPATH="$WRAPPY_LOGDIR/cmdlines.${STAGE_NAME}.setupfor"
352 1782b77fae15 Add command logging. Set RECORD_COMMANDS=1 to log every command line run Rob Landley <rob@landley.net> parents: 351 diff changeset	332
236 9c48cf5b65f6 Teach extract to check patch files for changes, not just tarballs. Rob Landley <rob@landley.net> parents: 222 diff changeset	333 # Make sure the source is already extracted and up-to-date.
222 8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	334 cd "${SRCDIR}" &&
252 aa03feec947a Minor tweaks: one error check was missed, use hard links instead of Rob Landley <rob@landley.net> parents: 248 diff changeset	335 extract "${1}-".tar \|\| exit 1
41 3baa8ab7ee6d Largeish update. Rob Landley <rob@landley.net> parents: 36 diff changeset	336
222 8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	337 # Set CURSRC
173 8b4c243a212e Add better debug info to a status report, and stop fighting ubuntu so much Rob Landley <rob@landley.net> parents: 170 diff changeset	338
222 8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	339 export CURSRC="$1"
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	340 [ ! -z "$3" ] && CURSRC="$3"
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	341 CURSRC="${WORK}/${CURSRC}"
41 3baa8ab7ee6d Largeish update. Rob Landley <rob@landley.net> parents: 36 diff changeset	342
222 8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	343 # Announce package, with easy-to-grep-for "===" marker.
41 3baa8ab7ee6d Largeish update. Rob Landley <rob@landley.net> parents: 36 diff changeset	344
125 2dd9f480ff4e Set PATH for run-mini-native.sh and add more obvious arch display info when Rob Landley <rob@landley.net> parents: 124 diff changeset	345 echo "=== Building $1 ($ARCH_NAME)"
222 8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	346 echo "Snapshot '$1'..."
306 358ef8a27085 Break up run-$ARCH.sh, move more temp files into temp dir, fix deletion logic. Rob Landley <rob@landley.net> parents: 301 diff changeset	347 cd "${WORK}" \|\| dienow
358ef8a27085 Break up run-$ARCH.sh, move more temp files into temp dir, fix deletion logic. Rob Landley <rob@landley.net> parents: 301 diff changeset	348 if [ $# -lt 3 ]
358ef8a27085 Break up run-$ARCH.sh, move more temp files into temp dir, fix deletion logic. Rob Landley <rob@landley.net> parents: 301 diff changeset	349 then
358ef8a27085 Break up run-$ARCH.sh, move more temp files into temp dir, fix deletion logic. Rob Landley <rob@landley.net> parents: 301 diff changeset	350 rm -rf "${CURSRC}" \|\| dienow
358ef8a27085 Break up run-$ARCH.sh, move more temp files into temp dir, fix deletion logic. Rob Landley <rob@landley.net> parents: 301 diff changeset	351 fi
222 8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	352 mkdir -p "${CURSRC}" &&
252 aa03feec947a Minor tweaks: one error check was missed, use hard links instead of Rob Landley <rob@landley.net> parents: 248 diff changeset	353 cp -lfR "${SRCTREE}/$1/"* "${CURSRC}"
222 8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	354
8b0d2080707c Be smarter about extracting tarballs: extract one copy of each tarball Rob Landley <rob@landley.net> parents: 220 diff changeset	355 [ $? -ne 0 ] && dienow
41 3baa8ab7ee6d Largeish update. Rob Landley <rob@landley.net> parents: 36 diff changeset	356
3baa8ab7ee6d Largeish update. Rob Landley <rob@landley.net> parents: 36 diff changeset	357 # Do we have a separate working directory?
3baa8ab7ee6d Largeish update. Rob Landley <rob@landley.net> parents: 36 diff changeset	358
34 ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	359 if [ -z "$2" ]
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	360 then
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	361 cd "$1"* \|\| dienow
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	362 else
47 edaa86240321 Turnerize the build script and teach cross-compile.sh to build qemu when Rob Landley <rob@landley.net> parents: 41 diff changeset	363 mkdir -p "$2" &&
34 ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	364 cd "$2" \|\| dienow
ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	365 fi
357 5c61d556fe0c Make forkbomb.sh --fork work with RECORD_COMMANDS. Rob Landley <rob@landley.net> parents: 352 diff changeset	366 export WRAPPY_LOGPATH="$WRAPPY_LOGDIR/cmdlines.${STAGE_NAME}.$1"
34 ad1cfcb043c7 Cleaup pass: Break out shell functions and variable definitions into include.sh. Rob Landley <rob@landley.net> parents: diff changeset	367 }

Mercurial > hg > aboriginal

annotate include.sh @ 396:63dae3cd1163