aboutsummaryrefslogtreecommitdiff
path: root/src/libstore/build.cc
AgeCommit message (Collapse)Author
2008-12-15* Delete the chroot if it already exists (e.g. left over from anEelco Dolstra
interrupted build).
2008-12-12* Put chroots in the Nix store. This ensures that we can create hardEelco Dolstra
links to the inputs.
2008-12-12* Detect whether unshare() is available.Eelco Dolstra
2008-12-12* Use a PathSet for the chroot directories so that we don'tEelco Dolstra
accidentally bind-mount a directory twice.
2008-12-12* Define _GNU_SOURCE. Hopefully this fixes the build on Debian 4.0Eelco Dolstra
(http://hydra.nixos.org/nixlog/384/1).
2008-12-11* Don't provide the whole Nix store in the chroot, but only theEelco Dolstra
closure of the inputs. This really enforces that there can't be any undeclared dependencies on paths in the store. This is done by creating a fake Nix store and creating bind-mounts or hard-links in the fake store for all paths in the closure. After the build, the build output is moved from the fake store to the real store. TODO: the chroot has to be on the same filesystem as the Nix store for this to work, but this isn't enforced yet. (I.e. it only works currently if /tmp is on the same FS as /nix/store.)
2008-12-11* Revert r13150: now that we use private namespaces for the chroot, weEelco Dolstra
don't have to put the chroot in /nix/var/nix/chroots anymore. They're back in /tmp now.
2008-12-11* Provide a minimal /etc/passwd in the chroot to keep some buildersEelco Dolstra
happy.
2008-12-11* Do chroot builds in a private namespace. This means that all theEelco Dolstra
bind-mounts we do are only visible to the builder process and its children. So accidentally doing "rm -rf" on the chroot directory won't wipe out /nix/store and other bind-mounted directories anymore. Also, the bind-mounts in the private namespace disappear automatically when the builder exits.
2008-12-04* Propagate --max-silent-time to remote machines.Eelco Dolstra
2008-12-04* When using build hooks, for any nix-store -r build operation, it isEelco Dolstra
necessary that at least one build hook doesn't return "postpone", otherwise nix-store will barf ("waiting for a build slot, yet there are no running children"). So inform the build hook when this is the case, so that it can start a build even when that would exceed the maximum load on a machine.
2008-11-14* Restore SIGPIPE to SIG_DFL when running the builder. This preventsEelco Dolstra
subtle and often hard-to-reproduce bugs where programs in pipes either barf with a "Broken pipe" message or not, depending on the exact timing conditions. This particularly happened in GNU M4 (and Bison, which uses M4).
2008-11-12* Some somewhat ad hoc mechanism to allow the build farm to monitorEelco Dolstra
build progress.
2008-11-11* Add /dev/pts to the default nix.conf.Eelco Dolstra
2008-10-29* Put the chroots under /nix/var/nix/chroots to reduce the risk ofEelco Dolstra
disasters involving `rm -rf' on bind mounts. Will try the definitive fix (per-process mounts, apparently possible via the CLONE_NEWNS flag in clone()) some other time.
2008-10-16libstore: Always mount `/dev/pts' individually.Ludovic Courtès
This fixes problems such as Tcl's PTY handling: ERROR: The system has no more ptys. Ask your system administrator to create more.
2008-08-27* Explicitly set PWD to prevent problems with chroot builds. InEelco Dolstra
particular, dietlibc cannot figure out the cwd because the inode of the current directory doesn't appear in .. (because getdents returns the inode of the mount point).
2008-08-27* Create a /tmp with 1777 permission in the chroot. Some buildersEelco Dolstra
need a writable /tmp (they don't respect $TMPDIR).
2008-08-25* Disable chroot builds for fixed-output derivations so that we don'tEelco Dolstra
need /etc in the chroot (in particular, /etc/resolv.conf for fetchurl). Not having /etc/resolv.conf in the chroot is a good thing, since we don't want normal derivations to download files.
2008-08-04* build.cc: only use a substituter if it returns info for a path.Eelco Dolstra
2008-08-02* Make nix-env --dry-run print the paths to be substituted correctlyEelco Dolstra
again. (After the previous substituter mechanism refactoring I didn't update the code that obtains the references of substitutable paths.) This required some refactoring: the substituter programs are now kept running and receive/respond to info requests via stdin/stdout.
2008-06-18* Some refactoring: put the GC options / results in separate structs.Eelco Dolstra
* The garbage collector now also prints the number of blocks freed.
2008-06-13* Print some progress info during the early GC stages.Eelco Dolstra
2008-06-09* Merged the no-bdb branch (-r10900:HEADEelco Dolstra
https://svn.nixos.org/repos/nix/nix/branches/no-bdb).
2008-03-27* Use /tmp/nix-build-<drvpath>-<counter> instead ofEelco Dolstra
/tmp/nix-<pid>-<counter> for temporary build directories. This increases purity a bit: many packages store the temporary build path in their output, causing (generally unimportant) binary differences.
2008-01-29* nix-store --dump-db / --load-db to dump/load the Nix DB.Eelco Dolstra
* nix-store --register-validity: option to supply the content hash of each path. * Removed compatibility with Nix <= 0.7 stores.
2008-01-15Fixed exportBuildReferenceGraphMichael Raskin
2007-12-30Added a way to include derivation with its outputs and dependencies - ↵Michael Raskin
exportBuildReferenceGraph
2007-11-16* Flag `--no-build-hook' to disable distributed builds.Eelco Dolstra
* queryDeriver in daemon mode: don't barf if the other side returns an empty string (which means there is no deriver).
2007-10-29* On FreeBSD, sys/mount.h needs sys/param.h.Eelco Dolstra
2007-10-27* Detect whether chroot / bind-mount support is available.Eelco Dolstra
2007-10-27* Delete the chroot directory automatically.Eelco Dolstra
* Removed some debug messages.
2007-10-27* Support for doing builds in a chroot under Linux. The builder isEelco Dolstra
executed in a chroot that contains just the Nix store, the temporary build directory, and a configurable set of additional directories (/dev and /proc by default). This allows a bit more purity enforcement: hidden build-time dependencies on directories such as /usr or /nix/var/nix/profiles are no longer possible. As an added benefit, accidental network downloads (cf. NIXPKGS-52) are prevented as well (because files such as /etc/resolv.conf are not available in the chroot). However the usefulness of chroots is diminished by the fact that many builders depend on /bin/sh, so you need /bin in the list of additional directories. (And then on non-NixOS you need /lib as well...)
2007-08-28* When there are multiple substituters, make sure to release theEelco Dolstra
lock on the output path after trying each. Otherwise the pathIsLockedByMe() test gets confused.
2007-08-28* Fix a race condition with parallel builds where multipleEelco Dolstra
fixed-output derivations or substitutions try to build the same store path at the same time. Locking generally catches this, but not between multiple goals in the same process. This happened especially often (actually, only) in the build farm with fetchurl downloads of the same file being executed on multiple machines and then copied back to the main machine where they would clobber each other (NIXBF-13). Solution: if a goal notices that the output path is already locked, then go to sleep until another goal finishes (hopefully the one locking the path) and try again.
2007-08-12* Get rid of the substitutes database table (NIX-47). Instead, if weEelco Dolstra
need any info on substitutable paths, we just call the substituters (such as download-using-manifests.pl) directly. This means that it's no longer necessary for nix-pull to register substitutes or for nix-channel to clear them, which makes those operations much faster (NIX-95). Also, we don't have to worry about keeping nix-pull manifests (in /nix/var/nix/manifests) and the database in sync with each other. The downside is that there is some overhead in calling an external program to get the substitutes info. For instance, "nix-env -qas" takes a bit longer. Abolishing the substitutes table also makes the logic in local-store.cc simpler, as we don't need to store info for invalid paths. On the downside, you cannot do things like "nix-store -qR" on a substitutable but invalid path (but nobody did that anyway). * Never catch interrupts (the Interrupted exception).
2007-06-12* Support queryDeriver() in multi-user installations.Eelco Dolstra
2007-05-01* Set a terminate() handler to ensure that we leave the BDBEelco Dolstra
environment cleanly even when an exception is thrown from a destructor. We still crash, but we don't take all other Nix processes with us.
2007-03-20* Override the setuid helper using NIX_SETUID_HELPER.Eelco Dolstra
2007-03-19* Terminate build hooks and substitutes with a TERM signal, not a KILLEelco Dolstra
signal. This is necessary because those processes may have joined the BDB environment, so they have to be given a chance to clean up. (NIX-85)
2007-03-07* Delete the output paths before invoking the build hook.Eelco Dolstra
2007-02-21* `nix-store --export --sign': sign the Nix archive using the RSA keyEelco Dolstra
in /nix/etc/nix/signing-key.sec
2007-01-23* exportReferencesGraph: work on paths within store paths as well.Eelco Dolstra
2006-12-12* New primop builtins.filterSource, which can be used to filter filesEelco Dolstra
from a source directory. All files for which a predicate function returns true are copied to the store. Typical example is to leave out the .svn directory: stdenv.mkDerivation { ... src = builtins.filterSource (path: baseNameOf (toString path) != ".svn") ./source-dir; # as opposed to # src = ./source-dir; } This is important because the .svn directory influences the hash in a rather unpredictable and variable way.
2006-12-09* Use deletePathWrapped() in more places.Eelco Dolstra
2006-12-08* Goal cancellation inside the waitForInput() loop needs to be handledEelco Dolstra
very carefully, since it can invalidate iterators into the `children' map.
2006-12-08* Some refactoring.Eelco Dolstra
* Throw more exceptions as BuildErrors instead of Errors. This matters when --keep-going is turned on. (A BuildError is caught and terminates the goal in question, an Error terminates the program.)
2006-12-08* Kill a build if it has gone for more than a certain number ofEelco Dolstra
seconds without producing output on stdout or stderr (NIX-65). This timeout can be specified using the `--max-silent-time' option or the `build-max-silent-time' configuration setting. The default is infinity (0). * Fix a tricky race condition: if we kill the build user before the child has done its setuid() to the build user uid, then it won't be killed, and we'll potentially lock up in pid.wait(). So also send a conventional kill to the child.
2006-12-08* Also for convenience, change the ownership of the build output evenEelco Dolstra
in case of failure.
2006-12-07* Remove ancient terminology.Eelco Dolstra