aboutsummaryrefslogtreecommitdiff
path: root/src/libstore/build.cc
AgeCommit message (Collapse)Author
2007-10-27* Detect whether chroot / bind-mount support is available.Eelco Dolstra
2007-10-27* Delete the chroot directory automatically.Eelco Dolstra
* Removed some debug messages.
2007-10-27* Support for doing builds in a chroot under Linux. The builder isEelco Dolstra
executed in a chroot that contains just the Nix store, the temporary build directory, and a configurable set of additional directories (/dev and /proc by default). This allows a bit more purity enforcement: hidden build-time dependencies on directories such as /usr or /nix/var/nix/profiles are no longer possible. As an added benefit, accidental network downloads (cf. NIXPKGS-52) are prevented as well (because files such as /etc/resolv.conf are not available in the chroot). However the usefulness of chroots is diminished by the fact that many builders depend on /bin/sh, so you need /bin in the list of additional directories. (And then on non-NixOS you need /lib as well...)
2007-08-28* When there are multiple substituters, make sure to release theEelco Dolstra
lock on the output path after trying each. Otherwise the pathIsLockedByMe() test gets confused.
2007-08-28* Fix a race condition with parallel builds where multipleEelco Dolstra
fixed-output derivations or substitutions try to build the same store path at the same time. Locking generally catches this, but not between multiple goals in the same process. This happened especially often (actually, only) in the build farm with fetchurl downloads of the same file being executed on multiple machines and then copied back to the main machine where they would clobber each other (NIXBF-13). Solution: if a goal notices that the output path is already locked, then go to sleep until another goal finishes (hopefully the one locking the path) and try again.
2007-08-12* Get rid of the substitutes database table (NIX-47). Instead, if weEelco Dolstra
need any info on substitutable paths, we just call the substituters (such as download-using-manifests.pl) directly. This means that it's no longer necessary for nix-pull to register substitutes or for nix-channel to clear them, which makes those operations much faster (NIX-95). Also, we don't have to worry about keeping nix-pull manifests (in /nix/var/nix/manifests) and the database in sync with each other. The downside is that there is some overhead in calling an external program to get the substitutes info. For instance, "nix-env -qas" takes a bit longer. Abolishing the substitutes table also makes the logic in local-store.cc simpler, as we don't need to store info for invalid paths. On the downside, you cannot do things like "nix-store -qR" on a substitutable but invalid path (but nobody did that anyway). * Never catch interrupts (the Interrupted exception).
2007-06-12* Support queryDeriver() in multi-user installations.Eelco Dolstra
2007-05-01* Set a terminate() handler to ensure that we leave the BDBEelco Dolstra
environment cleanly even when an exception is thrown from a destructor. We still crash, but we don't take all other Nix processes with us.
2007-03-20* Override the setuid helper using NIX_SETUID_HELPER.Eelco Dolstra
2007-03-19* Terminate build hooks and substitutes with a TERM signal, not a KILLEelco Dolstra
signal. This is necessary because those processes may have joined the BDB environment, so they have to be given a chance to clean up. (NIX-85)
2007-03-07* Delete the output paths before invoking the build hook.Eelco Dolstra
2007-02-21* `nix-store --export --sign': sign the Nix archive using the RSA keyEelco Dolstra
in /nix/etc/nix/signing-key.sec
2007-01-23* exportReferencesGraph: work on paths within store paths as well.Eelco Dolstra
2006-12-12* New primop builtins.filterSource, which can be used to filter filesEelco Dolstra
from a source directory. All files for which a predicate function returns true are copied to the store. Typical example is to leave out the .svn directory: stdenv.mkDerivation { ... src = builtins.filterSource (path: baseNameOf (toString path) != ".svn") ./source-dir; # as opposed to # src = ./source-dir; } This is important because the .svn directory influences the hash in a rather unpredictable and variable way.
2006-12-09* Use deletePathWrapped() in more places.Eelco Dolstra
2006-12-08* Goal cancellation inside the waitForInput() loop needs to be handledEelco Dolstra
very carefully, since it can invalidate iterators into the `children' map.
2006-12-08* Some refactoring.Eelco Dolstra
* Throw more exceptions as BuildErrors instead of Errors. This matters when --keep-going is turned on. (A BuildError is caught and terminates the goal in question, an Error terminates the program.)
2006-12-08* Kill a build if it has gone for more than a certain number ofEelco Dolstra
seconds without producing output on stdout or stderr (NIX-65). This timeout can be specified using the `--max-silent-time' option or the `build-max-silent-time' configuration setting. The default is infinity (0). * Fix a tricky race condition: if we kill the build user before the child has done its setuid() to the build user uid, then it won't be killed, and we'll potentially lock up in pid.wait(). So also send a conventional kill to the child.
2006-12-08* Also for convenience, change the ownership of the build output evenEelco Dolstra
in case of failure.
2006-12-07* Remove ancient terminology.Eelco Dolstra
2006-12-07* When keeping the temporary build directory (-K), change the ownerEelco Dolstra
back to the Nix account.
2006-12-07* Be less verbose.Eelco Dolstra
2006-12-07* Don't count on the Pid deconstructor to kill the child process,Eelco Dolstra
since if we're running a build user in non-root mode, we can't. Let the setuid helper do it.
2006-12-07* If not running as root, let the setuid helper kill the build user'sEelco Dolstra
processes before and after the build.
2006-12-07* In the garbage collector, if deleting a path fails, try to fix itsEelco Dolstra
ownership, then try again.
2006-12-07* When not running as root, call the setuid helper to change theEelco Dolstra
ownership of the build result after the build.
2006-12-07* Change the ownership of store paths to the Nix account beforeEelco Dolstra
deleting them using the setuid helper.
2006-12-07* Pass the actual build user to the setuid helper.Eelco Dolstra
2006-12-07* If Nix is not running as root, call the setuid helper to start theEelco Dolstra
builder under the desired build user.
2006-12-07* Sanity check.Eelco Dolstra
2006-12-07* Move killUser() to libutil so that the setuid helper can use it.Eelco Dolstra
2006-12-06* Get rid of `build-users'. We'll just take all the members ofEelco Dolstra
`build-users-group'. This makes configuration easier: you can just add users in /etc/group.
2006-12-06* Start of the setuid helper (the program that performs the operationsEelco Dolstra
that have to be done as root: running builders under different uids, changing ownership of build results, and deleting paths in the store with the wrong ownership).
2006-12-05* Be less chatty.Eelco Dolstra
2006-12-05* Urgh. Do setgid() before setuid(), because the semantics of setgid() Eelco Dolstra
changes completely depending on whether you're root...
2006-12-05* FreeBSD returns ESRCH when there are no processes to kill.Eelco Dolstra
2006-12-05* Allow unprivileged users to run the garbage collector and to doEelco Dolstra
`nix-store --delete'. But unprivileged users are not allowed to ignore liveness. * `nix-store --delete --ignore-liveness': ignore the runtime roots as well.
2006-12-03* Removed `build-allow-root'.Eelco Dolstra
* Added `build-users-group', the group under which builds are to be performed. * Check that /nix/store has 1775 permission and is owner by the build-users-group.
2006-12-03* Some hackery to propagate the worker's stderr and exceptions to theEelco Dolstra
client.
2006-12-02* Move addTempRoot() to the store API, and add another functionEelco Dolstra
syncWithGC() to allow clients to register GC roots without needing write access to the global roots directory or the GC lock.
2006-11-30* More remote operations.Eelco Dolstra
* Added new operation hasSubstitutes(), which is more efficient than querySubstitutes().size() > 0.
2006-11-30* Put building in the store API.Eelco Dolstra
2006-11-30* Refactoring. There is now an abstract interface class StoreAPIEelco Dolstra
containing functions that operate on the Nix store. One implementation is LocalStore, which operates on the Nix store directly. The next step, to enable secure multi-user Nix, is to create a different implementation RemoteStore that talks to a privileged daemon process that uses LocalStore to perform the actual operations.
2006-11-13* Remove the undocumented `noscan' feature. It's no longer necessaryEelco Dolstra
now that reference scanning is sufficiently streamy.
2006-11-13* Magic attribute `exportReferencesGraph' that allows the referencesEelco Dolstra
graph to be passed to a builder. This attribute should be a list of pairs [name1 path1 name2 path2 ...]. The references graph of each `pathN' will be stored in a text file `nameN' in the temporary build directory. The text files have the format used by `nix-store --register-validity'. However, the deriver fields are left empty. `exportReferencesGraph' is useful for builders that want to do something with the closure of a store path. Examples: the builders that make initrds and ISO images for NixOS. `exportReferencesGraph' is entirely pure. It's necessary because otherwise the only way for a builder to get this information would be to call `nix-store' directly, which is not allowed (though unfortunately possible).
2006-10-28* `nix-store --read-log / -l PATH' shows the build log of PATH, ifEelco Dolstra
available. For instance, $ nix-store -l $(which svn) | less lets you read the build log of the Subversion instance in your profile. * `nix-store -qb': if applied to a non-derivation, take the deriver.
2006-10-19* Special derivation attribute `allowedReferences' that causes Nix toEelco Dolstra
check that the references of the output of a derivation are in the specified set. For instance, allowedReferences = []; specifies that the output cannot have any references. (This is useful, for instance, for the generation of bootstrap binaries for stdenv-linux, which must not have any references for purity). It could also be used to guard against undesired runtime dependencies, e.g., {gcc, dynlib}: derivation { ... allowedReferences = [dynlib]; } says that the output can refer to the path of `dynlib' but not `gcc'. A `forbiddedReferences' attribute would be more useful for this, though.
2006-09-04* Use a proper namespace.Eelco Dolstra
* Optimise header file usage a bit. * Compile the parser as C++.
2006-08-15On cygwin, disable the check that the output is not group or worldMartin Bravenboer
writable. File permissions on Cygwin are rather complex, and in this case this check introduced a problem with build jobs invoke from outside of Cygwin (MSYS). It seemed almost impossible to fix the permissions of the directory, so for now this safety check is disabled on Cygwin.
2006-07-20* Call find-runtime-roots.pl from the garbage collector to preventEelco Dolstra
running applications etc. from being garbage collected.