lix -

Age	Commit message (Collapse)	Author
2020-08-07	Squashed get CA derivations building	John Ericson

2020-07-30	unsigned long long -> uint64_t	Eelco Dolstra

2020-07-16	Fix bug in TeeSource	John Ericson
	We use this to simplify `LocalStore::addToStoreFromDump`. Also, hope I fixed build error with old clang (used in Darwin CI).
2020-07-15	Revert "LocalStore::addToStoreFromDump copy in chunks"	John Ericson
	This reverts commit 592851fb67cd15807109d6f65fb81f6af89af966. We don't need this extra feature anymore
2020-07-15	Get rid of `LocalStore::addToStoreCommon`	John Ericson
	I got it to just become `LocalStore::addToStoreFromDump`, cleanly taking a store and then doing nothing too fancy with it. `LocalStore::addToStore(...Path...)` is now just a simple wrapper with a bare-bones sinkToSource of the right dump command.
2020-07-14	LocalStore::addToStoreFromDump copy in chunks	John Ericson
	Rather than copying byte-by-byte, we let the coroutine know how much data we would like it to send back to us.
2020-07-13	Make 'nix copy' to s3:// binary caches run in constant memory	Eelco Dolstra

2020-07-13	NarAccessor: Run in constant memory	Eelco Dolstra

2020-07-13	Make 'nix copy' to file:// binary caches run in constant memory	Eelco Dolstra

2020-04-29	Remove the `drain` argument from `readFile`	Guillaume Bouchard
	Now it is always `drain` (see previous commit).
2019-11-26	Drop remaining uses of external "tar"	Eelco Dolstra
	Also, fetchGit now runs in O(1) memory since we pipe the output of 'git archive' directly into unpackTarball() (rather than first reading it all into memory).
2019-11-10	Fix extra ; warnings involving MakeError	John Ericson

2019-10-21	Allow content-addressable paths to have references	Eelco Dolstra
	This adds a command 'nix make-content-addressable' that rewrites the specified store paths into content-addressable paths. The advantage of such paths is that 1) they can be imported without signatures; 2) they can enable deduplication in cases where derivation changes do not cause output changes (apart from store path hashes). For example, $ nix make-content-addressable -r nixpkgs.cowsay rewrote '/nix/store/g1g31ah55xdia1jdqabv1imf6mcw0nb1-glibc-2.25-49' to '/nix/store/48jfj7bg78a8n4f2nhg269rgw1936vj4-glibc-2.25-49' ... rewrote '/nix/store/qbi6rzpk0bxjw8lw6azn2mc7ynnn455q-cowsay-3.03+dfsg1-16' to '/nix/store/iq6g2x4q62xp7y7493bibx0qn5w7xz67-cowsay-3.03+dfsg1-16' We can then copy the resulting closure to another store without signatures: $ nix copy --trusted-public-keys '' ---to ~/my-nix /nix/store/iq6g2x4q62xp7y7493bibx0qn5w7xz67-cowsay-3.03+dfsg1-16 In order to support self-references in content-addressable paths, these paths are hashed "modulo" self-references, meaning that self-references are zeroed out during hashing. Somewhat annoyingly, this means that the NAR hash stored in the Nix database is no longer necessarily equal to the output of "nix hash-path"; for content-addressable paths, you need to pass the --modulo flag: $ nix path-info --json /nix/store/iq6g2x4q62xp7y7493bibx0qn5w7xz67-cowsay-3.03+dfsg1-16 \| jq -r .[].narHash sha256:0ri611gdilz2c9rsibqhsipbfs9vwcqvs811a52i2bnkhv7w9mgw $ nix hash-path --type sha256 --base32 /nix/store/iq6g2x4q62xp7y7493bibx0qn5w7xz67-cowsay-3.03+dfsg1-16 1ggznh07khq0hz6id09pqws3a8q9pn03ya3c03nwck1kwq8rclzs $ nix hash-path --type sha256 --base32 /nix/store/iq6g2x4q62xp7y7493bibx0qn5w7xz67-cowsay-3.03+dfsg1-16 --modulo iq6g2x4q62xp7y7493bibx0qn5w7xz67 0ri611gdilz2c9rsibqhsipbfs9vwcqvs811a52i2bnkhv7w9mgw
2019-08-16	libutil: add SizedSource	zimbatm
	Introduce the SizeSource which allows to bound how much data is being read from a source. It also contains a drainAll() function to discard the rest of the source, useful to keep the nix protocol in sync.
2018-09-26	Make NAR header check more robust	Eelco Dolstra
	Changes std::bad_alloc into bad archive: input doesn't look like a Nix archive
2018-08-21	Improve 'coroutine has finished' error message	Eelco Dolstra

2018-05-21	serialise: fix buffer size used, hide method for internal use only	Will Dietz
	Fixes #2169.
2018-05-02	Fix some random -Wconversion warnings	Eelco Dolstra

2018-03-16	Reduce substitution memory consumption	Eelco Dolstra
	copyStorePath() now pipes the output of srcStore->narFromPath() directly into dstStore->addToStore(). The sink used by the former is converted into a source usable by the latter using boost::coroutine2. This is based on [1]. This reduces the maximum resident size of $ nix build --store ~/my-nix/ /nix/store/b0zlxla7dmy1iwc3g459rjznx59797xy-binutils-2.28.1 --substituters file:///tmp/binary-cache-xz/ --no-require-sigs from 418592 KiB to 53416 KiB. (The previous commit also reduced the runtime from ~4.2s to ~3.4s, not sure why.) A further improvement will be to download files into a Sink. [1] https://github.com/NixOS/nix/compare/master...Mathnerd314:dump-fix-coroutine#diff-dcbcac55a634031f9cc73707da6e4b18 Issue #1969.
2018-03-16	decompress(): Use a Source and Sink	Eelco Dolstra
	This allows decompression to happen in O(1) memory.
2017-10-23	Pass all settings to build-remote	Eelco Dolstra
	This ensures that command line flags such as --builders get passed correctly.
2017-07-30	Replace Unicode quotes in user-facing strings by ASCII	Jörg Thalheim
	Relevant RFC: NixOS/rfcs#4 $ ag -l \| xargs sed -i -e "/\"/s/’/'/g;/\"/s/‘/'/g"
2017-03-01	RemoteStore::addToStore(): Send NAR rather than string containing NAR	Eelco Dolstra
	This allows the NAR to be streamed in the future (though we're not doing that yet).
2017-03-01	Handle importing NARs containing files greater than 4 GiB	Eelco Dolstra
	Also templatize readInt() to work for various integer types.
2017-02-07	Move SavingSourceAdapter to serialise.hh	Eelco Dolstra

2016-11-26	Revert "Get rid of unicode quotes (#1140)"	Eelco Dolstra
	This reverts commit f78126bfd6b6c8477fcdbc09b2f98772dbe9a1e7. There really is no need for such a massive change...
2016-11-25	Get rid of unicode quotes (#1140)	Guillaume Maudoux

2016-07-13	FdSink: Restore move constructor/assignment	Shea Levy

2016-07-13	Make Buffered{Source,Sink} move-safe	Shea Levy

2016-05-04	Do compression in a sink	Eelco Dolstra

2016-03-04	Eliminate some large string copying	Eelco Dolstra

2016-02-26	FdSource: track number of bytes read	Eelco Dolstra

2016-02-24	Remove bad daemon connections from the pool	Eelco Dolstra
	This is necessary for long-running processes like hydra-queue-runner: if a nix-daemon worker is killed, we need to stop reusing that connection.
2015-09-03	Implement buildDerivation() via the daemon	Eelco Dolstra

2015-07-20	More cleanup	Eelco Dolstra

2015-07-17	Allow remote builds without sending the derivation closure	Eelco Dolstra
	Previously, to build a derivation remotely, we had to copy the entire closure of the .drv file to the remote machine, even though we only need the top-level derivation. This is very wasteful: the closure can contain thousands of store paths, and in some Hydra use cases, include source paths that are very large (e.g. Git/Mercurial checkouts). So now there is a new operation, StoreAPI::buildDerivation(), that performs a build from an in-memory representation of a derivation (BasicDerivation) rather than from a on-disk .drv file. The only files that need to be in the Nix store are the sources of the derivation (drv.inputSrcs), and the needed output paths of the dependencies (as described by drv.inputDrvs). "nix-store --serve" exposes this interface. Note that this is a privileged operation, because you can construct a derivation that builds any store path whatsoever. Fixing this will require changing the hashing scheme (i.e., the output paths should be computed from the other fields in BasicDerivation, allowing them to be verified without access to other derivations). However, this would be quite nice because it would allow .drv-free building (e.g. "nix-env -i" wouldn't have to write any .drv files to disk). Fixes #173.
2014-06-12	Don't use member initialisers	Eelco Dolstra
	They're a little bit too recent (only supported since GCC 4.7). http://hydra.nixos.org/build/11851475
2014-06-12	Fix bogus warnings about dumping large paths	Eelco Dolstra
	Also, yay for C++11 non-static initialisers.
2014-06-10	Print a warning when loading a large path into memory	Eelco Dolstra
	I.e. if you have a derivation with src = ./huge-directory; you'll get a warning that this is not a good idea.
2013-08-26	Fix typos, especially those that end up in the Nix manual	Ivan Kozik

2013-06-07	Process stderr from substituters while doing have/info queries	Eelco Dolstra

2012-07-18	Use "#pragma once" to prevent repeated header file inclusion	Eelco Dolstra

2011-12-16	* importPath() -> importPaths(). Because of buffering of the input	Eelco Dolstra
	stream it's now necessary for the daemon to process the entire sequence of exported paths, rather than letting the client do it.
2011-12-16	* Avoid expensive conversions from char arrays to STL strings.	Eelco Dolstra

2011-12-16	* Make the import operation through the daemon much more efficient	Eelco Dolstra
	(way fewer roundtrips) by allowing the client to send data in bigger chunks. * Some refactoring.
2011-12-16	* Clean up exception handling.	Eelco Dolstra

2011-12-15	* Refactoring: move sink/source buffering into separate classes.	Eelco Dolstra
	* Buffer the HashSink. This speeds up hashing a bit because it prevents lots of calls to the hash update functions (e.g. nix-hash went from 9.3s to 8.7s of user time on the closure of my /var/run/current-system).
2011-12-15	* Buffer reads in FdSource. Together with write buffering, this	Eelco Dolstra
	significantly cuts down the number of syscalls (e.g., for "nix-store -qR /var/run/current-system" via the daemon, it reduced the number of syscalls in the client from 29134 to 4766 and in the daemon from 44266 to 20666).
2011-12-14	* Buffer writes in FdSink. This significantly reduces the number of	Eelco Dolstra
	system calls / context switches when dumping a NAR and in the worker protocol.
2009-03-22	* NAR archives: handle files larger than 2^32 bytes. Previously it	Eelco Dolstra
	would just silently store only (fileSize % 2^32) bytes. * Use posix_fallocate if available when unpacking archives. * Provide a better error message when trying to unpack something that isn't a NAR archive.