lix -

Age	Commit message (Collapse)	Author
2024-07-15	libstore: rewrite narFromPath as generator	eldritch horrors
	Change-Id: Ifa783c2c65c06ddd1d0212016d5bfd07666ea91c
2024-07-11	libstore: make BinaryCacheStore::getFile return a source	eldritch horrors
	this lets us remove the last true remaining uses of makeDecompressionSink. Change-Id: I146ca2bbe1a9ae9a367117a7b8a304b23a63e5e2
2024-06-19	libstore: BinaryCacheStore::getFile{ -> Contents}	eldritch horrors
	if we want have getFile return a source instead of consuming a sink we'll have to disambiguate this overload another way, eg like this. Change-Id: Ia26de2020c309a37e7ccc3775c1ad1f32e0a778b
2024-05-09	libstore: un-callback-ify Store::queryRealisationUncached	eldritch horrors
	Change-Id: I4a328f46eaac3bb8b19ddc091306de83348be9cf
2024-05-09	libstore: de-callback-ify Store::queryPathInfoUncached	eldritch horrors
	Change-Id: I23a156aaff5328f67ca16ccd85c0ea1711b21e35
2024-05-09	libstore: de-callback-ify BinaryCacheStore::getFile	eldritch horrors
	Change-Id: I36b3eb9f645aa04058151e7b2353e15e6f29057b
2024-03-04	Merge pull request #6258 from obsidiansystems/gcc-bug-ergonomics	eldritch horrors
	Remove bug-avoiding `StoreConfig *` casts for settings (cherry picked from commit e3febfcd532adb23ca05ac465a2b907d6f1a3529) Change-Id: Ifeae276582fdbc781a38581df9de3da67a7e7bf9
2023-04-07	Finish converting existing comments for internal API docs (#8146)	John Ericson
	* Finish converting existing comments for internal API docs 99% of this was just reformatting existing comments. Only two exceptions: - Expanded upon `BuildResult::status` compat note - Split up file-level `symbol-table.hh` doc comments to get per-definition docs Also fixed a few whitespace goofs, turning leading tabs to spaces and removing trailing spaces. Picking up from #8133 * Fix two things from comments * Use triple-backtick not indent for `dumpPath` * Convert GNU-style `\`..'` quotes to markdown style in API docs This will render correctly.
2023-03-31	Ensure all headers have `#pragma once` and are in API docs	John Ericson
	`///@file` makes them show up in the internal API dos. A tiny few were missing `#pragma once`.
2023-03-22	Improve store setting descriptions / Markdown formatting	Eelco Dolstra

2022-12-15	getBuildLog: factor out resolving derivations	Taeer Bar-Yam

2022-10-18	Implement BinaryCacheStore::queryPathFromHashPart()	Eelco Dolstra

2022-03-11	Factor out a `LogStore` interface	John Ericson
	Continue progress on #5729. Just as I hoped, this uncovered an issue: the daemon protocol is missing a way to query build logs. This doesn't effect `unix://`, but does effect `ssh://`. A FIXME is left for this, so we come back to it later.
2022-02-25	Remove std::string alias (for real this time)	Eelco Dolstra
	Also use std::string_view in a few more places.
2022-02-16	addToStoreFromDump(): Take std::string_view	Eelco Dolstra

2022-01-18	BinaryCacheStore: Implement addBuildLog()	Eelco Dolstra

2022-01-18	Get rid of std::shared_ptr<std::string> and ref<std::string>	Eelco Dolstra
	These were needed back in the pre-C++11 era because we didn't have move semantics. But now we do.
2021-11-16	Merge pull request #5472 from NixOS/async-realisation-substitution	Eelco Dolstra
	async realisation substitution
2021-11-09	addToStore, addToStoreFromDump: refactor: pass refs by const reference	Alexander Bantyev
	Co-Authored-By: Eelco Dolstra <edolstra@gmail.com>
2021-11-03	Expose an async interface for `queryRealisation`	regnat
	Doesn’t change much so far because everything is still using it synchronously, but should allow the binary cache to fetch stuff in parallel
2021-10-23	addToStore, addToStoreFromDump: add references argument	Alexander Bantyev
	Allow to pass a set of references to be added as info to the added paths.
2021-10-12	Add compression level for NARs	Tom Bereknyei
	Based off on @dtzWill's #2276
2021-05-04	Fix the double-slash in the realisations path	regnat
	Make sure that we always access the realisations under `binaryCacheUrl/realisations` and not `binaryCacheUrl//realisations` Fix #4766
2020-12-23	Expose schedule entrypoints to all stores	John Ericson
	Remote stores still override so the other end schedules.
2020-12-20	Overhaul store subclassing	John Ericson
	We embrace virtual the rest of the way, and get rid of the `assert(false)` 0-param constructors. We also list config base classes first, so the constructor order is always: 1. all the configs 2. all the stores Each in the same order
2020-12-11	Store metadata about drv outputs realisations	regnat
	For each known realisation, store: - its output - its output path This comes with a set of needed changes: - New `realisations` module declaring the types needed for describing these mappings - New `Store::registerDrvOutput` method registering all the needed informations about a derivation output (also replaces `LocalStore::linkDeriverToPath`) - new `Store::queryRealisation` method to retrieve the informations for a derivations This introcudes some redundancy on the remote-store side between `wopQueryDerivationOutputMap` and `wopQueryRealisation`. However we might need to keep both (regardless of backwards compat) because we sometimes need to get some infos for all the outputs of a derivation (where `wopQueryDerivationOutputMap` is handy), but all the stores can't implement it − because listing all the outputs of a derivation isn't really possible for binary caches where the server doesn't allow to list a directory.
2020-09-23	Return more info from `BinaryCacheStore::addToStoreCommon`	John Ericson
	We don't need it yet, but we could/should in the future, and it's a cost-free change since we already have the reference. I like it. Co-authored-by: Robert Hensing <roberth@users.noreply.github.com>
2020-09-23	Get rid of Hash::dummy from BinaryCacheStore	John Ericson

2020-09-16	Add `(StoreConfig*)` casts to work around a GCC bug	regnat
	Work around https://gcc.gnu.org/bugzilla/show_bug.cgi?id=80431 that was already there in the code but was accidentally removed in the last commits
2020-09-16	Separate store configs from the implems	regnat
	Rework the `Store` hierarchy so that there's now one hierarchy for the store configs and one for the implementations (where each implementation extends the corresponding config). So a class hierarchy like ``` StoreConfig-------->Store \| \| v v SubStoreConfig----->SubStore \| \| v v SubSubStoreConfig-->SubSubStore ``` (with virtual inheritance to prevent DDD). The advantage of this architecture is that we can now introspect the configuration of a store without having to instantiate the store itself
2020-09-16	Separate the instantiation and initialisation of the stores	regnat
	Add a new `init()` method to the `Store` class that is supposed to handle all the effectful initialisation needed to set-up the store. The constructor should remain side-effect free and just initialize the c++ data structure. The goal behind that is that we can create “dummy” instances of each store to query static properties about it (the parameters it accepts for example)
2020-07-13	Make 'nix copy' to s3:// binary caches run in constant memory	Eelco Dolstra

2020-07-13	Remove 'accessor' from addToStore()	Eelco Dolstra
	This is only used by hydra-queue-runner and it's better to implement it there.
2020-07-13	Make 'nix copy' to file:// binary caches run in constant memory	Eelco Dolstra

2020-05-29	Remove addToStore variant as requested by `FIXME`	John Ericson
	The idea is it's always more flexible to consumer a `Source` than a plain string, and it might even reduce memory consumption. I also looked at `addToStoreFromDump` with its `// FIXME: remove?`, but the worked needed for that is far more up for interpretation, so I punted for now.
2020-05-27	Rename some variables named “recursive” to “method”	Matthew Bauer
	This is much less confusing since recursive is no longer a boolean.
2020-03-29	Replace some `bool recursive` with a new `FileIngestionMethod` enum	John Ericson

2019-12-17	Add priority setting to stores	Eelco Dolstra
	This allows overriding the priority of substituters, e.g. $ nix-store --store ~/my-nix/ -r /nix/store/df3m4da96d84ljzxx4mygfshm1p0r2n3-geeqie-1.4 \ --substituters 'http://cache.nixos.org?priority=100 daemon?priority=10' Fixes #3264.
2019-12-10	Make the Store API more type-safe	Eelco Dolstra
	Most functions now take a StorePath argument rather than a Path (which is just an alias for std::string). The StorePath constructor ensures that the path is syntactically correct (i.e. it looks like <store-dir>/<base32-hash>-<name>). Similarly, functions like buildPaths() now take a StorePathWithOutputs, rather than abusing Path by adding a '!<outputs>' suffix. Note that the StorePath type is implemented in Rust. This involves some hackery to allow Rust values to be used directly in C++, via a helper type whose destructor calls the Rust type's drop() function. The main issue is the dynamic nature of C++ move semantics: after we have moved a Rust value, we should not call the drop function on the original value. So when we move a value, we set the original value to bitwise zero, and the destructor only calls drop() if the value is not bitwise zero. This should be sufficient for most types. Also lots of minor cleanups to the C++ API to make it more modern (e.g. using std::optional and std::string_view in some places).
2019-10-29	queryPathInfoUncached(): Return const ValidPathInfo	Eelco Dolstra

2019-09-04	BinaryCacheStore: Add index-debug-info option	Eelco Dolstra
	This integrates the functionality of the index-debuginfo program in nixos-channel-scripts to maintain an index of DWARF debuginfo files in a format usable by dwarffs. Thus the debug info index is updated by Hydra rather than by the channel mirroring script. Example usage: $ nix copy --to 'file:///tmp/binary-cache?index-debug-info=true' /nix/store/vr9mhcch3fljzzkjld3kvkggvpq38cva-nix-2.2.2-debug $ cat /tmp/binary-cache/debuginfo/036b210b03bad75ab2d8fc80b7a146f98e7f1ecf.debug {"archive":"../nar/0313h2kdhk4v73xna9ysiksp2v8xrsk5xsw79mmwr3rg7byb4ka8.nar.xz","member":"lib/debug/.build-id/03/6b210b03bad75ab2d8fc80b7a146f98e7f1ecf.debug"} Fixes #3083.
2019-09-03	Add some noexcepts	Eelco Dolstra
	This is to assert that callback functions should never throw (since the context in which they're called may not be able to handle the exception).
2019-01-18	unsupported(): Show the name of the unsupported operation	Eelco Dolstra

2018-05-30	Make LocalBinaryCacheStore::narFromPath() run in constant memory	Eelco Dolstra
	This reduces memory consumption of nix copy --from file://... --to ~/my-nix /nix/store/95cwv4q54dc6giaqv6q6p4r02ia2km35-blender-2.79 from 514 MiB to 18 MiB for an uncompressed binary cache, and from 192 MiB to 53 MiB for a bzipped binary cache. It may also be faster because fetching can happen concurrently with decompression/writing. Continuation of 48662d151bdf4a38670897beacea9d1bd750376a. Issue https://github.com/NixOS/nix/issues/1681.
2018-05-30	Simplify the callback mechanism	Eelco Dolstra

2018-02-07	move the parallel-compression setting to binary-cache-store, the setting	AmineChikhaoui
	can be done now from the url e.g s3://nix-cache?parallel-compression=1 instead of nix.conf.
2017-11-14	nix sign-paths: Support binary caches	Eelco Dolstra

2017-10-17	BinaryCacheStore: Support local caching of NARs	Eelco Dolstra
	This speeds up commands like "nix cat-store". For example: $ time nix cat-store --store https://cache.nixos.org?local-nar-cache=/tmp/nar-cache /nix/store/i60yncmq6w9dyv37zd2k454g0fkl3arl-systemd-234/etc/udev/udev.conf real 0m4.336s $ time nix cat-store --store https://cache.nixos.org?local-nar-cache=/tmp/nar-cache /nix/store/i60yncmq6w9dyv37zd2k454g0fkl3arl-systemd-234/etc/udev/udev.conf real 0m0.045s The primary motivation is to allow hydra-server to serve files from S3 binary caches. Previously Hydra had a hack to do "nix-store -r <path>", but that fetches the entire closure so is prohibitively expensive. There is no garbage collection of the NAR cache yet. Also, the entire NAR is read when accessing a single member file. We could generate the NAR listing to provide random access. Note: the NAR cache is indexed by the store path hash, not the content hash, so NAR caches should not be shared between binary caches, unless you're sure that all your builds are binary-reproducible.
2017-07-04	Sort substituters by priority	Eelco Dolstra
	Fixes #1438.
2017-07-03	Replace a few bool flags with enums	Eelco Dolstra
	Functions like copyClosure() had 3 bool arguments, which creates a severe risk of mixing up arguments. Also, implement copyClosure() using copyPaths().