lix -

Age	Commit message (Collapse)	Author
2023-03-22	Improve store setting descriptions / Markdown formatting	Eelco Dolstra

2023-03-21	Support per-store Markdown documentation	Eelco Dolstra

2023-03-02	Remove FormatOrString and remaining uses of format()	Eelco Dolstra

2023-02-07	NarInfoDiskCache: Rename cacheExists -> upToDateCacheExists	Robert Hensing
	This is slightly more accurate considering that an outdated record may exist in the persistent cache. Possibly-outdated records are quite relevant as they may be foreign keys to more recent information that we want to keep, but we will not return them here.
2022-02-25	Remove std::string alias (for real this time)	Eelco Dolstra
	Also use std::string_view in a few more places.
2022-01-18	Get rid of std::shared_ptr<std::string> and ref<std::string>	Eelco Dolstra
	These were needed back in the pre-C++11 era because we didn't have move semantics. But now we do.
2021-09-22	Make setDefault() typed	Eelco Dolstra

2021-09-17	Fix scheme argument to s3 cache	Gregor Kleen

2020-12-20	Overhaul store subclassing	John Ericson
	We embrace virtual the rest of the way, and get rid of the `assert(false)` 0-param constructors. We also list config base classes first, so the constructor order is always: 1. all the configs 2. all the stores Each in the same order
2020-12-11	treat s3 permission errors as file-not-found	Michael Bishop
	Signed-off-by: Jonathan Ringer <jonringer117@gmail.com>
2020-12-04	Fix compatibility with newer AWS SDKs	Stéphan Kochen
	Tested against AWS SDK 1.8.99. Fixes #3201.
2020-12-02	Sink: Use std::string_view	Eelco Dolstra

2020-10-06	Remove static variable name clashes	Eelco Dolstra
	This was useful for an experiment with building Nix as a single compilation unit. It's not very useful otherwise but also doesn't hurt...
2020-09-16	Fix the s3 store	regnat
	Add some necessary casts in the initialisation of the store's config
2020-09-16	Fix build issues with gcc	regnat

2020-09-16	Add a name to the stores	regnat
	So that it can be printed by `nix describe-stores`
2020-09-16	Document the new store hierarchy	regnat

2020-09-16	Properly filter the stores according to their declared uriSchemes	regnat
	When opening a store, only try the stores whose `uriSchemes()` include the current one
2020-09-16	Correctly call all the parent contructors of the stores	regnat
	Using virtual inheritance means that only the default constructors of the parent classes will be called, which isn't what we want
2020-09-16	Separate store configs from the implems	regnat
	Rework the `Store` hierarchy so that there's now one hierarchy for the store configs and one for the implementations (where each implementation extends the corresponding config). So a class hierarchy like ``` StoreConfig-------->Store \| \| v v SubStoreConfig----->SubStore \| \| v v SubSubStoreConfig-->SubSubStore ``` (with virtual inheritance to prevent DDD). The advantage of this architecture is that we can now introspect the configuration of a store without having to instantiate the store itself
2020-09-16	Separate the instantiation and initialisation of the stores	regnat
	Add a new `init()` method to the `Store` class that is supposed to handle all the effectful initialisation needed to set-up the store. The constructor should remain side-effect free and just initialize the c++ data structure. The goal behind that is that we can create “dummy” instances of each store to query static properties about it (the parameters it accepts for example)
2020-09-16	Fix the registration of stores	regnat

2020-09-16	Make the store plugins more introspectable	regnat
	Directly register the store classes rather than a function to build an instance of them. This gives the possibility to introspect static members of the class or choose different ways of instantiating them.
2020-08-04	S3BinaryCacheStore: Fix size determination	Eelco Dolstra

2020-08-04	Revert "Remove putBytes"	Eelco Dolstra
	This reverts commit b8eea7e81af53905be7845dffc6d0a83ea8edc97.
2020-07-28	Remove putBytes	Eelco Dolstra
	istream->tellg() returns -1 so we can't get the number of bytes written. Fixes 'uploaded 's3://nix-cache/nar/00819r9lp5kajr6baxfw5dhhc0cx8ndxaz43qmd2f0gn1hk1ynlp.nar.xz' (-1 bytes) in 11620 ms' messages.
2020-07-13	Make 'nix copy' to s3:// binary caches run in constant memory	Eelco Dolstra

2020-07-13	Remove istringstream_nocopy	Eelco Dolstra

2020-07-13	Make 'nix copy' to file:// binary caches run in constant memory	Eelco Dolstra

2020-07-13	Fix 'nix verify --all' on a binary cache and add a test	Eelco Dolstra

2020-05-11	Merge branch 'master' into errors-phase-2	Ben Burdette

2020-05-03	convert some printError calls to logError	Ben Burdette

2020-04-21	remove 'format' from Error constructor calls	Ben Burdette

2020-04-08	datatransfer.{cc,hh} -> filetransfer.{cc,hh}	Nikola Knezevic

2020-04-08	DataTransfer -> FileTransfer	Nikola Knezevic

2020-04-08	DownloadResult -> DataTransferResult	Nikola Knezevic

2020-04-08	Rename src/lib/download.* to src/lib/datatransfer.*	Nikola Knezevic

2019-12-17	Add priority setting to stores	Eelco Dolstra
	This allows overriding the priority of substituters, e.g. $ nix-store --store ~/my-nix/ -r /nix/store/df3m4da96d84ljzxx4mygfshm1p0r2n3-geeqie-1.4 \ --substituters 'http://cache.nixos.org?priority=100 daemon?priority=10' Fixes #3264.
2019-12-10	Make the Store API more type-safe	Eelco Dolstra
	Most functions now take a StorePath argument rather than a Path (which is just an alias for std::string). The StorePath constructor ensures that the path is syntactically correct (i.e. it looks like <store-dir>/<base32-hash>-<name>). Similarly, functions like buildPaths() now take a StorePathWithOutputs, rather than abusing Path by adding a '!<outputs>' suffix. Note that the StorePath type is implemented in Rust. This involves some hackery to allow Rust values to be used directly in C++, via a helper type whose destructor calls the Rust type's drop() function. The main issue is the dynamic nature of C++ move semantics: after we have moved a Rust value, we should not call the drop function on the original value. So when we move a value, we set the original value to bitwise zero, and the destructor only calls drop() if the value is not bitwise zero. This should be sufficient for most types. Also lots of minor cleanups to the C++ API to make it more modern (e.g. using std::optional and std::string_view in some places).
2019-03-15	Add a 5 seconds of timeouts to connect to S3.	Chaker Benhamed
	The default is 1000ms, but we can hit it a lot of we don't have direct link to AWS (e.g. using VPN).
2018-12-07	s3: make scheme configurable	Daiderd Jordan
	This enables using for http for S3 request for debugging or implementations that don't have https configured. This is not a problem for binary caches since they should not contain sensitive information. Both package signatures and AWS auth already protect against tampering.
2018-11-01	Disable the S3 content-encoding patch	Eelco Dolstra
	Since we're not using multi-part uploads at the moment, we can drop this patch.
2018-10-30	Remove redundant message	Eelco Dolstra

2018-10-30	S3BinaryCacheStore: Allow disabling multipart uploads	Eelco Dolstra
	The use of TransferManager has several issues, including that it doesn't allow setting a Content-Encoding without a patch, and it doesn't handle exceptions in worker threads (causing termination on memory allocation failure). Fixes #2493.
2018-10-30	Fix broken uploadProgressCallback closure	Eelco Dolstra
	Since the callback is global we can't refer to 'path' in it. This could cause a segfault or printing of arbitrary data.
2018-09-27	S3BinaryCacheStore: Don't create buckets	Eelco Dolstra
	This meant that making a typo in an s3:// URI would cause a bucket to be created. Also it didn't handle eventual consistency very well. Now it's up to the user to create the bucket.
2018-08-09	S3BinaryCacheStore: Share TransferManager	Eelco Dolstra
	TransferManager allocates a lot of memory (50 MiB by default), and it might leak but I'm not sure about that. In any case it was causing OOMs in hydra-queue-runner. So allocate only one TransferManager per S3BinaryCacheStore. Hopefully fixes https://github.com/NixOS/hydra/issues/586.
2018-08-08	S3BinaryCacheStore: Don't use the transfer status callback	Eelco Dolstra
	This callback is executed on a different thread, so exceptions thrown from the callback are not caught: Aug 08 16:25:48 chef hydra-queue-runner[11967]: terminate called after throwing an instance of 'nix::Error' Aug 08 16:25:48 chef hydra-queue-runner[11967]: what(): AWS error: failed to upload 's3://nix-cache/19dbddlfb0vp68g68y19p9fswrgl0bg7.ls' Therefore, just check the transfer status after it completes. Also include the S3 error message in the exception.
2018-08-06	Fix setting Content-Encoding in S3 uploads	Eelco Dolstra
	Fixes https://github.com/NixOS/nix/issues/2333 and https://github.com/NixOS/nixpkgs/issues/44337.
2018-08-06	Fix Brotli decompression in 'nix log'	Eelco Dolstra
	This didn't work anymore since decompression was only done in the non-coroutine case. Decompressors are now sinks, just like compressors. Also fixed a bug in bzip2 API handling (we have to handle BZ_RUN_OK rather than BZ_OK), which we didn't notice because there was a missing 'throw': if (ret != BZ_OK) CompressionError("error while compressing bzip2 file");