:1710077803:compare-example_sets compare-example_sets /run/current-system/sw/bin/candelabra-cli -l --manifest-path /opt/candelabra/src/tests/Cargo.toml -p example_sets select --compare [2024-03-10T13:36:43Z INFO candelabra_cli] Using source dir: "/nix/store/1vjbjqp60xw852rp1r7zdw6i6xcmja7j-source" [2024-03-10T13:36:43Z DEBUG candelabra::candidates] Initialised candidate cacher with hash 10402570600929242768 [2024-03-10T13:36:43Z DEBUG primrose::library_specs] Failed to process library module /nix/store/1vjbjqp60xw852rp1r7zdw6i6xcmja7j-source/crates/library/src/adaptive.rs. Continuing anyway. [2024-03-10T13:36:43Z DEBUG primrose::library_specs] Failed to process library module /nix/store/1vjbjqp60xw852rp1r7zdw6i6xcmja7j-source/crates/library/src/profiler.rs. Continuing anyway. [2024-03-10T13:36:43Z DEBUG primrose::library_specs] Failed to process library module /nix/store/1vjbjqp60xw852rp1r7zdw6i6xcmja7j-source/crates/library/src/traits.rs. Continuing anyway. [2024-03-10T13:36:43Z DEBUG candelabra::cost] Initialised benchmark cacher with hash 10402570600929242768 [2024-03-10T13:36:43Z INFO candelabra_cli::select] Processing project example_sets [2024-03-10T13:36:43Z DEBUG primrose::selector] Setting up directories [2024-03-10T13:36:43Z DEBUG primrose::selector] Parsing into blocks [2024-03-10T13:36:43Z DEBUG primrose::selector] Running type checker [2024-03-10T13:36:43Z DEBUG primrose::selector] Running analysis [2024-03-10T13:36:43Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/1vjbjqp60xw852rp1r7zdw6i6xcmja7j-source/crates/library/src/adaptive.rs [2024-03-10T13:36:43Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/1vjbjqp60xw852rp1r7zdw6i6xcmja7j-source/crates/library/src/profiler.rs [2024-03-10T13:36:43Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/1vjbjqp60xw852rp1r7zdw6i6xcmja7j-source/crates/library/src/traits.rs [2024-03-10T13:36:43Z INFO primrose::selector] Finding container types for tag Set [2024-03-10T13:36:43Z DEBUG primrose::selector] std::collections::LinkedList - ... [2024-03-10T13:36:43Z DEBUG primrose::selector] Checking bound Container... [2024-03-10T13:36:45Z DEBUG primrose::selector] std::collections::LinkedList - NAY [2024-03-10T13:36:45Z DEBUG primrose::selector] std::collections::BTreeSet - ... [2024-03-10T13:36:45Z DEBUG primrose::selector] Checking bound Container... [2024-03-10T13:36:49Z DEBUG primrose::selector] std::collections::BTreeSet - YAY [2024-03-10T13:36:49Z DEBUG primrose::selector] std::vec::Vec - ... [2024-03-10T13:36:49Z DEBUG primrose::selector] Checking bound Container... [2024-03-10T13:36:52Z DEBUG primrose::selector] std::vec::Vec - NAY [2024-03-10T13:36:52Z DEBUG primrose::selector] std::collections::HashSet - ... [2024-03-10T13:36:52Z DEBUG primrose::selector] Checking bound Container... [2024-03-10T13:36:56Z DEBUG primrose::selector] std::collections::HashSet - YAY [2024-03-10T13:36:56Z DEBUG primrose::selector] primrose_library::SortedVec - ... [2024-03-10T13:36:56Z DEBUG primrose::selector] Checking bound Container... [2024-03-10T13:36:59Z DEBUG primrose::selector] primrose_library::SortedVec - NAY [2024-03-10T13:36:59Z DEBUG primrose::selector] primrose_library::SortedUniqueVec - ... [2024-03-10T13:36:59Z DEBUG primrose::selector] Checking bound Container... [2024-03-10T13:37:02Z DEBUG primrose::selector] primrose_library::SortedUniqueVec - YAY [2024-03-10T13:37:02Z INFO candelabra::profiler] Setting up /opt/candelabra/src/tests/example_sets/src/types.pr.rs for profiling [2024-03-10T13:37:02Z DEBUG primrose::selector] Setting up directories [2024-03-10T13:37:02Z DEBUG primrose::selector] Parsing into blocks [2024-03-10T13:37:02Z DEBUG primrose::selector] Running type checker [2024-03-10T13:37:02Z DEBUG primrose::selector] Running analysis [2024-03-10T13:37:02Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/1vjbjqp60xw852rp1r7zdw6i6xcmja7j-source/crates/library/src/adaptive.rs [2024-03-10T13:37:02Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/1vjbjqp60xw852rp1r7zdw6i6xcmja7j-source/crates/library/src/profiler.rs [2024-03-10T13:37:02Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/1vjbjqp60xw852rp1r7zdw6i6xcmja7j-source/crates/library/src/traits.rs [2024-03-10T13:37:02Z INFO candelabra::profiler] Running benchmark main with out dir TempDir { path: "/tmp/.tmpXdsbxO" } Compiling example_sets v0.1.0 (/opt/candelabra/src/tests/example_sets) Finished bench [optimized] target(s) in 3.07s Running benches/main.rs (/opt/candelabra/src/tests/target/release/deps/main-4274d8fe7defaf49) ┌──────┬───────────────────────────────────┬───────────────────┬────────────────────────────────────────────────────────┐ │ name │ implementation │ estimated cost │ file │ ├──────┼───────────────────────────────────┼───────────────────┼────────────────────────────────────────────────────────┤ │ Set │ std::collections::BTreeSet │ 88811501415.8282 │ /opt/candelabra/src/tests/example_sets/src/types.pr.rs │ │ Set │ std::collections::HashSet │ 56258119118.78233 │ /opt/candelabra/src/tests/example_sets/src/types.pr.rs │ │ Set │ primrose_library::SortedUniqueVec │ 464121484706.9112 │ /opt/candelabra/src/tests/example_sets/src/types.pr.rs │ └──────┴───────────────────────────────────┴───────────────────┴────────────────────────────────────────────────────────┘ \begin{center} \begin{tabular}{|c|c|c|c|} name & implementation & estimated cost & file \\ \hline Set & std::collections::BTreeSet & 88811501415.8282 & /opt/candelabra/src/tests/example\_sets/src/types.pr.rs \\ Set & std::collections::HashSet & 56258119118.78233 & /opt/candelabra/src/tests/example\_sets/src/types.pr.rs \\ Set & primrose\_library::SortedUniqueVec & 464121484706.9112 & /opt/candelabra/src/tests/example\_sets/src/types.pr.rs \\ \end{tabular} \end{center} [2024-03-10T13:41:54Z DEBUG candelabra::profiler::info] Checking for nsplit [2024-03-10T13:41:54Z DEBUG candelabra::profiler::info] Partitions: [ProfilerPartition { occurences: 139536.0, avg_n: 500.0, avg_op_counts: {"get": 0.0, "first": 0.0, "last": 0.0, "insert": 500.0, "contains": 1000.0, "nth": 0.0, "remove": 0.0, "push": 0.0, "clear": 0.0, "pop": 0.0} }, ProfilerPartition { occurences: 6915.0, avg_n: 10000.0, avg_op_counts: {"clear": 0.0, "nth": 0.0, "last": 0.0, "first": 0.0, "pop": 0.0, "contains": 20000.0, "remove": 0.0, "insert": 10000.0, "push": 0.0, "get": 0.0} }, ProfilerPartition { occurences: 2027.0, avg_n: 50000.0, avg_op_counts: {"contains": 100000.0, "insert": 50000.0, "nth": 0.0, "get": 0.0, "remove": 0.0, "push": 0.0, "last": 0.0, "first": 0.0, "clear": 0.0, "pop": 0.0} }] [2024-03-10T13:41:54Z DEBUG candelabra::profiler::info] Costs by partitions: [("std::collections::HashSet", [11507064499.044813, 16219513161.929575, 28531541457.80795]), ("std::collections::BTreeSet", [16571149761.744167, 25012161384.41382, 47228190269.67021]), ("primrose_library::SortedUniqueVec", [11696222991.094152, 52426651646.38907, 399998610069.428])] [2024-03-10T13:41:54Z DEBUG candelabra::profiler::info] Top by partition: [("std::collections::HashSet", 11507064499.044813), ("std::collections::HashSet", 16219513161.929575), ("std::collections::HashSet", 28531541457.80795)] [2024-03-10T13:41:54Z DEBUG candelabra::profiler::info] Checking for nsplit [2024-03-10T13:41:54Z DEBUG candelabra::profiler::info] Partitions: [ProfilerPartition { occurences: 139536.0, avg_n: 500.0, avg_op_counts: {"last": 0.0, "get": 0.0, "contains": 1000.0, "remove": 0.0, "clear": 0.0, "insert": 500.0, "pop": 0.0, "first": 0.0, "nth": 0.0, "push": 0.0} }, ProfilerPartition { occurences: 6915.0, avg_n: 10000.0, avg_op_counts: {"last": 0.0, "nth": 0.0, "contains": 20000.0, "insert": 10000.0, "get": 0.0, "push": 0.0, "first": 0.0, "pop": 0.0, "clear": 0.0, "remove": 0.0} }, ProfilerPartition { occurences: 2027.0, avg_n: 50000.0, avg_op_counts: {"insert": 50000.0, "contains": 100000.0, "last": 0.0, "nth": 0.0, "pop": 0.0, "first": 0.0, "push": 0.0, "remove": 0.0, "get": 0.0, "clear": 0.0} }] [2024-03-10T13:41:54Z DEBUG candelabra::profiler::info] Costs by partitions: [("std::collections::BTreeSet", [16571149761.744167, 25012161384.41382, 47228190269.67021]), ("std::collections::HashSet", [11507064499.044813, 16219513161.929575, 28531541457.80795]), ("primrose_library::SortedUniqueVec", [11696222991.094152, 52426651646.38907, 399998610069.428])] [2024-03-10T13:41:54Z DEBUG candelabra::profiler::info] Top by partition: [("std::collections::HashSet", 11507064499.044813), ("std::collections::HashSet", 16219513161.929575), ("std::collections::HashSet", 28531541457.80795)] [2024-03-10T13:41:54Z DEBUG candelabra::confirmation] Saving choices for project example_sets [2024-03-10T13:41:54Z DEBUG candelabra::confirmation] Saving choices for /opt/candelabra/src/tests/example_sets/src/types.pr.rs [2024-03-10T13:41:54Z DEBUG primrose::selector] Setting up directories [2024-03-10T13:41:54Z DEBUG primrose::selector] Parsing into blocks [2024-03-10T13:41:54Z DEBUG primrose::selector] Running type checker [2024-03-10T13:41:54Z DEBUG primrose::selector] Running analysis [2024-03-10T13:41:54Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/1vjbjqp60xw852rp1r7zdw6i6xcmja7j-source/crates/library/src/adaptive.rs [2024-03-10T13:41:54Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/1vjbjqp60xw852rp1r7zdw6i6xcmja7j-source/crates/library/src/profiler.rs [2024-03-10T13:41:54Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/1vjbjqp60xw852rp1r7zdw6i6xcmja7j-source/crates/library/src/traits.rs [2024-03-10T13:41:54Z INFO candelabra_cli::select] Saved best choices [2024-03-10T13:41:54Z INFO candelabra_cli::select] Running benchmarks with {("/opt/candelabra/src/tests/example_sets/src/types.pr.rs", "Set"): std::collections::BTreeSet} [2024-03-10T13:41:54Z DEBUG candelabra::confirmation] Saving choices for project example_sets [2024-03-10T13:41:54Z DEBUG candelabra::confirmation] Saving choices for /opt/candelabra/src/tests/example_sets/src/types.pr.rs [2024-03-10T13:41:54Z DEBUG primrose::selector] Setting up directories [2024-03-10T13:41:55Z DEBUG primrose::selector] Parsing into blocks [2024-03-10T13:41:55Z DEBUG primrose::selector] Running type checker [2024-03-10T13:41:55Z DEBUG primrose::selector] Running analysis [2024-03-10T13:41:55Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/1vjbjqp60xw852rp1r7zdw6i6xcmja7j-source/crates/library/src/adaptive.rs [2024-03-10T13:41:55Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/1vjbjqp60xw852rp1r7zdw6i6xcmja7j-source/crates/library/src/profiler.rs [2024-03-10T13:41:55Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/1vjbjqp60xw852rp1r7zdw6i6xcmja7j-source/crates/library/src/traits.rs Compiling example_sets v0.1.0 (/opt/candelabra/src/tests/example_sets) Finished bench [optimized] target(s) in 8.22s Running benches/main.rs (/opt/candelabra/src/tests/target/release/deps/main-4274d8fe7defaf49) [2024-03-10T13:42:39Z INFO candelabra_cli::select] Running benchmarks with {("/opt/candelabra/src/tests/example_sets/src/types.pr.rs", "Set"): std::collections::HashSet} [2024-03-10T13:42:39Z DEBUG candelabra::confirmation] Saving choices for project example_sets [2024-03-10T13:42:39Z DEBUG candelabra::confirmation] Saving choices for /opt/candelabra/src/tests/example_sets/src/types.pr.rs [2024-03-10T13:42:39Z DEBUG primrose::selector] Setting up directories [2024-03-10T13:42:39Z DEBUG primrose::selector] Parsing into blocks [2024-03-10T13:42:39Z DEBUG primrose::selector] Running type checker [2024-03-10T13:42:39Z DEBUG primrose::selector] Running analysis [2024-03-10T13:42:39Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/1vjbjqp60xw852rp1r7zdw6i6xcmja7j-source/crates/library/src/adaptive.rs [2024-03-10T13:42:39Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/1vjbjqp60xw852rp1r7zdw6i6xcmja7j-source/crates/library/src/profiler.rs [2024-03-10T13:42:39Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/1vjbjqp60xw852rp1r7zdw6i6xcmja7j-source/crates/library/src/traits.rs Compiling example_sets v0.1.0 (/opt/candelabra/src/tests/example_sets) Finished bench [optimized] target(s) in 2.96s Running benches/main.rs (/opt/candelabra/src/tests/target/release/deps/main-4274d8fe7defaf49) [2024-03-10T13:43:16Z INFO candelabra_cli::select] Running benchmarks with {("/opt/candelabra/src/tests/example_sets/src/types.pr.rs", "Set"): primrose_library::SortedUniqueVec} [2024-03-10T13:43:16Z DEBUG candelabra::confirmation] Saving choices for project example_sets [2024-03-10T13:43:16Z DEBUG candelabra::confirmation] Saving choices for /opt/candelabra/src/tests/example_sets/src/types.pr.rs [2024-03-10T13:43:16Z DEBUG primrose::selector] Setting up directories [2024-03-10T13:43:16Z DEBUG primrose::selector] Parsing into blocks [2024-03-10T13:43:16Z DEBUG primrose::selector] Running type checker [2024-03-10T13:43:16Z DEBUG primrose::selector] Running analysis [2024-03-10T13:43:16Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/1vjbjqp60xw852rp1r7zdw6i6xcmja7j-source/crates/library/src/adaptive.rs [2024-03-10T13:43:16Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/1vjbjqp60xw852rp1r7zdw6i6xcmja7j-source/crates/library/src/profiler.rs [2024-03-10T13:43:16Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/1vjbjqp60xw852rp1r7zdw6i6xcmja7j-source/crates/library/src/traits.rs Compiling example_sets v0.1.0 (/opt/candelabra/src/tests/example_sets) Finished bench [optimized] target(s) in 2.73s Running benches/main.rs (/opt/candelabra/src/tests/target/release/deps/main-4274d8fe7defaf49) ┌────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────────┐ │ assignment │ │ ├────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────────┤ │ {("/opt/candelabra/src/tests/example_sets/src/types.pr.rs", "Set"): std::collections::BTreeSet} │ 7142500.0 │ │ {("/opt/candelabra/src/tests/example_sets/src/types.pr.rs", "Set"): std::collections::HashSet} │ 3913400.0 │ │ {("/opt/candelabra/src/tests/example_sets/src/types.pr.rs", "Set"): primrose_library::SortedUniqueVec} │ 176830000.0 │ └────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────────┘ \begin{center} \begin{tabular}{|c|c|} assignment & \\ \hline \{("/opt/candelabra/src/tests/example\_sets/src/types.pr.rs", "Set"): std::collections::BTreeSet\} & 7142500.0 \\ \{("/opt/candelabra/src/tests/example\_sets/src/types.pr.rs", "Set"): std::collections::HashSet\} & 3913400.0 \\ \{("/opt/candelabra/src/tests/example\_sets/src/types.pr.rs", "Set"): primrose\_library::SortedUniqueVec\} & 176830000.0 \\ \end{tabular} \end{center} section_end:1710078247:compare-example_sets