:1710899057:compare-example_sets compare-example_sets /run/current-system/sw/bin/candelabra-cli -l --manifest-path /opt/candelabra/src/tests/Cargo.toml -p example_sets select --compare [2024-03-20T01:44:17Z INFO candelabra_cli] Using source dir: "/nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source" [2024-03-20T01:44:17Z DEBUG candelabra::candidates] Initialised candidate cacher with hash 6543311679163142612 [2024-03-20T01:44:17Z DEBUG primrose::library_specs] Failed to process library module /nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source/crates/library/src/adaptive.rs. Continuing anyway. [2024-03-20T01:44:17Z DEBUG primrose::library_specs] Failed to process library module /nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source/crates/library/src/profiler.rs. Continuing anyway. [2024-03-20T01:44:17Z DEBUG primrose::library_specs] Failed to process library module /nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source/crates/library/src/traits.rs. Continuing anyway. [2024-03-20T01:44:17Z DEBUG candelabra::cost] Initialised benchmark cacher with hash 6543311679163142612 [2024-03-20T01:44:17Z INFO candelabra_cli::select] Processing project example_sets [2024-03-20T01:44:18Z INFO candelabra::profiler] Setting up /opt/candelabra/src/tests/example_sets/src/types.pr.rs for profiling [2024-03-20T01:44:18Z DEBUG primrose::selector] Setting up directories [2024-03-20T01:44:18Z DEBUG primrose::selector] Parsing into blocks [2024-03-20T01:44:18Z DEBUG primrose::selector] Running type checker [2024-03-20T01:44:18Z DEBUG primrose::selector] Running analysis [2024-03-20T01:44:18Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source/crates/library/src/adaptive.rs [2024-03-20T01:44:18Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source/crates/library/src/profiler.rs [2024-03-20T01:44:18Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source/crates/library/src/traits.rs [2024-03-20T01:44:18Z INFO candelabra::profiler] Running benchmark main with out dir TempDir { path: "/tmp/.tmpFrOGtB" } Compiling example_sets v0.1.0 (/opt/candelabra/src/tests/example_sets) Finished bench [optimized] target(s) in 3.13s Running benches/main.rs (/opt/candelabra/src/tests/target/release/deps/main-4274d8fe7defaf49) ┌──────┬────────────────────────────┬────────────────────┬────────────────────────────────────────────────────────┐ │ name │ implementation │ estimated cost │ file │ ├──────┼────────────────────────────┼────────────────────┼────────────────────────────────────────────────────────┤ │ Set │ std::collections::HashSet │ 14600867290.768051 │ /opt/candelabra/src/tests/example_sets/src/types.pr.rs │ │ Set │ std::collections::BTreeSet │ 21329213278.665424 │ /opt/candelabra/src/tests/example_sets/src/types.pr.rs │ └──────┴────────────────────────────┴────────────────────┴────────────────────────────────────────────────────────┘ \begin{center} \begin{tabular}{|c|c|c|c|} name & implementation & estimated cost & file \\ \hline Set & std::collections::HashSet & 14600867290.768051 & /opt/candelabra/src/tests/example\_sets/src/types.pr.rs \\ Set & std::collections::BTreeSet & 21329213278.665424 & /opt/candelabra/src/tests/example\_sets/src/types.pr.rs \\ \end{tabular} \end{center} [2024-03-20T01:47:57Z DEBUG candelabra::profiler::info] Checking for nsplit [2024-03-20T01:47:57Z DEBUG candelabra::profiler::info] Partitions: [ProfilerPartition { occurences: 69344.0, avg_n: 50.0, avg_op_counts: {"push": 0.0, "clear": 0.0, "get": 0.0, "insert": 50.0, "pop": 0.0, "nth": 0.0, "remove": 0.0, "first": 0.0, "contains": 100.0, "last": 0.0} }, ProfilerPartition { occurences: 41775.0, avg_n: 150.0, avg_op_counts: {"first": 0.0, "nth": 0.0, "clear": 0.0, "last": 0.0, "insert": 150.0, "remove": 0.0, "pop": 0.0, "get": 0.0, "contains": 300.0, "push": 0.0} }, ProfilerPartition { occurences: 4891.0, avg_n: 2500.0, avg_op_counts: {"clear": 0.0, "get": 0.0, "last": 0.0, "insert": 2500.0, "push": 0.0, "nth": 0.0, "remove": 0.0, "contains": 5000.0, "first": 0.0, "pop": 0.0} }, ProfilerPartition { occurences: 5973.0, avg_n: 7500.0, avg_op_counts: {"push": 0.0, "clear": 0.0, "insert": 7500.0, "contains": 15000.0, "pop": 0.0, "get": 0.0, "first": 0.0, "remove": 0.0, "nth": 0.0, "last": 0.0} }] [2024-03-20T01:47:57Z DEBUG candelabra::profiler::info] Costs by partitions: [("std::collections::HashSet", [467806452.2478616, 965178935.5062613, 2541474529.362616, 10626407373.651312]), ("std::collections::BTreeSet", [581630428.2607172, 1319325246.1831577, 3844072464.1425066, 15584185140.079044])] [2024-03-20T01:47:57Z DEBUG candelabra::profiler::info] Top by partition: [("std::collections::HashSet", 467806452.2478616), ("std::collections::HashSet", 965178935.5062613), ("std::collections::HashSet", 2541474529.362616), ("std::collections::HashSet", 10626407373.651312)] [2024-03-20T01:47:57Z DEBUG candelabra::profiler::info] Checking for nsplit [2024-03-20T01:47:57Z DEBUG candelabra::profiler::info] Partitions: [ProfilerPartition { occurences: 69344.0, avg_n: 50.0, avg_op_counts: {"first": 0.0, "contains": 100.0, "push": 0.0, "get": 0.0, "clear": 0.0, "remove": 0.0, "pop": 0.0, "nth": 0.0, "insert": 50.0, "last": 0.0} }, ProfilerPartition { occurences: 41775.0, avg_n: 150.0, avg_op_counts: {"get": 0.0, "remove": 0.0, "first": 0.0, "pop": 0.0, "push": 0.0, "nth": 0.0, "last": 0.0, "insert": 150.0, "contains": 300.0, "clear": 0.0} }, ProfilerPartition { occurences: 4891.0, avg_n: 2500.0, avg_op_counts: {"push": 0.0, "clear": 0.0, "pop": 0.0, "last": 0.0, "get": 0.0, "remove": 0.0, "insert": 2500.0, "contains": 5000.0, "first": 0.0, "nth": 0.0} }, ProfilerPartition { occurences: 5973.0, avg_n: 7500.0, avg_op_counts: {"clear": 0.0, "push": 0.0, "contains": 15000.0, "insert": 7500.0, "pop": 0.0, "first": 0.0, "remove": 0.0, "nth": 0.0, "last": 0.0, "get": 0.0} }] [2024-03-20T01:47:57Z DEBUG candelabra::profiler::info] Costs by partitions: [("std::collections::HashSet", [467806452.2478616, 965178935.5062613, 2541474529.362616, 10626407373.651312]), ("std::collections::BTreeSet", [581630428.2607172, 1319325246.1831577, 3844072464.1425066, 15584185140.079044])] [2024-03-20T01:47:57Z DEBUG candelabra::profiler::info] Top by partition: [("std::collections::HashSet", 467806452.2478616), ("std::collections::HashSet", 965178935.5062613), ("std::collections::HashSet", 2541474529.362616), ("std::collections::HashSet", 10626407373.651312)] [2024-03-20T01:47:57Z DEBUG candelabra::confirmation] Saving choices for project example_sets [2024-03-20T01:47:57Z DEBUG candelabra::confirmation] Saving choices for /opt/candelabra/src/tests/example_sets/src/types.pr.rs [2024-03-20T01:47:57Z DEBUG primrose::selector] Setting up directories [2024-03-20T01:47:57Z DEBUG primrose::selector] Parsing into blocks [2024-03-20T01:47:57Z DEBUG primrose::selector] Running type checker [2024-03-20T01:47:57Z DEBUG primrose::selector] Running analysis [2024-03-20T01:47:57Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source/crates/library/src/adaptive.rs [2024-03-20T01:47:57Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source/crates/library/src/profiler.rs [2024-03-20T01:47:57Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source/crates/library/src/traits.rs [2024-03-20T01:47:57Z INFO candelabra_cli::select] Saved best choices [2024-03-20T01:47:57Z INFO candelabra_cli::select] Running benchmarks with {("/opt/candelabra/src/tests/example_sets/src/types.pr.rs", "Set"): std::collections::HashSet} [2024-03-20T01:47:57Z DEBUG candelabra::confirmation] Saving choices for project example_sets [2024-03-20T01:47:57Z DEBUG candelabra::confirmation] Saving choices for /opt/candelabra/src/tests/example_sets/src/types.pr.rs [2024-03-20T01:47:57Z DEBUG primrose::selector] Setting up directories [2024-03-20T01:47:57Z DEBUG primrose::selector] Parsing into blocks [2024-03-20T01:47:57Z DEBUG primrose::selector] Running type checker [2024-03-20T01:47:57Z DEBUG primrose::selector] Running analysis [2024-03-20T01:47:57Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source/crates/library/src/adaptive.rs [2024-03-20T01:47:57Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source/crates/library/src/profiler.rs [2024-03-20T01:47:57Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source/crates/library/src/traits.rs Compiling example_sets v0.1.0 (/opt/candelabra/src/tests/example_sets) Finished bench [optimized] target(s) in 6.44s Running benches/main.rs (/opt/candelabra/src/tests/target/release/deps/main-4274d8fe7defaf49) [2024-03-20T01:48:49Z INFO candelabra_cli::select] Running benchmarks with {("/opt/candelabra/src/tests/example_sets/src/types.pr.rs", "Set"): std::collections::BTreeSet} [2024-03-20T01:48:49Z DEBUG candelabra::confirmation] Saving choices for project example_sets [2024-03-20T01:48:49Z DEBUG candelabra::confirmation] Saving choices for /opt/candelabra/src/tests/example_sets/src/types.pr.rs [2024-03-20T01:48:49Z DEBUG primrose::selector] Setting up directories [2024-03-20T01:48:49Z DEBUG primrose::selector] Parsing into blocks [2024-03-20T01:48:49Z DEBUG primrose::selector] Running type checker [2024-03-20T01:48:49Z DEBUG primrose::selector] Running analysis [2024-03-20T01:48:49Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source/crates/library/src/adaptive.rs [2024-03-20T01:48:49Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source/crates/library/src/profiler.rs [2024-03-20T01:48:49Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source/crates/library/src/traits.rs Compiling example_sets v0.1.0 (/opt/candelabra/src/tests/example_sets) Finished bench [optimized] target(s) in 2.98s Running benches/main.rs (/opt/candelabra/src/tests/target/release/deps/main-4274d8fe7defaf49) ┌─────────────────────────────────────────────────────────────────────────────────────────────────┬───────┬───────┬────────┬────────┬─────────┬────────┬────────────────────┬───────────┐ │ │ l17 │ l18 │ l27 │ l28 │ l39 │ l40 │ l8 │ total │ ├─────────────────────────────────────────────────────────────────────────────────────────────────┼───────┼───────┼────────┼────────┼─────────┼────────┼────────────────────┼───────────┤ │ {("/opt/candelabra/src/tests/example_sets/src/types.pr.rs", "Set"): std::collections::BTreeSet} │ 20289 │ │ 490340 │ │ 1667600 │ │ 5246.2 │ 2183475.2 │ │ {("/opt/candelabra/src/tests/example_sets/src/types.pr.rs", "Set"): std::collections::HashSet} │ │ 12000 │ │ 197130 │ │ 640930 │ 4040.7999999999997 │ 854100.8 │ └─────────────────────────────────────────────────────────────────────────────────────────────────┴───────┴───────┴────────┴────────┴─────────┴────────┴────────────────────┴───────────┘ \begin{center} \begin{tabular}{|c|c|c|c|c|c|c|c|c|} & l17 & l18 & l27 & l28 & l39 & l40 & l8 & total \\ \hline \{("/opt/candelabra/src/tests/example\_sets/src/types.pr.rs", "Set"): std::collections::BTreeSet\} & 20289 & & 490340 & & 1667600 & & 5246.2 & 2183475.2 \\ \{("/opt/candelabra/src/tests/example\_sets/src/types.pr.rs", "Set"): std::collections::HashSet\} & & 12000 & & 197130 & & 640930 & 4040.7999999999997 & 854100.8 \\ \end{tabular} \end{center} section_end:1710899383:compare-example_sets