:1711385934:compare-example_sets compare-example_sets /run/current-system/sw/bin/candelabra-cli -l --manifest-path /opt/candelabra/src/tests/Cargo.toml -p example_sets select --compare [2024-03-25T16:58:54Z INFO candelabra_cli] Using source dir: "/nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source" [2024-03-25T16:58:54Z DEBUG candelabra::candidates] Initialised candidate cacher with hash 6543311679163142612 [2024-03-25T16:58:54Z DEBUG primrose::library_specs] Failed to process library module /nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source/crates/library/src/adaptive.rs. Continuing anyway. [2024-03-25T16:58:54Z DEBUG primrose::library_specs] Failed to process library module /nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source/crates/library/src/profiler.rs. Continuing anyway. [2024-03-25T16:58:54Z DEBUG primrose::library_specs] Failed to process library module /nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source/crates/library/src/traits.rs. Continuing anyway. [2024-03-25T16:58:54Z DEBUG candelabra::cost] Initialised benchmark cacher with hash 6543311679163142612 [2024-03-25T16:58:54Z INFO candelabra_cli::select] Processing project example_sets ┌──────┬────────────────────────────┬────────────────────┬────────────────────────────────────────────────────────┐ │ name │ implementation │ estimated cost │ file │ ├──────┼────────────────────────────┼────────────────────┼────────────────────────────────────────────────────────┤ │ Set │ std::collections::HashSet │ 14600867290.768051 │ /opt/candelabra/src/tests/example_sets/src/types.pr.rs │ │ Set │ std::collections::BTreeSet │ 21329213278.665424 │ /opt/candelabra/src/tests/example_sets/src/types.pr.rs │ └──────┴────────────────────────────┴────────────────────┴────────────────────────────────────────────────────────┘ \begin{center} \begin{tabular}{|c|c|c|c|} name & implementation & estimated cost & file \\ \hline Set & std::collections::HashSet & 14600867290.768051 & /opt/candelabra/src/tests/example\_sets/src/types.pr.rs \\ Set & std::collections::BTreeSet & 21329213278.665424 & /opt/candelabra/src/tests/example\_sets/src/types.pr.rs \\ \end{tabular} \end{center} [2024-03-25T16:58:54Z DEBUG candelabra::profiler::info] Checking for nsplit [2024-03-25T16:58:54Z DEBUG candelabra::profiler::info] Partitions: [ProfilerPartition { occurences: 69344.0, avg_n: 50.0, avg_op_counts: {"get": 0.0, "last": 0.0, "insert": 50.0, "remove": 0.0, "first": 0.0, "pop": 0.0, "clear": 0.0, "push": 0.0, "contains": 100.0, "nth": 0.0} }, ProfilerPartition { occurences: 41775.0, avg_n: 150.0, avg_op_counts: {"nth": 0.0, "remove": 0.0, "first": 0.0, "insert": 150.0, "get": 0.0, "push": 0.0, "pop": 0.0, "last": 0.0, "contains": 300.0, "clear": 0.0} }, ProfilerPartition { occurences: 4891.0, avg_n: 2500.0, avg_op_counts: {"insert": 2500.0, "nth": 0.0, "contains": 5000.0, "pop": 0.0, "first": 0.0, "push": 0.0, "get": 0.0, "clear": 0.0, "last": 0.0, "remove": 0.0} }, ProfilerPartition { occurences: 5973.0, avg_n: 7500.0, avg_op_counts: {"remove": 0.0, "nth": 0.0, "contains": 15000.0, "pop": 0.0, "last": 0.0, "insert": 7500.0, "push": 0.0, "clear": 0.0, "first": 0.0, "get": 0.0} }] [2024-03-25T16:58:54Z DEBUG candelabra::profiler::info] Costs by partitions: [("std::collections::BTreeSet", [581630428.2607172, 1319325246.1831577, 3844072464.1425066, 15584185140.079044]), ("std::collections::HashSet", [467806452.2478616, 965178935.5062613, 2541474529.362616, 10626407373.651312])] [2024-03-25T16:58:54Z DEBUG candelabra::profiler::info] Top by partition: [("std::collections::HashSet", 467806452.2478616), ("std::collections::HashSet", 965178935.5062613), ("std::collections::HashSet", 2541474529.362616), ("std::collections::HashSet", 10626407373.651312)] [2024-03-25T16:58:54Z DEBUG candelabra::profiler::info] Checking for nsplit [2024-03-25T16:58:54Z DEBUG candelabra::profiler::info] Partitions: [ProfilerPartition { occurences: 69344.0, avg_n: 50.0, avg_op_counts: {"push": 0.0, "get": 0.0, "remove": 0.0, "last": 0.0, "clear": 0.0, "insert": 50.0, "first": 0.0, "contains": 100.0, "nth": 0.0, "pop": 0.0} }, ProfilerPartition { occurences: 41775.0, avg_n: 150.0, avg_op_counts: {"clear": 0.0, "insert": 150.0, "get": 0.0, "nth": 0.0, "contains": 300.0, "pop": 0.0, "last": 0.0, "push": 0.0, "first": 0.0, "remove": 0.0} }, ProfilerPartition { occurences: 4891.0, avg_n: 2500.0, avg_op_counts: {"insert": 2500.0, "contains": 5000.0, "clear": 0.0, "remove": 0.0, "last": 0.0, "pop": 0.0, "push": 0.0, "nth": 0.0, "first": 0.0, "get": 0.0} }, ProfilerPartition { occurences: 5973.0, avg_n: 7500.0, avg_op_counts: {"insert": 7500.0, "clear": 0.0, "nth": 0.0, "last": 0.0, "remove": 0.0, "pop": 0.0, "first": 0.0, "push": 0.0, "get": 0.0, "contains": 15000.0} }] [2024-03-25T16:58:54Z DEBUG candelabra::profiler::info] Costs by partitions: [("std::collections::HashSet", [467806452.2478616, 965178935.5062613, 2541474529.362616, 10626407373.651312]), ("std::collections::BTreeSet", [581630428.2607172, 1319325246.1831577, 3844072464.1425066, 15584185140.079044])] [2024-03-25T16:58:54Z DEBUG candelabra::profiler::info] Top by partition: [("std::collections::HashSet", 467806452.2478616), ("std::collections::HashSet", 965178935.5062613), ("std::collections::HashSet", 2541474529.362616), ("std::collections::HashSet", 10626407373.651312)] [2024-03-25T16:58:54Z DEBUG candelabra::confirmation] Saving choices for project example_sets [2024-03-25T16:58:54Z DEBUG candelabra::confirmation] Saving choices for /opt/candelabra/src/tests/example_sets/src/types.pr.rs [2024-03-25T16:58:54Z DEBUG primrose::selector] Setting up directories [2024-03-25T16:58:55Z DEBUG primrose::selector] Parsing into blocks [2024-03-25T16:58:55Z DEBUG primrose::selector] Running type checker [2024-03-25T16:58:55Z DEBUG primrose::selector] Running analysis [2024-03-25T16:58:55Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source/crates/library/src/adaptive.rs [2024-03-25T16:58:55Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source/crates/library/src/profiler.rs [2024-03-25T16:58:55Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source/crates/library/src/traits.rs [2024-03-25T16:58:55Z INFO candelabra_cli::select] Saved best choices [2024-03-25T16:58:55Z INFO candelabra_cli::select] Running benchmarks with {("/opt/candelabra/src/tests/example_sets/src/types.pr.rs", "Set"): std::collections::HashSet} [2024-03-25T16:58:55Z DEBUG candelabra::confirmation] Saving choices for project example_sets [2024-03-25T16:58:55Z DEBUG candelabra::confirmation] Saving choices for /opt/candelabra/src/tests/example_sets/src/types.pr.rs [2024-03-25T16:58:55Z DEBUG primrose::selector] Setting up directories [2024-03-25T16:58:55Z DEBUG primrose::selector] Parsing into blocks [2024-03-25T16:58:55Z DEBUG primrose::selector] Running type checker [2024-03-25T16:58:55Z DEBUG primrose::selector] Running analysis [2024-03-25T16:58:55Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source/crates/library/src/adaptive.rs [2024-03-25T16:58:55Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source/crates/library/src/profiler.rs [2024-03-25T16:58:55Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source/crates/library/src/traits.rs Compiling example_sets v0.1.0 (/opt/candelabra/src/tests/example_sets) Finished bench [optimized] target(s) in 2.90s Running benches/main.rs (/opt/candelabra/src/tests/target/release/deps/main-4274d8fe7defaf49) [2024-03-25T16:59:43Z INFO candelabra_cli::select] Running benchmarks with {("/opt/candelabra/src/tests/example_sets/src/types.pr.rs", "Set"): std::collections::BTreeSet} [2024-03-25T16:59:43Z DEBUG candelabra::confirmation] Saving choices for project example_sets [2024-03-25T16:59:43Z DEBUG candelabra::confirmation] Saving choices for /opt/candelabra/src/tests/example_sets/src/types.pr.rs [2024-03-25T16:59:43Z DEBUG primrose::selector] Setting up directories [2024-03-25T16:59:43Z DEBUG primrose::selector] Parsing into blocks [2024-03-25T16:59:43Z DEBUG primrose::selector] Running type checker [2024-03-25T16:59:43Z DEBUG primrose::selector] Running analysis [2024-03-25T16:59:43Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source/crates/library/src/adaptive.rs [2024-03-25T16:59:43Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source/crates/library/src/profiler.rs [2024-03-25T16:59:43Z DEBUG primrose::library_specs] Ignoring invalid library module /nix/store/n9bab5lfpka22cpsfrvdsg454dn0kkdn-source/crates/library/src/traits.rs Compiling example_sets v0.1.0 (/opt/candelabra/src/tests/example_sets) Finished bench [optimized] target(s) in 2.81s Running benches/main.rs (/opt/candelabra/src/tests/target/release/deps/main-4274d8fe7defaf49) ┌─────────────────────────────────────────────────────────────────────────────────────────────────┬───────┬───────┬────────┬────────┬────────┬─────────┬────────────────────┬──────────┐ │ │ l18 │ l19 │ l28 │ l30 │ l37 │ l40 │ l8 │ total │ ├─────────────────────────────────────────────────────────────────────────────────────────────────┼───────┼───────┼────────┼────────┼────────┼─────────┼────────────────────┼──────────┤ │ {("/opt/candelabra/src/tests/example_sets/src/types.pr.rs", "Set"): std::collections::HashSet} │ │ 11940 │ │ 193820 │ 640250 │ │ 3899.7000000000003 │ 849909.7 │ │ {("/opt/candelabra/src/tests/example_sets/src/types.pr.rs", "Set"): std::collections::BTreeSet} │ 20039 │ │ 492650 │ │ │ 1672200 │ 6000 │ 2190889 │ └─────────────────────────────────────────────────────────────────────────────────────────────────┴───────┴───────┴────────┴────────┴────────┴─────────┴────────────────────┴──────────┘ \begin{center} \begin{tabular}{|c|c|c|c|c|c|c|c|c|} & l18 & l19 & l28 & l30 & l37 & l40 & l8 & total \\ \hline \{("/opt/candelabra/src/tests/example\_sets/src/types.pr.rs", "Set"): std::collections::HashSet\} & & 11940 & & 193820 & 640250 & & 3899.7000000000003 & 849909.7 \\ \{("/opt/candelabra/src/tests/example\_sets/src/types.pr.rs", "Set"): std::collections::BTreeSet\} & 20039 & & 492650 & & & 1672200 & 6000 & 2190889 \\ \end{tabular} \end{center} section_end:1711386038:compare-example_sets