feat(data-pipeline)!: refactor agent's /info obfuscation config format - #2490
feat(data-pipeline)!: refactor agent's /info obfuscation config format#2490Eldolfin wants to merge 7 commits into
Conversation
BenchmarksComparisonBenchmark execution time: 2026-09-10 11:34:04 Comparing candidate commit 4aaeae8 in PR branch Found 0 performance improvements and 0 performance regressions! Performance is the same for 24 metrics, 0 unstable metrics.
|
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 4aaeae8 | 1789039397 | oscarld/refactor-agent-info-obfuscation-config-format |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| trace_buffer/1_senders/10us_delay | execution_time | 56.366ms | 56.656ms ± 0.162ms | 56.622ms ± 0.095ms | 56.737ms | 56.964ms | 57.139ms | 57.179ms | 0.99% | 0.838 | 0.618 | 0.29% | 0.011ms | 1 | 200 |
| trace_buffer/1_senders/10us_delay | throughput | 15739.917op/s | 15885.600op/s ± 45.283op/s | 15894.990op/s ± 26.768op/s | 15916.864op/s | 15948.858op/s | 15962.476op/s | 15966.972op/s | 0.45% | -0.822 | 0.581 | 0.28% | 3.202op/s | 1 | 200 |
| trace_buffer/1_senders/1us_delay | execution_time | 50.027ms | 50.088ms ± 0.034ms | 50.081ms ± 0.012ms | 50.092ms | 50.175ms | 50.192ms | 50.214ms | 0.27% | 1.564 | 2.521 | 0.07% | 0.002ms | 1 | 200 |
| trace_buffer/1_senders/1us_delay | throughput | 17923.375op/s | 17968.276op/s ± 12.131op/s | 17970.901op/s ± 4.400op/s | 17975.490op/s | 17981.672op/s | 17987.310op/s | 17990.268op/s | 0.11% | -1.559 | 2.508 | 0.07% | 0.858op/s | 1 | 200 |
| trace_buffer/1_senders/no_delay | execution_time | 330.264µs | 337.770µs ± 3.464µs | 337.215µs ± 1.890µs | 339.183µs | 343.380µs | 348.559µs | 358.630µs | 6.35% | 1.674 | 6.323 | 1.02% | 0.245µs | 1 | 200 |
| trace_buffer/1_senders/no_delay | throughput | 2509547.362op/s | 2664806.007op/s ± 26892.822op/s | 2668918.801op/s ± 14985.145op/s | 2682978.064op/s | 2698128.308op/s | 2707639.446op/s | 2725092.442op/s | 2.10% | -1.514 | 5.286 | 1.01% | 1901.610op/s | 1 | 200 |
| trace_buffer/2_senders/10us_delay | execution_time | 56.887ms | 57.298ms ± 0.170ms | 57.299ms ± 0.122ms | 57.419ms | 57.564ms | 57.675ms | 57.811ms | 0.89% | 0.022 | -0.152 | 0.30% | 0.012ms | 1 | 200 |
| trace_buffer/2_senders/10us_delay | throughput | 31135.710op/s | 31415.247op/s ± 92.997op/s | 31413.888op/s ± 66.763op/s | 31480.508op/s | 31570.569op/s | 31607.741op/s | 31641.876op/s | 0.73% | -0.006 | -0.161 | 0.30% | 6.576op/s | 1 | 200 |
| trace_buffer/2_senders/1us_delay | execution_time | 50.064ms | 50.117ms ± 0.041ms | 50.111ms ± 0.017ms | 50.126ms | 50.187ms | 50.233ms | 50.444ms | 0.67% | 3.280 | 20.396 | 0.08% | 0.003ms | 1 | 200 |
| trace_buffer/2_senders/1us_delay | throughput | 35682.798op/s | 35916.005op/s ± 29.065op/s | 35920.390op/s ± 11.890op/s | 35934.096op/s | 35947.541op/s | 35950.615op/s | 35954.314op/s | 0.09% | -3.252 | 20.088 | 0.08% | 2.055op/s | 1 | 200 |
| trace_buffer/2_senders/no_delay | execution_time | 867.413µs | 913.966µs ± 15.198µs | 916.282µs ± 9.134µs | 923.839µs | 936.153µs | 945.788µs | 948.959µs | 3.57% | -0.553 | 0.326 | 1.66% | 1.075µs | 1 | 200 |
| trace_buffer/2_senders/no_delay | throughput | 1896815.574op/s | 1969986.946op/s ± 33090.351op/s | 1964461.021op/s ± 19780.248op/s | 1987399.045op/s | 2033648.152op/s | 2059788.170op/s | 2075137.129op/s | 5.63% | 0.655 | 0.481 | 1.68% | 2339.841op/s | 1 | 200 |
| trace_buffer/4_senders/10us_delay | execution_time | 57.218ms | 57.502ms ± 0.145ms | 57.484ms ± 0.088ms | 57.576ms | 57.762ms | 57.891ms | 58.075ms | 1.03% | 0.857 | 1.107 | 0.25% | 0.010ms | 1 | 200 |
| trace_buffer/4_senders/10us_delay | throughput | 61988.638op/s | 62606.928op/s ± 157.305op/s | 62626.517op/s ± 96.182op/s | 62712.207op/s | 62814.680op/s | 62899.617op/s | 62917.309op/s | 0.46% | -0.839 | 1.058 | 0.25% | 11.123op/s | 1 | 200 |
| trace_buffer/4_senders/1us_delay | execution_time | 50.116ms | 50.170ms ± 0.033ms | 50.161ms ± 0.016ms | 50.184ms | 50.243ms | 50.262ms | 50.268ms | 0.21% | 1.064 | 0.620 | 0.07% | 0.002ms | 1 | 200 |
| trace_buffer/4_senders/1us_delay | throughput | 71615.746op/s | 71755.915op/s ± 47.422op/s | 71768.576op/s ± 22.429op/s | 71788.318op/s | 71812.592op/s | 71830.056op/s | 71832.855op/s | 0.09% | -1.061 | 0.613 | 0.07% | 3.353op/s | 1 | 200 |
| trace_buffer/4_senders/no_delay | execution_time | 2.188ms | 2.417ms ± 0.064ms | 2.419ms ± 0.039ms | 2.461ms | 2.509ms | 2.530ms | 2.569ms | 6.19% | -0.750 | 1.135 | 2.63% | 0.005ms | 1 | 200 |
| trace_buffer/4_senders/no_delay | throughput | 1401380.516op/s | 1490574.371op/s ± 40266.361op/s | 1488098.676op/s ± 23850.070op/s | 1510186.167op/s | 1564003.296op/s | 1614381.595op/s | 1645122.525op/s | 10.55% | 0.963 | 1.700 | 2.69% | 2847.262op/s | 1 | 200 |
| trace_buffer/8_senders/10us_delay | execution_time | 57.603ms | 57.903ms ± 0.206ms | 57.849ms ± 0.121ms | 58.015ms | 58.298ms | 58.369ms | 58.480ms | 1.09% | 0.750 | -0.415 | 0.35% | 0.015ms | 1 | 200 |
| trace_buffer/8_senders/10us_delay | throughput | 123118.954op/s | 124347.282op/s ± 440.647op/s | 124461.911op/s ± 260.148op/s | 124693.544op/s | 124913.396op/s | 124964.277op/s | 124993.167op/s | 0.43% | -0.740 | -0.433 | 0.35% | 31.158op/s | 1 | 200 |
| trace_buffer/8_senders/1us_delay | execution_time | 50.201ms | 50.299ms ± 0.068ms | 50.279ms ± 0.037ms | 50.328ms | 50.436ms | 50.512ms | 50.598ms | 0.64% | 1.493 | 2.708 | 0.13% | 0.005ms | 1 | 200 |
| trace_buffer/8_senders/1us_delay | throughput | 142297.892op/s | 143145.372op/s ± 192.814op/s | 143202.303op/s ± 105.895op/s | 143277.217op/s | 143357.267op/s | 143400.120op/s | 143422.229op/s | 0.15% | -1.483 | 2.663 | 0.13% | 13.634op/s | 1 | 200 |
| trace_buffer/8_senders/no_delay | execution_time | 6.083ms | 6.375ms ± 0.091ms | 6.389ms ± 0.056ms | 6.440ms | 6.496ms | 6.544ms | 6.549ms | 2.51% | -0.732 | 0.398 | 1.42% | 0.006ms | 1 | 200 |
| trace_buffer/8_senders/no_delay | throughput | 1099345.737op/s | 1129582.631op/s ± 16241.776op/s | 1126916.551op/s ± 9808.761op/s | 1138622.233op/s | 1161987.471op/s | 1173074.944op/s | 1183626.241op/s | 5.03% | 0.813 | 0.556 | 1.43% | 1148.467op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| trace_buffer/1_senders/10us_delay | execution_time | [56.633ms; 56.678ms] or [-0.040%; +0.040%] | None | None | None |
| trace_buffer/1_senders/10us_delay | throughput | [15879.324op/s; 15891.876op/s] or [-0.040%; +0.040%] | None | None | None |
| trace_buffer/1_senders/1us_delay | execution_time | [50.084ms; 50.093ms] or [-0.009%; +0.009%] | None | None | None |
| trace_buffer/1_senders/1us_delay | throughput | [17966.594op/s; 17969.957op/s] or [-0.009%; +0.009%] | None | None | None |
| trace_buffer/1_senders/no_delay | execution_time | [337.290µs; 338.251µs] or [-0.142%; +0.142%] | None | None | None |
| trace_buffer/1_senders/no_delay | throughput | [2661078.921op/s; 2668533.094op/s] or [-0.140%; +0.140%] | None | None | None |
| trace_buffer/2_senders/10us_delay | execution_time | [57.274ms; 57.321ms] or [-0.041%; +0.041%] | None | None | None |
| trace_buffer/2_senders/10us_delay | throughput | [31402.358op/s; 31428.135op/s] or [-0.041%; +0.041%] | None | None | None |
| trace_buffer/2_senders/1us_delay | execution_time | [50.111ms; 50.123ms] or [-0.011%; +0.011%] | None | None | None |
| trace_buffer/2_senders/1us_delay | throughput | [35911.977op/s; 35920.033op/s] or [-0.011%; +0.011%] | None | None | None |
| trace_buffer/2_senders/no_delay | execution_time | [911.859µs; 916.072µs] or [-0.230%; +0.230%] | None | None | None |
| trace_buffer/2_senders/no_delay | throughput | [1965400.942op/s; 1974572.951op/s] or [-0.233%; +0.233%] | None | None | None |
| trace_buffer/4_senders/10us_delay | execution_time | [57.482ms; 57.522ms] or [-0.035%; +0.035%] | None | None | None |
| trace_buffer/4_senders/10us_delay | throughput | [62585.127op/s; 62628.729op/s] or [-0.035%; +0.035%] | None | None | None |
| trace_buffer/4_senders/1us_delay | execution_time | [50.166ms; 50.175ms] or [-0.009%; +0.009%] | None | None | None |
| trace_buffer/4_senders/1us_delay | throughput | [71749.343op/s; 71762.487op/s] or [-0.009%; +0.009%] | None | None | None |
| trace_buffer/4_senders/no_delay | execution_time | [2.408ms; 2.426ms] or [-0.366%; +0.366%] | None | None | None |
| trace_buffer/4_senders/no_delay | throughput | [1484993.840op/s; 1496154.901op/s] or [-0.374%; +0.374%] | None | None | None |
| trace_buffer/8_senders/10us_delay | execution_time | [57.875ms; 57.932ms] or [-0.049%; +0.049%] | None | None | None |
| trace_buffer/8_senders/10us_delay | throughput | [124286.213op/s; 124408.352op/s] or [-0.049%; +0.049%] | None | None | None |
| trace_buffer/8_senders/1us_delay | execution_time | [50.289ms; 50.308ms] or [-0.019%; +0.019%] | None | None | None |
| trace_buffer/8_senders/1us_delay | throughput | [143118.650op/s; 143172.095op/s] or [-0.019%; +0.019%] | None | None | None |
| trace_buffer/8_senders/no_delay | execution_time | [6.363ms; 6.388ms] or [-0.197%; +0.197%] | None | None | None |
| trace_buffer/8_senders/no_delay | throughput | [1127331.677op/s; 1131833.585op/s] or [-0.199%; +0.199%] | None | None | None |
Group 1
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz | 4aaeae8 | 1789039397 | oscarld/refactor-agent-info-obfuscation-config-format |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| write only interface | execution_time | 2.045µs | 2.066µs ± 0.009µs | 2.063µs ± 0.002µs | 2.066µs | 2.089µs | 2.095µs | 2.102µs | 1.89% | 1.715 | 2.829 | 0.45% | 0.001µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| write only interface | execution_time | [2.064µs; 2.067µs] or [-0.062%; +0.062%] | None | None | None |
Group 2
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz | 4aaeae8 | 1789039397 | oscarld/refactor-agent-info-obfuscation-config-format |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| two way interface | execution_time | 21.347µs | 21.797µs ± 0.277µs | 21.736µs ± 0.177µs | 21.947µs | 22.272µs | 22.661µs | 22.788µs | 4.84% | 0.978 | 1.101 | 1.27% | 0.020µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| two way interface | execution_time | [21.759µs; 21.835µs] or [-0.176%; +0.176%] | None | None | None |
Group 3
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz | 4aaeae8 | 1789039397 | oscarld/refactor-agent-info-obfuscation-config-format |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | 29.079µs | 30.073µs ± 1.280µs | 29.263µs ± 0.090µs | 31.512µs | 32.586µs | 32.781µs | 32.827µs | 12.18% | 1.022 | -0.726 | 4.25% | 0.091µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | [29.896µs; 30.251µs] or [-0.590%; +0.590%] | None | None | None |
Group 4
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz | 4aaeae8 | 1789039397 | oscarld/refactor-agent-info-obfuscation-config-format |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | 9.656ms | 9.688ms ± 0.021ms | 9.682ms ± 0.012ms | 9.699ms | 9.726ms | 9.750ms | 9.776ms | 0.97% | 1.193 | 1.474 | 0.21% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | [9.685ms; 9.691ms] or [-0.030%; +0.030%] | None | None | None |
Group 5
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz | 4aaeae8 | 1789039397 | oscarld/refactor-agent-info-obfuscation-config-format |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | 3.887µs | 3.924µs ± 0.005µs | 3.923µs ± 0.003µs | 3.926µs | 3.930µs | 3.935µs | 3.944µs | 0.52% | -1.182 | 13.233 | 0.13% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/ | throughput | 253570075.667op/s | 254869360.510op/s ± 326600.992op/s | 254898840.292op/s ± 201537.033op/s | 255089155.001op/s | 255220030.644op/s | 255274391.930op/s | 257238971.068op/s | 0.92% | 1.235 | 13.599 | 0.13% | 23094.178op/s | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | 79.610µs | 80.357µs ± 0.407µs | 80.280µs ± 0.276µs | 80.616µs | 81.077µs | 81.386µs | 81.965µs | 2.10% | 0.766 | 0.641 | 0.50% | 0.029µs | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | 12200307.975op/s | 12444797.266op/s ± 62744.389op/s | 12456381.520op/s ± 42677.863op/s | 12491063.270op/s | 12529941.863op/s | 12537903.725op/s | 12561180.486op/s | 0.84% | -0.735 | 0.552 | 0.50% | 4436.698op/s | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | execution_time | 73.549µs | 74.352µs ± 0.373µs | 74.294µs ± 0.245µs | 74.570µs | 75.115µs | 75.253µs | 75.497µs | 1.62% | 0.633 | 0.182 | 0.50% | 0.026µs | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | throughput | 13245610.110op/s | 13449875.386op/s ± 67205.457op/s | 13460013.668op/s ± 44337.038op/s | 13497466.188op/s | 13541268.555op/s | 13568238.858op/s | 13596394.357op/s | 1.01% | -0.606 | 0.140 | 0.50% | 4752.143op/s | 1 | 200 |
| credit_card/is_card_number/37828224631 | execution_time | 3.901µs | 3.923µs ± 0.004µs | 3.922µs ± 0.002µs | 3.925µs | 3.930µs | 3.936µs | 3.938µs | 0.40% | 0.139 | 4.911 | 0.10% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/37828224631 | throughput | 253937575.970op/s | 254896449.268op/s ± 267415.782op/s | 254950080.778op/s ± 160714.750op/s | 255068670.864op/s | 255178894.441op/s | 255223749.816op/s | 256374165.527op/s | 0.56% | -0.117 | 4.988 | 0.10% | 18909.151op/s | 1 | 200 |
| credit_card/is_card_number/378282246310005 | execution_time | 69.910µs | 70.672µs ± 0.366µs | 70.604µs ± 0.240µs | 70.914µs | 71.348µs | 71.593µs | 71.764µs | 1.64% | 0.500 | 0.073 | 0.52% | 0.026µs | 1 | 200 |
| credit_card/is_card_number/378282246310005 | throughput | 13934555.086op/s | 14150319.184op/s ± 73149.187op/s | 14163489.360op/s ± 48205.686op/s | 14200482.464op/s | 14263106.116op/s | 14292582.379op/s | 14304007.298op/s | 0.99% | -0.472 | 0.035 | 0.52% | 5172.429op/s | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | execution_time | 53.151µs | 53.245µs ± 0.057µs | 53.232µs ± 0.039µs | 53.281µs | 53.354µs | 53.401µs | 53.467µs | 0.44% | 0.888 | 0.610 | 0.11% | 0.004µs | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | throughput | 18702996.907op/s | 18781033.626op/s ± 20219.563op/s | 18785783.859op/s ± 13883.516op/s | 18796317.802op/s | 18805885.491op/s | 18810091.277op/s | 18814172.716op/s | 0.15% | -0.882 | 0.591 | 0.11% | 1429.739op/s | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | execution_time | 6.442µs | 6.452µs ± 0.007µs | 6.451µs ± 0.005µs | 6.457µs | 6.465µs | 6.469µs | 6.472µs | 0.34% | 0.715 | -0.348 | 0.11% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | throughput | 154501285.301op/s | 154980168.422op/s ± 163653.740op/s | 155021842.578op/s ± 113668.966op/s | 155114521.057op/s | 155182816.998op/s | 155205603.507op/s | 155225200.721op/s | 0.13% | -0.711 | -0.356 | 0.11% | 11572.067op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | execution_time | 3.888µs | 3.924µs ± 0.005µs | 3.923µs ± 0.003µs | 3.926µs | 3.931µs | 3.934µs | 3.965µs | 1.08% | 1.125 | 23.471 | 0.14% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | throughput | 252201745.968op/s | 254869326.615op/s ± 354210.236op/s | 254921751.769op/s ± 173360.446op/s | 255076459.169op/s | 255190598.030op/s | 255239389.352op/s | 257184343.787op/s | 0.89% | -1.024 | 23.258 | 0.14% | 25046.446op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | 64.870µs | 65.323µs ± 0.208µs | 65.271µs ± 0.107µs | 65.428µs | 65.705µs | 65.992µs | 66.150µs | 1.35% | 1.207 | 2.167 | 0.32% | 0.015µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | 15117241.076op/s | 15308653.576op/s ± 48547.536op/s | 15320700.819op/s ± 25140.638op/s | 15342502.820op/s | 15366275.507op/s | 15405539.300op/s | 15415447.820op/s | 0.62% | -1.181 | 2.089 | 0.32% | 3432.829op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | 58.568µs | 59.002µs ± 0.197µs | 58.969µs ± 0.107µs | 59.081µs | 59.377µs | 59.588µs | 59.611µs | 1.09% | 0.930 | 0.825 | 0.33% | 0.014µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | 16775377.693op/s | 16948646.976op/s ± 56292.552op/s | 16958044.949op/s ± 30717.836op/s | 16987778.992op/s | 17016698.146op/s | 17053059.507op/s | 17074247.365op/s | 0.69% | -0.911 | 0.788 | 0.33% | 3980.485op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | 3.886µs | 3.924µs ± 0.005µs | 3.924µs ± 0.003µs | 3.927µs | 3.931µs | 3.935µs | 3.938µs | 0.37% | -2.249 | 20.147 | 0.12% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | 253913175.435op/s | 254826225.381op/s ± 309921.536op/s | 254841997.961op/s ± 183542.848op/s | 255017876.761op/s | 255170134.710op/s | 255263047.081op/s | 257351887.429op/s | 0.98% | 2.312 | 20.732 | 0.12% | 21914.762op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | 55.489µs | 55.817µs ± 0.197µs | 55.763µs ± 0.121µs | 55.949µs | 56.229µs | 56.340µs | 56.372µs | 1.09% | 0.786 | -0.054 | 0.35% | 0.014µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | 17739334.669op/s | 17915835.335op/s ± 63195.236op/s | 17932973.724op/s ± 39015.722op/s | 17962871.206op/s | 17995296.839op/s | 18015605.157op/s | 18021523.105op/s | 0.49% | -0.772 | -0.082 | 0.35% | 4468.578op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | 53.065µs | 53.243µs ± 0.059µs | 53.234µs ± 0.042µs | 53.280µs | 53.350µs | 53.383µs | 53.431µs | 0.37% | 0.576 | 0.093 | 0.11% | 0.004µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | 18715665.340op/s | 18781744.302op/s ± 20851.597op/s | 18785053.688op/s ± 14698.155op/s | 18798473.564op/s | 18807430.910op/s | 18809682.015op/s | 18844731.740op/s | 0.32% | -0.570 | 0.087 | 0.11% | 1474.431op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | 6.442µs | 6.451µs ± 0.006µs | 6.450µs ± 0.005µs | 6.456µs | 6.462µs | 6.468µs | 6.477µs | 0.43% | 0.839 | 0.501 | 0.10% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | 154385822.322op/s | 155006779.970op/s ± 154347.217op/s | 155046645.783op/s ± 112617.443op/s | 155135572.977op/s | 155190496.343op/s | 155220780.923op/s | 155233968.638op/s | 0.12% | -0.833 | 0.481 | 0.10% | 10913.996op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | [3.923µs; 3.924µs] or [-0.018%; +0.018%] | None | None | None |
| credit_card/is_card_number/ | throughput | [254824096.754op/s; 254914624.267op/s] or [-0.018%; +0.018%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | [80.301µs; 80.413µs] or [-0.070%; +0.070%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | [12436101.497op/s; 12453493.035op/s] or [-0.070%; +0.070%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | execution_time | [74.300µs; 74.404µs] or [-0.069%; +0.069%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | throughput | [13440561.356op/s; 13459189.416op/s] or [-0.069%; +0.069%] | None | None | None |
| credit_card/is_card_number/37828224631 | execution_time | [3.923µs; 3.924µs] or [-0.015%; +0.015%] | None | None | None |
| credit_card/is_card_number/37828224631 | throughput | [254859388.012op/s; 254933510.523op/s] or [-0.015%; +0.015%] | None | None | None |
| credit_card/is_card_number/378282246310005 | execution_time | [70.621µs; 70.722µs] or [-0.072%; +0.072%] | None | None | None |
| credit_card/is_card_number/378282246310005 | throughput | [14140181.410op/s; 14160456.958op/s] or [-0.072%; +0.072%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | execution_time | [53.237µs; 53.253µs] or [-0.015%; +0.015%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | throughput | [18778231.389op/s; 18783835.863op/s] or [-0.015%; +0.015%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | execution_time | [6.452µs; 6.453µs] or [-0.015%; +0.015%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | throughput | [154957487.588op/s; 155002849.257op/s] or [-0.015%; +0.015%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | execution_time | [3.923µs; 3.924µs] or [-0.019%; +0.019%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | throughput | [254820236.483op/s; 254918416.748op/s] or [-0.019%; +0.019%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | [65.294µs; 65.352µs] or [-0.044%; +0.044%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | [15301925.354op/s; 15315381.798op/s] or [-0.044%; +0.044%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | [58.975µs; 59.030µs] or [-0.046%; +0.046%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | [16940845.370op/s; 16956448.582op/s] or [-0.046%; +0.046%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | [3.924µs; 3.925µs] or [-0.017%; +0.017%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | [254783273.237op/s; 254869177.525op/s] or [-0.017%; +0.017%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | [55.790µs; 55.845µs] or [-0.049%; +0.049%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | [17907077.083op/s; 17924593.587op/s] or [-0.049%; +0.049%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | [53.235µs; 53.251µs] or [-0.015%; +0.015%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | [18778854.471op/s; 18784634.133op/s] or [-0.015%; +0.015%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | [6.450µs; 6.452µs] or [-0.014%; +0.014%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | [154985388.930op/s; 155028171.010op/s] or [-0.014%; +0.014%] | None | None | None |
Group 6
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz | 4aaeae8 | 1789039397 | oscarld/refactor-agent-info-obfuscation-config-format |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | 4.943µs | 5.030µs ± 0.045µs | 5.017µs ± 0.011µs | 5.031µs | 5.138µs | 5.141µs | 5.143µs | 2.52% | 1.304 | 1.235 | 0.89% | 0.003µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | [5.024µs; 5.037µs] or [-0.124%; +0.124%] | None | None | None |
Group 7
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz | 4aaeae8 | 1789039397 | oscarld/refactor-agent-info-obfuscation-config-format |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | 287.061µs | 288.237µs ± 0.564µs | 288.154µs ± 0.140µs | 288.328µs | 288.881µs | 289.968µs | 294.278µs | 2.13% | 6.643 | 65.446 | 0.20% | 0.040µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | [288.159µs; 288.315µs] or [-0.027%; +0.027%] | None | None | None |
Group 8
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz | 4aaeae8 | 1789039397 | oscarld/refactor-agent-info-obfuscation-config-format |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | 2.625µs | 2.662µs ± 0.043µs | 2.649µs ± 0.008µs | 2.658µs | 2.754µs | 2.851µs | 2.856µs | 7.80% | 2.903 | 8.498 | 1.62% | 0.003µs | 1 | 200 |
| tags/replace_trace_tags_v04 | execution_time | 2.613µs | 2.799µs ± 0.067µs | 2.830µs ± 0.022µs | 2.849µs | 2.855µs | 2.858µs | 2.859µs | 1.04% | -1.308 | 0.349 | 2.39% | 0.005µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | [2.656µs; 2.668µs] or [-0.225%; +0.225%] | None | None | None |
| tags/replace_trace_tags_v04 | execution_time | [2.790µs; 2.809µs] or [-0.332%; +0.332%] | None | None | None |
Baseline
Omitted due to size.
e936bbd to
b3a818c
Compare
📚 Documentation Check Results📦
|
🔒 Cargo Deny Results✅ No issues found! 📦
|
🎉 All green!🧪 All tests passed 🎯 Code Coverage (details) 🔗 Commit SHA: 4aaeae8 | Docs | View more details | Give us feedback! |
Artifact Size Benchmark Reportaarch64-alpine-linux-musl
aarch64-unknown-linux-gnu
libdatadog-x64-windows
libdatadog-x86-windows
x86_64-alpine-linux-musl
x86_64-unknown-linux-gnu
|
What does this PR do?
Parse the obfuscation config from the agent
/infoendpoint with a new, more complete format.It now includes the missing parts, these are not used in stats computation yet it will come in a follow up PR.
Agent side PR: DataDog/datadog-agent#56014
Motivation
2 main motivation:
Client side stats obfuscates resources without using the agent config. This is a breaking change for customers enabling CSS when they have a custom obfuscation config.See https://docs.google.com/document/d/1i-CQfkF-5B_8vLYepIJ6A16aRISH-Px7XIBSq0HKMaY/edit?tab=t.0#heading=h.i4txi29o2zao
We might want to obfuscate span derived primary tags in client side stats in the future.
Additional Notes
How to test the change?
I tried the
fetch_infofunction manually using a released agent version and with the version in the mentioned PR.