Skip to content

Very high scores get a score_pctl value of 1 instead of 100 #43

@AndrewKostandy

Description

@AndrewKostandy

Thank you for your work on this package. It's truly appreciated.

There seems to be an issue when running the score() function where results with very high scores get a score_pctl value of 1 instead of 100. There seems to be already an issue posted about the same problem (with no response), but I am posting a reproducible example below using the recommended format.

On a side note, CRAN is stating that "[issues need fixing before 2025-10-31]" on the package page so I thought to let you know too.

library(tidyverse)
library(applicable)

mod <- select(iris, 1:4) |>
  apd_isolation(nthreads = 1)

score(mod, select(iris, 1:4)) |>
  pull(score) |>
  quantile(probs = c(0,0.01,0.25,0.5,0.75,0.99,1))
#>        0%        1%       25%       50%       75%       99%      100% 
#> 0.3967572 0.3998048 0.4258091 0.4513852 0.4932370 0.6323000 0.6398325


score(mod, select(iris, 1:4)) |>
  filter(between(score_pctl, 0, 2))
#> # A tibble: 3 × 2
#>   score score_pctl
#>   <dbl>      <dbl>
#> 1 0.397      0    
#> 2 0.398      0.561
#> 3 0.401      1.76

score(mod, select(iris, 1:4)) |>
  filter(between(score_pctl, 98, 100))
#> # A tibble: 3 × 2
#>   score score_pctl
#>   <dbl>      <dbl>
#> 1 0.625       98.7
#> 2 0.640      100  
#> 3 0.639       99.9

score(
  mod,
  tibble(Sepal.Length = 1e9, Sepal.Width = 1e9, Petal.Length= 1e9, Petal.Width = 1e9)
)
#> # A tibble: 1 × 2
#>   score score_pctl
#>   <dbl>      <dbl>
#> 1 0.708          1
Created on 2025-10-10 with [reprex v2.1.1](https://reprex.tidyverse.org/)
Session Info
sessioninfo::session_info()
#> ─ Session info ───────────────────────────────────────────────────────────────
#>  setting  value
#>  version  R version 4.5.1 (2025-06-13)
#>  os       macOS Tahoe 26.0.1
#>  system   x86_64, darwin20
#>  ui       X11
#>  language (EN)
#>  collate  en_US.UTF-8
#>  ctype    en_US.UTF-8
#>  tz       America/Toronto
#>  date     2025-10-10
#>  pandoc   3.6.3 @ /Applications/RStudio.app/Contents/Resources/app/quarto/bin/tools/x86_64/ (via rmarkdown)
#>  quarto   1.6.39 @ /usr/local/bin/quarto
#> 
#> ─ Packages ───────────────────────────────────────────────────────────────────
#>  package      * version date (UTC) lib source
#>  applicable   * 0.1.1   2024-04-25 [1] CRAN (R 4.5.0)
#>  cli            3.6.5   2025-04-23 [1] CRAN (R 4.5.0)
#>  dichromat      2.0-0.1 2022-05-02 [1] CRAN (R 4.5.0)
#>  digest         0.6.37  2024-08-19 [1] CRAN (R 4.5.0)
#>  dplyr        * 1.1.4   2023-11-17 [1] CRAN (R 4.5.0)
#>  evaluate       1.0.5   2025-08-27 [1] CRAN (R 4.5.1)
#>  farver         2.1.2   2024-05-13 [1] CRAN (R 4.5.0)
#>  fastmap        1.2.0   2024-05-15 [1] CRAN (R 4.5.0)
#>  forcats      * 1.0.1   2025-09-25 [1] CRAN (R 4.5.1)
#>  fs             1.6.6   2025-04-12 [1] CRAN (R 4.5.0)
#>  generics       0.1.4   2025-05-09 [1] CRAN (R 4.5.0)
#>  ggplot2      * 4.0.0   2025-09-11 [1] CRAN (R 4.5.1)
#>  glue           1.8.0   2024-09-30 [1] CRAN (R 4.5.0)
#>  gtable         0.3.6   2024-10-25 [1] CRAN (R 4.5.0)
#>  hardhat        1.4.2   2025-08-20 [1] CRAN (R 4.5.1)
#>  hms            1.1.3   2023-03-21 [1] CRAN (R 4.5.0)
#>  htmltools      0.5.8.1 2024-04-04 [1] CRAN (R 4.5.0)
#>  isotree        0.6.1-4 2025-01-08 [1] CRAN (R 4.5.0)
#>  jsonlite       2.0.0   2025-03-27 [1] CRAN (R 4.5.0)
#>  knitr          1.50    2025-03-16 [1] CRAN (R 4.5.0)
#>  lattice        0.22-7  2025-04-02 [1] CRAN (R 4.5.1)
#>  lifecycle      1.0.4   2023-11-07 [1] CRAN (R 4.5.0)
#>  lubridate    * 1.9.4   2024-12-08 [1] CRAN (R 4.5.0)
#>  magrittr       2.0.4   2025-09-12 [1] CRAN (R 4.5.1)
#>  Matrix         1.7-4   2025-08-28 [1] CRAN (R 4.5.1)
#>  pillar         1.11.1  2025-09-17 [1] CRAN (R 4.5.1)
#>  pkgconfig      2.0.3   2019-09-22 [1] CRAN (R 4.5.0)
#>  proxyC         0.5.2   2025-04-25 [1] CRAN (R 4.5.0)
#>  purrr        * 1.1.0   2025-07-10 [1] CRAN (R 4.5.0)
#>  R6             2.6.1   2025-02-15 [1] CRAN (R 4.5.0)
#>  RColorBrewer   1.1-3   2022-04-03 [1] CRAN (R 4.5.0)
#>  Rcpp           1.1.0   2025-07-02 [1] CRAN (R 4.5.1)
#>  readr        * 2.1.5   2024-01-10 [1] CRAN (R 4.5.0)
#>  reprex         2.1.1   2024-07-06 [1] CRAN (R 4.5.0)
#>  RhpcBLASctl    0.23-42 2023-02-11 [1] CRAN (R 4.5.0)
#>  rlang          1.1.6   2025-04-11 [1] CRAN (R 4.5.0)
#>  rmarkdown      2.30    2025-09-28 [1] CRAN (R 4.5.1)
#>  rstudioapi     0.17.1  2024-10-22 [1] CRAN (R 4.5.0)
#>  S7             0.2.0   2024-11-07 [1] CRAN (R 4.5.0)
#>  scales         1.4.0   2025-04-24 [1] CRAN (R 4.5.0)
#>  sessioninfo    1.2.3   2025-02-05 [1] CRAN (R 4.5.0)
#>  stringi        1.8.7   2025-03-27 [1] CRAN (R 4.5.0)
#>  stringr      * 1.5.2   2025-09-08 [1] CRAN (R 4.5.1)
#>  tibble       * 3.3.0   2025-06-08 [1] CRAN (R 4.5.0)
#>  tidyr        * 1.3.1   2024-01-24 [1] CRAN (R 4.5.0)
#>  tidyselect     1.2.1   2024-03-11 [1] CRAN (R 4.5.0)
#>  tidyverse    * 2.0.0   2023-02-22 [1] CRAN (R 4.5.0)
#>  timechange     0.3.0   2024-01-18 [1] CRAN (R 4.5.0)
#>  tzdb           0.5.0   2025-03-15 [1] CRAN (R 4.5.0)
#>  vctrs          0.6.5   2023-12-01 [1] CRAN (R 4.5.0)
#>  withr          3.0.2   2024-10-28 [1] CRAN (R 4.5.0)
#>  xfun           0.53    2025-08-19 [1] CRAN (R 4.5.1)
#>  yaml           2.3.10  2024-07-26 [1] CRAN (R 4.5.0)
#> 
#>  [1] /Library/Frameworks/R.framework/Versions/4.5-x86_64/Resources/library
#>  * ── Packages attached to the search path.
#> 
#> ──────────────────────────────────────────────────────────────────────────────

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugan unexpected problem or unintended behavior

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions