Package: mlr3resampling
Type: Package
Title: Resampling Algorithms for 'mlr3' Framework
Version: 2024.7.3
Authors@R: c(
    person("Toby", "Hocking",
     email="toby.hocking@r-project.org",
     role=c("aut", "cre"),
     comment = c(ORCID="0000-0002-3146-0865")),
    person("Michel", "Lang", , "michellang@gmail.com", role = "ctb",
           comment = c(ORCID = "0000-0001-9754-0393", "Author of mlr3 when Resampling/ResamplingCV was copied/modified")),
    person("Bernd", "Bischl", , "bernd_bischl@gmx.net", role = "ctb",
           comment = c(ORCID = "0000-0001-6002-6980", "Author of mlr3 when Resampling/ResamplingCV was copied/modified")),
    person("Jakob", "Richter", , "jakob1richter@gmail.com", role = "ctb",
           comment = c(ORCID = "0000-0003-4481-5554", "Author of mlr3 when Resampling/ResamplingCV was copied/modified")),
    person("Patrick", "Schratz", , "patrick.schratz@gmail.com", role = "ctb",
           comment = c(ORCID = "0000-0003-0748-6624", "Author of mlr3 when Resampling/ResamplingCV was copied/modified")),
    person("Giuseppe", "Casalicchio", , "giuseppe.casalicchio@stat.uni-muenchen.de", role = "ctb",
           comment = c(ORCID = "0000-0001-5324-5966", "Author of mlr3 when Resampling/ResamplingCV was copied/modified")),
    person("Stefan", "Coors", , "mail@stefancoors.de", role = "ctb",
           comment = c(ORCID = "0000-0002-7465-2146", "Author of mlr3 when Resampling/ResamplingCV was copied/modified")),
    person("Quay", "Au", , "quayau@gmail.com", role = "ctb",
           comment = c(ORCID = "0000-0002-5252-8902", "Author of mlr3 when Resampling/ResamplingCV was copied/modified")),
    person("Martin", "Binder", , "mlr.developer@mb706.com", role = "ctb"),
    person("Florian", "Pfisterer", , "pfistererf@googlemail.com", role = "ctb",
           comment = c(ORCID = "0000-0001-8867-762X", "Author of mlr3 when Resampling/ResamplingCV was copied/modified")),
    person("Raphael", "Sonabend", , "raphaelsonabend@gmail.com", role = "ctb",
           comment = c(ORCID = "0000-0001-9225-4654", "Author of mlr3 when Resampling/ResamplingCV was copied/modified")),
    person("Lennart", "Schneider", , "lennart.sch@web.de", role = "ctb",
           comment = c(ORCID = "0000-0003-4152-5308", "Author of mlr3 when Resampling/ResamplingCV was copied/modified")),
    person("Marc", "Becker", , "marcbecker@posteo.de", role = "ctb",
           comment = c(ORCID = "0000-0002-8115-0400", "Author of mlr3 when Resampling/ResamplingCV was copied/modified")),
    person("Sebastian", "Fischer", , "sebf.fischer@gmail.com", role = "ctb",
           comment = c(ORCID = "0000-0002-9609-3197", "Author of mlr3 when Resampling/ResamplingCV was copied/modified"))
  )
Description: A supervised learning algorithm inputs a train set,
 and outputs a prediction function, which can be used on a test set.
 If each data point belongs to a group
 (such as geographic region, year, etc), then
 how do we know if it is possible to train on one group, and predict
 accurately on another group? Cross-validation can be used to determine
 the extent to which this is possible, by first assigning fold IDs from
 1 to K to all data (possibly using stratification, usually by group
 and label). Then we loop over test sets (group/fold combinations),
 train sets (same group, other groups, all groups), and compute
 test/prediction accuracy for each combination.  Comparing
 test/prediction accuracy between same and other, we can determine the
 extent to which it is possible (perfect if same/other have similar
 test accuracy for each group; other is usually somewhat less accurate
 than same; other can be just as bad as featureless baseline when the
 groups have different patterns).
 For more information,
 <https://tdhock.github.io/blog/2023/R-gen-new-subsets/>
 describes the method in depth.
 How many train samples are required to get accurate predictions on a
 test set? Cross-validation can be used to answer this question, with
 variable size train sets.
License: GPL-3
URL: https://github.com/tdhock/mlr3resampling
BugReports: https://github.com/tdhock/mlr3resampling/issues
Imports: data.table, R6, checkmate, paradox, mlr3, mlr3misc
Suggests: ggplot2, animint2, mlr3tuning, lgr, future, testthat, knitr,
        markdown, nc, rpart, directlabels
VignetteBuilder: knitr
NeedsCompilation: no
Packaged: 2024-07-05 18:55:12 UTC; tdhock
Author: Toby Hocking [aut, cre] (<https://orcid.org/0000-0002-3146-0865>),
  Michel Lang [ctb] (<https://orcid.org/0000-0001-9754-0393>, Author of
    mlr3 when Resampling/ResamplingCV was copied/modified),
  Bernd Bischl [ctb] (<https://orcid.org/0000-0001-6002-6980>, Author of
    mlr3 when Resampling/ResamplingCV was copied/modified),
  Jakob Richter [ctb] (<https://orcid.org/0000-0003-4481-5554>, Author of
    mlr3 when Resampling/ResamplingCV was copied/modified),
  Patrick Schratz [ctb] (<https://orcid.org/0000-0003-0748-6624>, Author
    of mlr3 when Resampling/ResamplingCV was copied/modified),
  Giuseppe Casalicchio [ctb] (<https://orcid.org/0000-0001-5324-5966>,
    Author of mlr3 when Resampling/ResamplingCV was copied/modified),
  Stefan Coors [ctb] (<https://orcid.org/0000-0002-7465-2146>, Author of
    mlr3 when Resampling/ResamplingCV was copied/modified),
  Quay Au [ctb] (<https://orcid.org/0000-0002-5252-8902>, Author of mlr3
    when Resampling/ResamplingCV was copied/modified),
  Martin Binder [ctb],
  Florian Pfisterer [ctb] (<https://orcid.org/0000-0001-8867-762X>,
    Author of mlr3 when Resampling/ResamplingCV was copied/modified),
  Raphael Sonabend [ctb] (<https://orcid.org/0000-0001-9225-4654>, Author
    of mlr3 when Resampling/ResamplingCV was copied/modified),
  Lennart Schneider [ctb] (<https://orcid.org/0000-0003-4152-5308>,
    Author of mlr3 when Resampling/ResamplingCV was copied/modified),
  Marc Becker [ctb] (<https://orcid.org/0000-0002-8115-0400>, Author of
    mlr3 when Resampling/ResamplingCV was copied/modified),
  Sebastian Fischer [ctb] (<https://orcid.org/0000-0002-9609-3197>,
    Author of mlr3 when Resampling/ResamplingCV was copied/modified)
Maintainer: Toby Hocking <toby.hocking@r-project.org>
Repository: CRAN
Date/Publication: 2024-07-05 22:10:01 UTC
Built: R 4.4.0; ; 2024-07-06 00:30:31 UTC; unix
