1. Tool interface | Create a tool set | Arguments of the create_toolset function | Use predefined tool sets | 2. Test data interface | 2a. Select pre-defined test data for the accuracy evaluation | 2b. Create randomly generated test data for the running-time evaluation | 3. Run a evaluation function with the selected tools and test data sets | 3a. Accuracy evaluation of precision-recall curves | Evaluation scores | Visualization of the result | 3b. Running-time evaluation of precision-recall curves | 4. Create a user-defined tool | The format of the function for calculating a precision-recall curve | 5. Create a user-defined test data | 5a. User-defined test data for the accuracy evaluation | 5b. User-defined test data for the running-time evaluation | 6. External links
Package: prcbench 1.1.10
Takaya Saito
prcbench: Testing Workbench for Precision-Recall Curves
A testing workbench to evaluate tools that calculate precision-recall curves. Saito and Rehmsmeier (2015) <doi:10.1371/journal.pone.0118432>.
Authors:
prcbench_1.1.10.tar.gz
prcbench_1.1.10.zip(r-4.7)prcbench_1.1.10.zip(r-4.6)prcbench_1.1.10.zip(r-4.5)
prcbench_1.1.10.tgz(r-4.6-x86_64)prcbench_1.1.10.tgz(r-4.6-arm64)prcbench_1.1.10.tgz(r-4.5-x86_64)prcbench_1.1.10.tgz(r-4.5-arm64)
prcbench_1.1.10.tar.gz(r-4.7-arm64)prcbench_1.1.10.tar.gz(r-4.7-x86_64)prcbench_1.1.10.tar.gz(r-4.6-arm64)prcbench_1.1.10.tar.gz(r-4.6-x86_64)
prcbench_1.1.10.tgz(r-4.6-emscripten)
manual.pdf |manual.html✨
DESCRIPTION |NEWS
card.svg |card.png
prcbench/json (API)
| # Install 'prcbench' in R: |
| install.packages('prcbench', repos = c('https://evalclass.r-universe.dev', 'https://cloud.r-project.org')) |
Bug tracker:https://github.com/evalclass/prcbench/issues
Pkgdown/docs site:https://evalclass.github.io
Datasets:
Last updated from:0274c846b5. Checks:13 OK. Indexed: yes.
| Target | Result | Time | Files | Syslog |
|---|---|---|---|---|
| linux-devel-arm64 | OK | 209 | ||
| linux-devel-x86_64 | OK | 209 | ||
| source / vignettes | OK | 164 | ||
| linux-release-arm64 | OK | 168 | ||
| linux-release-x86_64 | OK | 172 | ||
| macos-release-arm64 | OK | 220 | ||
| macos-release-x86_64 | OK | 267 | ||
| macos-oldrel-arm64 | OK | 228 | ||
| macos-oldrel-x86_64 | OK | 354 | ||
| windows-devel | OK | 194 | ||
| windows-release | OK | 158 | ||
| windows-oldrel | OK | 176 | ||
| wasm-release | OK | 133 |
Exports:autoplotcreate_example_funccreate_testsetcreate_toolsetcreate_usrdatacreate_usrtoolrun_benchmarkrun_evalcurveTestDataBTestDataCToolAUCCalculatorToolIFBaseToolPerfMeasToolprecrecToolPRROCToolROCR
Dependencies:assertthatbitopscachemcaToolsclicpp11data.tablefarverfastmapggplot2gluegplotsgridExtragtablegtoolsisobandKernSmoothlabelinglifecyclememoiseprecrecPRROCR6RColorBrewerRcpprlangROCRS7scalesvctrsviridisLitewithr
Readme and manuals
Help Manual
| Help page | Topics |
|---|---|
| Plot the result of Precision-Recall curve evaluation | autoplot autoplot.evalcurve |
| C1: Pre-calculated Precision-Recall curve | C1DATA |
| C2: Pre-calculated Precision-Recall curve | C2DATA |
| C3: Pre-calculated Precision-Recall curve | C3DATA |
| C4: Pre-calculated Precision-Recall curve | C4DATA |
| Create an example for the func argument of the create_usrtool function | create_example_func |
| Create a list of test datasets | create_testset |
| Create a set of tools | create_toolset |
| Create a user-defined test dataset | create_usrdata |
| Create a set of tools | create_usrtool |
| prcbench: A package to provide a testing workbench for precision-recall curves | prcbench-package prcbench |
| Run microbenchmark with specified tools and test sets | run_benchmark |
| Evaluate Precision-Recall curves with specified tools and test sets | run_evalcurve |
| TestDataB | TestDataB |
| TestDataC | TestDataC |
| ToolAUCCalculator | ToolAUCCalculator |
| ToolIFBase | ToolIFBase |
| ToolPerfMeas | ToolPerfMeas |
| Toolprecrec | Toolprecrec |
| ToolPRROC | ToolPRROC |
| ToolROCR | ToolROCR |
