Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

update stat-software parts of site #229

Merged
merged 5 commits into from
Jul 7, 2021
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion content/software-review/_index.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,6 @@ title = "rOpenSci Software Peer Review"
description = "rOpenSci's open peer-review system of R packages"
+++

rOpenSci's [suite of packages](/packages/) is comprised of contributions from staff engineers and the wider R community, bringing considerable diversity of skills, expertise and experience to bear on the suite. How do we ensure that every package is held to a high standard? That's where our software review system comes into play: packages contributed by the community undergo a **transparent, constructive, non adversarial and open review process**. For that process relying mostly on **volunteer work**, _[associate editors](#editors)_ manage the incoming flow and ensure progress of submissions; _authors_ create, submit and improve their package; *[reviewers](https://devguide.ropensci.org/softwarereviewintro.html#reviewers)*, two per submission, examine the software code and user experience. Our system current accepts software from a variety of broadly-defined categories, with a [new project](/blog/2019/07/15/expanding-software-review/) underway to expand the software review system to include specifically [statistical software](/stat-software-review).
rOpenSci's [suite of packages](/packages/) is comprised of contributions from staff engineers and the wider R community, bringing considerable diversity of skills, expertise and experience to bear on the suite. How do we ensure that every package is held to a high standard? That's where our software review system comes into play: packages contributed by the community undergo a **transparent, constructive, non adversarial and open review process**. For that process relying mostly on **volunteer work**, _[associate editors](#editors)_ manage the incoming flow and ensure progress of submissions; _authors_ create, submit and improve their package; *[reviewers](https://devguide.ropensci.org/softwarereviewintro.html#reviewers)*, two per submission, examine the software code and user experience. Our system current accepts software from a variety of broadly-defined categories, including our [new system](/blog/2019/07/15/expanding-software-review/) for peer review of [statistical software](/stat-software-review).

Technically, we make the most of [GitHub](https://github.com/) infrastructure: each package software peer review process is an issue in the [ropensci/software-review GitHub repository](https://github.com/ropensci/software-review/). For instance, read [the software peer review thread of the `ropenaq` package](https://github.com/ropensci/software-review/issues/24): the process is an ongoing conversation until acceptance of the package, with two external reviews as important milestones. Furthermore, we use GitHub features such as the use of issue templates (as submission templates), and labelling which we use to track progress of submissions (from editor checks to approval).
20 changes: 11 additions & 9 deletions content/stat-software-review/_index.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,21 +3,23 @@ title = "rOpenSci Statistical Software Peer Review"
description = "rOpenSci's open peer-review system of R statistical packages"
+++

rOpenSci is currently working to expand our peer review system beyond its current scope to explicitly review packages that implement statistical algorithms. This requires an expansion of our editor and reviewer community to bring in new expertise, and new sets of standards and approaches to deal with the particular challenges of statistical methods. We aim to initially include packages from the following 11 categories:
We have expanded our peer review system include packages that implement statistical algorithms. To accommodate these packages, we have developed a new set of standards specific to statistical packages, expanded our editorial board to bring in additional expertise, and developed tools to support authors and reviewers in testing and examining code. We are currently accepting submission of packages in the following 7 categories of statistical software:

1. Bayesian and Monte Carlo Routines
2. Dimensionality Reduction, Clustering, and Unsupervised Learning
3. Machine Learning
4. Regression and Supervised Learning
5. Probability Distributions
6. Wrapper Packages
7. Networks
8. Exploratory Data Analysis (EDA) and Summary Statistics
9. Workflow Support
10. Spatial Analyses
11. Time Series Analyses
5. Exploratory Data Analysis (EDA) and Summary Statistics
6. Spatial Analyses
7. Time Series Analyses

We aim to expand the system to include the following four additional categories:

Our process to develop these standards is primarily documented and organised through our online ["living document"](https://ropenscilabs.github.io/statistical-software-review-book/index.html). We anticipate the system being ready for initial submissions early in 2021. Until then, we welcome any enquiries from anyone interested in engaging with the system, including developers who might be interested in pre-submission enquiries. Please contribute via our [discussion forum](https://discuss.ropensci.org/c/statistical-software-peer-review/28), or contact Mark Padgham (mark@ropensci.org).
8. Probability Distributions
9. Wrapper Packages
10. Networks
11. Workflow Support

Full details of procedures for preparing and submitting statistical packages for peer review are containing in our ["*Statistical Software Peer Review*" book](https://stats-devguide.ropensci.org/index.html). The system is currently in its trial phase. We ask that authors considering submission of a statistical package first via open a [pre-submission inquiry](https://github.com/ropensci/software-review/issues/new?assignees=&labels=&template=B-submit-a-presubmission-inquiry.md). Those with questions and inquiries are welcome to contact the statistical software team (Mark Padgham, mark<at>ropensci.org, and Noam Ross, ross<at>ecohealthalliance.org).

This work is supported through a [grant from the Alfred P. Sloan Foundation](/blog/2019/07/15/expanding-software-review/).
9 changes: 7 additions & 2 deletions data/resources/statsoftwarereview.json
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
[
{
"title": "Online book",
"text": "Living document for the project",
"url": "https://ropenscilabs.github.io/statistical-software-review-book/"
"text": "rOpenSci Statistical Software Peer Review",
"url": "https://stats-devguide.ropensci.org"
},
{
"title": "Discussion of our standards and process",
Expand All @@ -13,5 +13,10 @@
"title": "Context",
"text": "Posts related to the project",
"url": "/tags/statistical-software"
},
{
"title": "Volunteer",
"text": "Volunteering form for software reviewers including for statistical software.",
"url": "https://airtable.com/shrnfDI2S9uuyxtDw"
}
]
2 changes: 1 addition & 1 deletion themes/ropensci/layouts/partials/skeleton/navbar.html
Original file line number Diff line number Diff line change
Expand Up @@ -44,7 +44,7 @@
<ul class="sub-menu">
<li><a href="/r-universe/">The R-universe system</a></li>
<li><a href="/software-review">Software Peer Review</a></li>
<li><a href="/stat-software-review/">Statistical Software Project</a></li>
<li><a href="/stat-software-review/">Statistical Software Peer Review</a></li>
</ul>
</li>

Expand Down