Skip to content

Commit

Permalink
26112023
Browse files Browse the repository at this point in the history
  • Loading branch information
@pablobernabeu
pablobernabeu committed Nov 26, 2023
1 parent d4dce68 commit fdb7536
Show file tree
Hide file tree
Showing 11 changed files with 63 additions and 28 deletions.
11 changes: 8 additions & 3 deletions 2023/motivating-a-preregistration-especially-in-experimental-linguistics/index.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -633,19 +633,24 @@ <h2>The disorder</h2>
</div>
<div id="the-treatment" class="section level2">
<h2>The treatment</h2>
<p>The purpose of a preregistration is to reduce the number of researcher degrees of freedom. Yet, the best argument to motivate a preregistration may be that preregistering a study incurs no extra time. It just requires frontloading an important portion of the work. As a reward, those analyses that have been preregistered are received with greater trust by peer-reviewers and other readers. Preregistration is not perfect, but is a lesser evil that reduces the misuse of statistical analysis in science (Mertzen et al., 2021; Roettger, 2023).</p>
<p>The preregistration takes a bit of time, which poses a challenge because funding mandates often require <em>doing things</em> as soon as possible (i.e., academic capitalism). However, if any contributors of a project can gather just enough time and interest to initiate a preregistration before data collection (or before the analysis, in the case of meta-analyses and secondary-data analyes), then the researchers can attempt to pocket the important asset of preregistration for their study. They will reap the reward in time, and so will their field of research at large.</p>
<p>The number of researcher degrees of freedom, and their unforeseen influence, can be reduced a priori by publishing a preregistration before data collection begins (or before the analysis has begun, in the case of meta-analyses and secondary-data analyes). The preregistration takes a bit of time, which poses a challenge because funding systems often require <em>doing things</em> as soon and as fast as possible, driven by a questionable notion of scientific productivity.</p>
<div id="how-to-gather-the-strength" class="section level3">
<h3>How to gather the strength</h3>
<p>The best argument to motivate a preregistration may be that does not incur any extra time. It only requires frontloading an important portion of the work. This effort will be rewarded when the study is published, as preregistered analyses are received with greater trust by peer-reviewers and other readers.</p>
<p>If any contributors of a project can gather just enough time and interest to initiate a preregistration in time, the researchers can attempt to pocket this important asset for their study. They will reap the reward in time, and so will their field of research at large.</p>
</div>
<div id="what-to-do" class="section level3">
<h3>What to do</h3>
<p>Initially, rather than detailed analytical steps, it is the broader theoretical aspects that should be laid out. An abstract and an introduction should be written, describing why the study has been designed in such a way, what analyses will be performed, and what hypotheses are afforded by the literature. Next, some methodological details regarding the materials and the analyses should be added.</p>
<p>The degree of detail in the preregistration can be determined by the researchers alone. Yet, ceteris paribus, the greater the detail in a preregistration, the greater the trustworthiness of the analyses and the results. Multiple preregistration guidelines exist by now, including some field-specific ones.</p>
</div>
<div id="solace" class="section level3">
<h3>Solace</h3>
<p>Rules are made to be broken—at least as and when necessary. That is, deviations from the preregistration are possible, and indeed very frequent (Bakker et al., 2020; van den Akker et al., 2023).</p>
<p>Preregistration is not perfect, but is a lesser evil that reduces the misuse of statistical analysis in science (Mertzen et al., 2021; Roettger, 2023).</p>
<blockquote>
<p>Even the strongest blizzards start with a single snowflake. (Sara Raasch)</p>
</blockquote>
<p>Rules are made to be broken—at least as and when necessary. That is, deviations from the preregistration are possible, and indeed very frequent (Bakker et al., 2020; van den Akker et al., 2023).</p>
</div>
</div>
<div id="references" class="section level2">
Expand Down
11 changes: 8 additions & 3 deletions categories/research-methods/index.xml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -28,19 +28,24 @@
&lt;/div&gt;
&lt;div id=&#34;the-treatment&#34; class=&#34;section level2&#34;&gt;
&lt;h2&gt;The treatment&lt;/h2&gt;
&lt;p&gt;The purpose of a preregistration is to reduce the number of researcher degrees of freedom. Yet, the best argument to motivate a preregistration may be that preregistering a study incurs no extra time. It just requires frontloading an important portion of the work. As a reward, those analyses that have been preregistered are received with greater trust by peer-reviewers and other readers. Preregistration is not perfect, but is a lesser evil that reduces the misuse of statistical analysis in science (Mertzen et al., 2021; Roettger, 2023).&lt;/p&gt;
&lt;p&gt;The preregistration takes a bit of time, which poses a challenge because funding mandates often require &lt;em&gt;doing things&lt;/em&gt; as soon as possible (i.e., academic capitalism). However, if any contributors of a project can gather just enough time and interest to initiate a preregistration before data collection (or before the analysis, in the case of meta-analyses and secondary-data analyes), then the researchers can attempt to pocket the important asset of preregistration for their study. They will reap the reward in time, and so will their field of research at large.&lt;/p&gt;
&lt;p&gt;The number of researcher degrees of freedom, and their unforeseen influence, can be reduced a priori by publishing a preregistration before data collection begins (or before the analysis has begun, in the case of meta-analyses and secondary-data analyes). The preregistration takes a bit of time, which poses a challenge because funding systems often require &lt;em&gt;doing things&lt;/em&gt; as soon and as fast as possible, driven by a questionable notion of scientific productivity.&lt;/p&gt;
&lt;div id=&#34;how-to-gather-the-strength&#34; class=&#34;section level3&#34;&gt;
&lt;h3&gt;How to gather the strength&lt;/h3&gt;
&lt;p&gt;The best argument to motivate a preregistration may be that does not incur any extra time. It only requires frontloading an important portion of the work. This effort will be rewarded when the study is published, as preregistered analyses are received with greater trust by peer-reviewers and other readers.&lt;/p&gt;
&lt;p&gt;If any contributors of a project can gather just enough time and interest to initiate a preregistration in time, the researchers can attempt to pocket this important asset for their study. They will reap the reward in time, and so will their field of research at large.&lt;/p&gt;
&lt;/div&gt;
&lt;div id=&#34;what-to-do&#34; class=&#34;section level3&#34;&gt;
&lt;h3&gt;What to do&lt;/h3&gt;
&lt;p&gt;Initially, rather than detailed analytical steps, it is the broader theoretical aspects that should be laid out. An abstract and an introduction should be written, describing why the study has been designed in such a way, what analyses will be performed, and what hypotheses are afforded by the literature. Next, some methodological details regarding the materials and the analyses should be added.&lt;/p&gt;
&lt;p&gt;The degree of detail in the preregistration can be determined by the researchers alone. Yet, ceteris paribus, the greater the detail in a preregistration, the greater the trustworthiness of the analyses and the results. Multiple preregistration guidelines exist by now, including some field-specific ones.&lt;/p&gt;
&lt;/div&gt;
&lt;div id=&#34;solace&#34; class=&#34;section level3&#34;&gt;
&lt;h3&gt;Solace&lt;/h3&gt;
&lt;p&gt;Rules are made to be broken—at least as and when necessary. That is, deviations from the preregistration are possible, and indeed very frequent (Bakker et al., 2020; van den Akker et al., 2023).&lt;/p&gt;
&lt;p&gt;Preregistration is not perfect, but is a lesser evil that reduces the misuse of statistical analysis in science (Mertzen et al., 2021; Roettger, 2023).&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;Even the strongest blizzards start with a single snowflake. (Sara Raasch)&lt;/p&gt;
&lt;/blockquote&gt;
&lt;p&gt;Rules are made to be broken—at least as and when necessary. That is, deviations from the preregistration are possible, and indeed very frequent (Bakker et al., 2020; van den Akker et al., 2023).&lt;/p&gt;
&lt;/div&gt;
&lt;/div&gt;
&lt;div id=&#34;references&#34; class=&#34;section level2&#34;&gt;
Expand Down
2 changes: 1 addition & 1 deletion css/academic.css
View file

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion index.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -2381,7 +2381,7 @@ <h3 class="article-title mb-0 mt-0">

<div class="row">
<div class="col-12 col-lg-4 section-heading">
<h1>Web applications and dashboards  <span style='font-size:60%;' data-toggle='tooltip1' data-placement='bottom' title=' &nbsp; Article: The case for data dashboards &nbsp; '><a href='/2017/the-case-for-data-dashboards-first-steps-in-r-shiny/'><i class='fas fa-info-circle fa-2xs' style='color:#D4D4D4'></i></a></span></h1>
<h1>Web applications and dashboards  <span style='font-size:60%;' data-toggle='tooltip1' data-placement='bottom' title=' &nbsp; Article: The case for data dashboards &nbsp; '><a href='/2017/the-case-for-data-dashboards-first-steps-in-r-shiny/'><i class='fas fa-info-circle fa-2xs' style='color:lightgrey;'></i></a></span></h1>
<p><span style='font-size:80%;'>Articles republished on <a href="https://www.r-bloggers.com">R-bloggers</a></span></p>
</div>
<div class="col-12 col-lg-8">
Expand Down
2 changes: 1 addition & 1 deletion index.json
View file

Large diffs are not rendered by default.

11 changes: 8 additions & 3 deletions index.xml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -27,19 +27,24 @@
&lt;/div&gt;
&lt;div id=&#34;the-treatment&#34; class=&#34;section level2&#34;&gt;
&lt;h2&gt;The treatment&lt;/h2&gt;
&lt;p&gt;The purpose of a preregistration is to reduce the number of researcher degrees of freedom. Yet, the best argument to motivate a preregistration may be that preregistering a study incurs no extra time. It just requires frontloading an important portion of the work. As a reward, those analyses that have been preregistered are received with greater trust by peer-reviewers and other readers. Preregistration is not perfect, but is a lesser evil that reduces the misuse of statistical analysis in science (Mertzen et al., 2021; Roettger, 2023).&lt;/p&gt;
&lt;p&gt;The preregistration takes a bit of time, which poses a challenge because funding mandates often require &lt;em&gt;doing things&lt;/em&gt; as soon as possible (i.e., academic capitalism). However, if any contributors of a project can gather just enough time and interest to initiate a preregistration before data collection (or before the analysis, in the case of meta-analyses and secondary-data analyes), then the researchers can attempt to pocket the important asset of preregistration for their study. They will reap the reward in time, and so will their field of research at large.&lt;/p&gt;
&lt;p&gt;The number of researcher degrees of freedom, and their unforeseen influence, can be reduced a priori by publishing a preregistration before data collection begins (or before the analysis has begun, in the case of meta-analyses and secondary-data analyes). The preregistration takes a bit of time, which poses a challenge because funding systems often require &lt;em&gt;doing things&lt;/em&gt; as soon and as fast as possible, driven by a questionable notion of scientific productivity.&lt;/p&gt;
&lt;div id=&#34;how-to-gather-the-strength&#34; class=&#34;section level3&#34;&gt;
&lt;h3&gt;How to gather the strength&lt;/h3&gt;
&lt;p&gt;The best argument to motivate a preregistration may be that does not incur any extra time. It only requires frontloading an important portion of the work. This effort will be rewarded when the study is published, as preregistered analyses are received with greater trust by peer-reviewers and other readers.&lt;/p&gt;
&lt;p&gt;If any contributors of a project can gather just enough time and interest to initiate a preregistration in time, the researchers can attempt to pocket this important asset for their study. They will reap the reward in time, and so will their field of research at large.&lt;/p&gt;
&lt;/div&gt;
&lt;div id=&#34;what-to-do&#34; class=&#34;section level3&#34;&gt;
&lt;h3&gt;What to do&lt;/h3&gt;
&lt;p&gt;Initially, rather than detailed analytical steps, it is the broader theoretical aspects that should be laid out. An abstract and an introduction should be written, describing why the study has been designed in such a way, what analyses will be performed, and what hypotheses are afforded by the literature. Next, some methodological details regarding the materials and the analyses should be added.&lt;/p&gt;
&lt;p&gt;The degree of detail in the preregistration can be determined by the researchers alone. Yet, ceteris paribus, the greater the detail in a preregistration, the greater the trustworthiness of the analyses and the results. Multiple preregistration guidelines exist by now, including some field-specific ones.&lt;/p&gt;
&lt;/div&gt;
&lt;div id=&#34;solace&#34; class=&#34;section level3&#34;&gt;
&lt;h3&gt;Solace&lt;/h3&gt;
&lt;p&gt;Rules are made to be broken—at least as and when necessary. That is, deviations from the preregistration are possible, and indeed very frequent (Bakker et al., 2020; van den Akker et al., 2023).&lt;/p&gt;
&lt;p&gt;Preregistration is not perfect, but is a lesser evil that reduces the misuse of statistical analysis in science (Mertzen et al., 2021; Roettger, 2023).&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;Even the strongest blizzards start with a single snowflake. (Sara Raasch)&lt;/p&gt;
&lt;/blockquote&gt;
&lt;p&gt;Rules are made to be broken—at least as and when necessary. That is, deviations from the preregistration are possible, and indeed very frequent (Bakker et al., 2020; van den Akker et al., 2023).&lt;/p&gt;
&lt;/div&gt;
&lt;/div&gt;
&lt;div id=&#34;references&#34; class=&#34;section level2&#34;&gt;
Expand Down
8 changes: 4 additions & 4 deletions sitemap.xml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -33,12 +33,12 @@
</url>

<url>
<loc>https://pablobernabeu.github.io/tags/research-methods/</loc>
<loc>https://pablobernabeu.github.io/categories/research-methods/</loc>
<lastmod>2023-11-24T00:00:00+00:00</lastmod>
</url>

<url>
<loc>https://pablobernabeu.github.io/categories/research-methods/</loc>
<loc>https://pablobernabeu.github.io/tags/research-methods/</loc>
<lastmod>2023-11-24T00:00:00+00:00</lastmod>
</url>

Expand Down Expand Up @@ -833,12 +833,12 @@
</url>

<url>
<loc>https://pablobernabeu.github.io/categories/open-science/</loc>
<loc>https://pablobernabeu.github.io/tags/open-science/</loc>
<lastmod>2021-05-14T00:00:00+00:00</lastmod>
</url>

<url>
<loc>https://pablobernabeu.github.io/tags/open-science/</loc>
<loc>https://pablobernabeu.github.io/categories/open-science/</loc>
<lastmod>2021-05-14T00:00:00+00:00</lastmod>
</url>

Expand Down
11 changes: 8 additions & 3 deletions tags/prereg/index.xml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -27,19 +27,24 @@
&lt;/div&gt;
&lt;div id=&#34;the-treatment&#34; class=&#34;section level2&#34;&gt;
&lt;h2&gt;The treatment&lt;/h2&gt;
&lt;p&gt;The purpose of a preregistration is to reduce the number of researcher degrees of freedom. Yet, the best argument to motivate a preregistration may be that preregistering a study incurs no extra time. It just requires frontloading an important portion of the work. As a reward, those analyses that have been preregistered are received with greater trust by peer-reviewers and other readers. Preregistration is not perfect, but is a lesser evil that reduces the misuse of statistical analysis in science (Mertzen et al., 2021; Roettger, 2023).&lt;/p&gt;
&lt;p&gt;The preregistration takes a bit of time, which poses a challenge because funding mandates often require &lt;em&gt;doing things&lt;/em&gt; as soon as possible (i.e., academic capitalism). However, if any contributors of a project can gather just enough time and interest to initiate a preregistration before data collection (or before the analysis, in the case of meta-analyses and secondary-data analyes), then the researchers can attempt to pocket the important asset of preregistration for their study. They will reap the reward in time, and so will their field of research at large.&lt;/p&gt;
&lt;p&gt;The number of researcher degrees of freedom, and their unforeseen influence, can be reduced a priori by publishing a preregistration before data collection begins (or before the analysis has begun, in the case of meta-analyses and secondary-data analyes). The preregistration takes a bit of time, which poses a challenge because funding systems often require &lt;em&gt;doing things&lt;/em&gt; as soon and as fast as possible, driven by a questionable notion of scientific productivity.&lt;/p&gt;
&lt;div id=&#34;how-to-gather-the-strength&#34; class=&#34;section level3&#34;&gt;
&lt;h3&gt;How to gather the strength&lt;/h3&gt;
&lt;p&gt;The best argument to motivate a preregistration may be that does not incur any extra time. It only requires frontloading an important portion of the work. This effort will be rewarded when the study is published, as preregistered analyses are received with greater trust by peer-reviewers and other readers.&lt;/p&gt;
&lt;p&gt;If any contributors of a project can gather just enough time and interest to initiate a preregistration in time, the researchers can attempt to pocket this important asset for their study. They will reap the reward in time, and so will their field of research at large.&lt;/p&gt;
&lt;/div&gt;
&lt;div id=&#34;what-to-do&#34; class=&#34;section level3&#34;&gt;
&lt;h3&gt;What to do&lt;/h3&gt;
&lt;p&gt;Initially, rather than detailed analytical steps, it is the broader theoretical aspects that should be laid out. An abstract and an introduction should be written, describing why the study has been designed in such a way, what analyses will be performed, and what hypotheses are afforded by the literature. Next, some methodological details regarding the materials and the analyses should be added.&lt;/p&gt;
&lt;p&gt;The degree of detail in the preregistration can be determined by the researchers alone. Yet, ceteris paribus, the greater the detail in a preregistration, the greater the trustworthiness of the analyses and the results. Multiple preregistration guidelines exist by now, including some field-specific ones.&lt;/p&gt;
&lt;/div&gt;
&lt;div id=&#34;solace&#34; class=&#34;section level3&#34;&gt;
&lt;h3&gt;Solace&lt;/h3&gt;
&lt;p&gt;Rules are made to be broken—at least as and when necessary. That is, deviations from the preregistration are possible, and indeed very frequent (Bakker et al., 2020; van den Akker et al., 2023).&lt;/p&gt;
&lt;p&gt;Preregistration is not perfect, but is a lesser evil that reduces the misuse of statistical analysis in science (Mertzen et al., 2021; Roettger, 2023).&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;Even the strongest blizzards start with a single snowflake. (Sara Raasch)&lt;/p&gt;
&lt;/blockquote&gt;
&lt;p&gt;Rules are made to be broken—at least as and when necessary. That is, deviations from the preregistration are possible, and indeed very frequent (Bakker et al., 2020; van den Akker et al., 2023).&lt;/p&gt;
&lt;/div&gt;
&lt;/div&gt;
&lt;div id=&#34;references&#34; class=&#34;section level2&#34;&gt;
Expand Down
Loading

0 comments on commit fdb7536

Please sign in to comment.