What is the right Bonferroni adjustment?All vs all post-hoc after Aligned Friedman (k classifiers over multiple datasets)Appropriate non-parametric post-hoc test for baseline comparisons?Bonferroni adjustment according to which families?Friedman's test is very significant, but its post hoc comparisons (SPSS) are not significantSome new questions re the Bonferroni correctionHow many comparisons should I use when applying the Bonferroni Correction?Level of Bonferroni Correction for Post-hoc Wilcoxon Signed RankBonferroni correction vs Adjusted Bonferroni p valueBonferroni correction for Wilcoxon signed rank test with 6 related samples?Bonferroni for Wilcoxon signed rank?
Problem with GFCI at start of circuit with both lights and two receptacles
Is this "Faetouched" homebrew race balanced?
Number of matrices with bounded products of rows and columns
What's a good pattern to calculate a variable only when it is used the first time?
If I am sleeping clutching on to something, how easy is it to steal that item?
Can I use images from my published papers in my thesis without copyright infringment?
Why should P.I be willing to write strong LOR even if that means losing a undergraduate from his/her lab?
Photoshop older default brushes
Can anybody tell me who this Pokemon is?
How could Tony Stark wield the Infinity Nano Gauntlet - at all?
Short Story: Cold War setting. In orbit, two astronauts decide whether to launch nuclear counter strike ("MAD" scenario). Twist at end
What happened after the end of the Truman Show?
Did Michelle Obama have a staff of 23; and Melania have a staff of 4?
"I like watching" vs "I like to watch" What's the difference?
Heyawacky: Ace of Cups
Why don't modern jet engines use forced exhaust mixing?
Trying to understand how Digital Certificates and CA are indeed secure
Units of measurement, especially length, when body parts vary in size among races
How to prevent criminal gangs from making/buying guns?
Adding things to bunches of things vs multiplication
Why should I pay for an SSL certificate?
Subgroup generated by a subgroup and a conjugate of it
Have made several mistakes during the course of my PhD. Can't help but feel resentment. Can I get some advice about how to move forward?
Yes/ No : The sum of two ideals of a ring R is an ideal of R
What is the right Bonferroni adjustment?
All vs all post-hoc after Aligned Friedman (k classifiers over multiple datasets)Appropriate non-parametric post-hoc test for baseline comparisons?Bonferroni adjustment according to which families?Friedman's test is very significant, but its post hoc comparisons (SPSS) are not significantSome new questions re the Bonferroni correctionHow many comparisons should I use when applying the Bonferroni Correction?Level of Bonferroni Correction for Post-hoc Wilcoxon Signed RankBonferroni correction vs Adjusted Bonferroni p valueBonferroni correction for Wilcoxon signed rank test with 6 related samples?Bonferroni for Wilcoxon signed rank?
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;
$begingroup$
I am trying to test a hypothesis for my Masters Thesis.
There are 3 conditions (I will name them X, Y, Z), in each of which the data isn't normally distributed, and measures the improvement for each condition. I ran a Friedman test as a repeated measure, and in post-hoc I ran a Wilcoxon test with the Bonferroni adjustment.
My problem is that I want to compare only X vs Y and X vs Z (and not Y vs Z).
My question is this: for the Bonferroni correction do I need to divide by 2 or 3?
On one hand, there are 3 comparisons done in the SPSS test, but on the other I'm only interested in 2 of them.
Does this even count as a repeated measure?
Thank you!
hypothesis-testing repeated-measures nonparametric bonferroni friedman-test
asked Aug 5 at 18:07
IzzyIzzy
211 bronze badge
$endgroup$
add a comment |
$begingroup$
I am trying to test a hypothesis for my Masters Thesis.
There are 3 conditions (I will name them X, Y, Z), in each of which the data isn't normally distributed, and measures the improvement for each condition. I ran a Friedman test as a repeated measure, and in post-hoc I ran a Wilcoxon test with the Bonferroni adjustment.
My problem is that I want to compare only X vs Y and X vs Z (and not Y vs Z).
My question is this: for the Bonferroni correction do I need to divide by 2 or 3?
On one hand, there are 3 comparisons done in the SPSS test, but on the other I'm only interested in 2 of them.
Does this even count as a repeated measure?
Thank you!
hypothesis-testing repeated-measures nonparametric bonferroni friedman-test
asked Aug 5 at 18:07
IzzyIzzy
211 bronze badge
$endgroup$
$begingroup$
We need more information for the "repeated measure" part of the question. Is this one group of subjects measured three times, or three different groups of subjects each measured once?
$endgroup$
– TPM
Aug 5 at 18:22
1
$begingroup$
Note that "repeated measure" has a technical meaning in statistics, representing multiple measurements on the same individual under different conditions or over time. I think that what you're asking about is really multiple comparisons. If I'm correct, please change the tag and edit your question so that future visitors to this page won't be confused. If there is a repeated measures issue, please address the comment from @TPM.
$endgroup$
– EdM
Aug 5 at 18:31
$begingroup$
@TPM This is one group of subjects. They each go through all 3 treatments (conditions) on different sessions, and are measured each time.
$endgroup$
– Izzy
Aug 7 at 7:57
add a comment |
$begingroup$
I am trying to test a hypothesis for my Masters Thesis.
There are 3 conditions (I will name them X, Y, Z), in each of which the data isn't normally distributed, and measures the improvement for each condition. I ran a Friedman test as a repeated measure, and in post-hoc I ran a Wilcoxon test with the Bonferroni adjustment.
My problem is that I want to compare only X vs Y and X vs Z (and not Y vs Z).
My question is this: for the Bonferroni correction do I need to divide by 2 or 3?
On one hand, there are 3 comparisons done in the SPSS test, but on the other I'm only interested in 2 of them.
Does this even count as a repeated measure?
Thank you!
hypothesis-testing repeated-measures nonparametric bonferroni friedman-test
asked Aug 5 at 18:07
IzzyIzzy
211 bronze badge
$endgroup$
I am trying to test a hypothesis for my Masters Thesis.
There are 3 conditions (I will name them X, Y, Z), in each of which the data isn't normally distributed, and measures the improvement for each condition. I ran a Friedman test as a repeated measure, and in post-hoc I ran a Wilcoxon test with the Bonferroni adjustment.
My problem is that I want to compare only X vs Y and X vs Z (and not Y vs Z).
My question is this: for the Bonferroni correction do I need to divide by 2 or 3?
On one hand, there are 3 comparisons done in the SPSS test, but on the other I'm only interested in 2 of them.
Does this even count as a repeated measure?
Thank you!
hypothesis-testing repeated-measures nonparametric bonferroni friedman-test
hypothesis-testing repeated-measures nonparametric bonferroni friedman-test
asked Aug 5 at 18:07
IzzyIzzy
211 bronze badge
asked Aug 5 at 18:07
IzzyIzzy
211 bronze badge
asked Aug 5 at 18:07
IzzyIzzy
211 bronze badge
asked Aug 5 at 18:07
IzzyIzzy
211 bronze badge
asked Aug 5 at 18:07
IzzyIzzy
211 bronze badge
211 bronze badge
$begingroup$
We need more information for the "repeated measure" part of the question. Is this one group of subjects measured three times, or three different groups of subjects each measured once?
$endgroup$
– TPM
Aug 5 at 18:22
1
$begingroup$
Note that "repeated measure" has a technical meaning in statistics, representing multiple measurements on the same individual under different conditions or over time. I think that what you're asking about is really multiple comparisons. If I'm correct, please change the tag and edit your question so that future visitors to this page won't be confused. If there is a repeated measures issue, please address the comment from @TPM.
$endgroup$
– EdM
Aug 5 at 18:31
$begingroup$
@TPM This is one group of subjects. They each go through all 3 treatments (conditions) on different sessions, and are measured each time.
$endgroup$
– Izzy
Aug 7 at 7:57
add a comment |
$begingroup$
We need more information for the "repeated measure" part of the question. Is this one group of subjects measured three times, or three different groups of subjects each measured once?
$endgroup$
– TPM
Aug 5 at 18:22
1
$begingroup$
Note that "repeated measure" has a technical meaning in statistics, representing multiple measurements on the same individual under different conditions or over time. I think that what you're asking about is really multiple comparisons. If I'm correct, please change the tag and edit your question so that future visitors to this page won't be confused. If there is a repeated measures issue, please address the comment from @TPM.
$endgroup$
– EdM
Aug 5 at 18:31
$begingroup$
@TPM This is one group of subjects. They each go through all 3 treatments (conditions) on different sessions, and are measured each time.
$endgroup$
– Izzy
Aug 7 at 7:57
$begingroup$
We need more information for the "repeated measure" part of the question. Is this one group of subjects measured three times, or three different groups of subjects each measured once?
$endgroup$
– TPM
Aug 5 at 18:22
$begingroup$
We need more information for the "repeated measure" part of the question. Is this one group of subjects measured three times, or three different groups of subjects each measured once?
$endgroup$
– TPM
Aug 5 at 18:22
1
1
$begingroup$
Note that "repeated measure" has a technical meaning in statistics, representing multiple measurements on the same individual under different conditions or over time. I think that what you're asking about is really multiple comparisons. If I'm correct, please change the tag and edit your question so that future visitors to this page won't be confused. If there is a repeated measures issue, please address the comment from @TPM.
$endgroup$
– EdM
Aug 5 at 18:31
$begingroup$
Note that "repeated measure" has a technical meaning in statistics, representing multiple measurements on the same individual under different conditions or over time. I think that what you're asking about is really multiple comparisons. If I'm correct, please change the tag and edit your question so that future visitors to this page won't be confused. If there is a repeated measures issue, please address the comment from @TPM.
$endgroup$
– EdM
Aug 5 at 18:31
$begingroup$
@TPM This is one group of subjects. They each go through all 3 treatments (conditions) on different sessions, and are measured each time.
$endgroup$
– Izzy
Aug 7 at 7:57
$begingroup$
@TPM This is one group of subjects. They each go through all 3 treatments (conditions) on different sessions, and are measured each time.
$endgroup$
– Izzy
Aug 7 at 7:57
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
To the best of my knowledge, the Bonferroni correction is based on the number of tests you actually perform, not on the total number of pairwise tests that you could perform. So if you set out to perform two pairwise comparisons, you should divide by two.
answered Aug 5 at 18:17
ZombiePlan37ZombiePlan37
1109 bronze badges
$endgroup$
1
$begingroup$
This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
$endgroup$
– Dave
Aug 5 at 18:27
$begingroup$
Also you should make sure it is Bonferroni (or Holm) you are interested and want to control family-wise error rate (FWER) rather than BHY (Benjamini-Hochberg-Yakutieli) which controls false discovery rate (FDR).
$endgroup$
– Nick Firoozye
2 days ago
add a comment |
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "65"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f420727%2fwhat-is-the-right-bonferroni-adjustment%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
To the best of my knowledge, the Bonferroni correction is based on the number of tests you actually perform, not on the total number of pairwise tests that you could perform. So if you set out to perform two pairwise comparisons, you should divide by two.
answered Aug 5 at 18:17
ZombiePlan37ZombiePlan37
1109 bronze badges
$endgroup$
1
$begingroup$
This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
$endgroup$
– Dave
Aug 5 at 18:27
$begingroup$
Also you should make sure it is Bonferroni (or Holm) you are interested and want to control family-wise error rate (FWER) rather than BHY (Benjamini-Hochberg-Yakutieli) which controls false discovery rate (FDR).
$endgroup$
– Nick Firoozye
2 days ago
add a comment |
$begingroup$
To the best of my knowledge, the Bonferroni correction is based on the number of tests you actually perform, not on the total number of pairwise tests that you could perform. So if you set out to perform two pairwise comparisons, you should divide by two.
answered Aug 5 at 18:17
ZombiePlan37ZombiePlan37
1109 bronze badges
$endgroup$
1
$begingroup$
This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
$endgroup$
– Dave
Aug 5 at 18:27
$begingroup$
Also you should make sure it is Bonferroni (or Holm) you are interested and want to control family-wise error rate (FWER) rather than BHY (Benjamini-Hochberg-Yakutieli) which controls false discovery rate (FDR).
$endgroup$
– Nick Firoozye
2 days ago
add a comment |
$begingroup$
To the best of my knowledge, the Bonferroni correction is based on the number of tests you actually perform, not on the total number of pairwise tests that you could perform. So if you set out to perform two pairwise comparisons, you should divide by two.
answered Aug 5 at 18:17
ZombiePlan37ZombiePlan37
1109 bronze badges
$endgroup$
To the best of my knowledge, the Bonferroni correction is based on the number of tests you actually perform, not on the total number of pairwise tests that you could perform. So if you set out to perform two pairwise comparisons, you should divide by two.
answered Aug 5 at 18:17
ZombiePlan37ZombiePlan37
1109 bronze badges
answered Aug 5 at 18:17
ZombiePlan37ZombiePlan37
1109 bronze badges
answered Aug 5 at 18:17
ZombiePlan37ZombiePlan37
1109 bronze badges
answered Aug 5 at 18:17
ZombiePlan37ZombiePlan37
1109 bronze badges
1109 bronze badges
1
$begingroup$
This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
$endgroup$
– Dave
Aug 5 at 18:27
$begingroup$
Also you should make sure it is Bonferroni (or Holm) you are interested and want to control family-wise error rate (FWER) rather than BHY (Benjamini-Hochberg-Yakutieli) which controls false discovery rate (FDR).
$endgroup$
– Nick Firoozye
2 days ago
add a comment |
1
$begingroup$
This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
$endgroup$
– Dave
Aug 5 at 18:27
$begingroup$
Also you should make sure it is Bonferroni (or Holm) you are interested and want to control family-wise error rate (FWER) rather than BHY (Benjamini-Hochberg-Yakutieli) which controls false discovery rate (FDR).
$endgroup$
– Nick Firoozye
2 days ago
1
1
$begingroup$
This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
$endgroup$
– Dave
Aug 5 at 18:27
$begingroup$
This is correct. One point to consider is that if the p-value for the YZ comparison turns out to be significant, it still shouldn't be considered significant. It should be as if you never calculated that p-value, since its calculation is just a matter of the software doing it by default (and this most likely can be changed).
$endgroup$
– Dave
Aug 5 at 18:27
$begingroup$
Also you should make sure it is Bonferroni (or Holm) you are interested and want to control family-wise error rate (FWER) rather than BHY (Benjamini-Hochberg-Yakutieli) which controls false discovery rate (FDR).
$endgroup$
– Nick Firoozye
2 days ago
$begingroup$
Also you should make sure it is Bonferroni (or Holm) you are interested and want to control family-wise error rate (FWER) rather than BHY (Benjamini-Hochberg-Yakutieli) which controls false discovery rate (FDR).
$endgroup$
– Nick Firoozye
2 days ago
add a comment |
Thanks for contributing an answer to Cross Validated!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f420727%2fwhat-is-the-right-bonferroni-adjustment%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
$begingroup$
We need more information for the "repeated measure" part of the question. Is this one group of subjects measured three times, or three different groups of subjects each measured once?
$endgroup$
– TPM
Aug 5 at 18:22
1
$begingroup$
Note that "repeated measure" has a technical meaning in statistics, representing multiple measurements on the same individual under different conditions or over time. I think that what you're asking about is really multiple comparisons. If I'm correct, please change the tag and edit your question so that future visitors to this page won't be confused. If there is a repeated measures issue, please address the comment from @TPM.
$endgroup$
– EdM
Aug 5 at 18:31
$begingroup$
@TPM This is one group of subjects. They each go through all 3 treatments (conditions) on different sessions, and are measured each time.
$endgroup$
– Izzy
Aug 7 at 7:57