This book explains the concepts of p-value and hypothesis testing brilliantly. You should read this book too.
- Null hypothesis ⇒ questions scientist want to nullify.
- Example: = "The world is flat."
- Alternate hypothesis: "The world is round."
- In order to change an opinion, we first prove it wrong!
- Small p-value ⇒ reject null hypothesis!
- Mostly, we need (statistical significance) to reject a null hypothesis.
- Smaller , we are more sure!
- Example: "Gender IS NOT linked to pet preference (cat/dog)." With , we reject that hypothesis and conclude "Gender IS linked to pet preference. (ref)
- If , it means that there are the null hypothesis is true! We cannot reject it!
In order to calculate p-value, we use Chi-Square Test ( test).
- This test only works for categorical data (men, women), not numerical data (height, weight).
- The number of entries must be large enough.
- The goal of multiple comparisons corrections is to reduce the number of false positives, because false positives can be embarrassing, confusing, and cause you and other people to waste your time.
- The conclusion from p-value depends much on signigicance (usually ). What if we wanna test multiple tests simultaneously? The same for all cases?
- Dealing with multiple testing → adjusting .
- Math is fun -- Chi-Square Test.