forked from eggy/eifueo
Compare commits
3 Commits
master
...
math-stati
Author | SHA1 | Date | |
---|---|---|---|
7a168dac62 | |||
de940be05e | |||
d060ad4322 |
136
docs/mhf4u7.md
136
docs/mhf4u7.md
@ -5,16 +5,150 @@ The course code for this page is **MHF4U7**.
|
|||||||
## 4 - Statistics and probability
|
## 4 - Statistics and probability
|
||||||
|
|
||||||
!!! note "Definition"
|
!!! note "Definition"
|
||||||
- **Descriptive statistics:** The use of methods to organise, display, and describe data by using various charts and summary methods to reduce data to a manageable size.
|
- **Statistics:** The techniques and procedures to analyse, interpret, display, and make decisions based on data.
|
||||||
|
- **Descriptive statistics:** The use of methods to work with and describe the **entire** data set.
|
||||||
- **Inferential statistics:** The use of samples to make judgements about a population.
|
- **Inferential statistics:** The use of samples to make judgements about a population.
|
||||||
- **Data set:** A collection of data with elements and observations, typically in the form of a table. It is similar to a map or dictionary in programming.
|
- **Data set:** A collection of data with elements and observations, typically in the form of a table. It is similar to a map or dictionary in programming.
|
||||||
- **Element:** The name of an observation(s), similar to a key to a map/dictionary in programming.
|
- **Element:** The name of an observation(s), similar to a key to a map/dictionary in programming.
|
||||||
- **Observation:** The collected data linked to an element, similar to a value to a map/dictionary in programming.
|
- **Observation:** The collected data linked to an element, similar to a value to a map/dictionary in programming.
|
||||||
|
- **Population**: A collection of all elements of interest within a data set.
|
||||||
|
- **Sample**: The selection of a few elements within a population to represent that population.
|
||||||
- **Raw data:** Data collected prior to processing or ranking.
|
- **Raw data:** Data collected prior to processing or ranking.
|
||||||
|
|
||||||
|
### Sampling
|
||||||
|
|
||||||
|
A good sample:
|
||||||
|
|
||||||
|
- represents the relevant features of the full population,
|
||||||
|
- is as large as reasonably possible so that it decently represents the full population,
|
||||||
|
- and is random.
|
||||||
|
|
||||||
|
The types of random sampling include:
|
||||||
|
|
||||||
|
- **Simple**: Choosing a sample completely randomly.
|
||||||
|
- **Convenience**: Choosing a sample based on ease of access to the data.
|
||||||
|
- **Systematic**: Choosing a random starting point, then choosing the rest of the sample at a consistent interval in a list.
|
||||||
|
- **Quota**: Choosing a sample whose members have specific characteristics.
|
||||||
|
- **Stratified**: Choosing a sample so that the proportion of specific characteristics matches that of the population.
|
||||||
|
|
||||||
|
??? example
|
||||||
|
- Simple: Using a random number generator to pick items from a list.
|
||||||
|
- Convenience: Asking the first 20 people met to answer a survey,
|
||||||
|
- Systematic: Rolling a die and getting a 6, so choosing the 6th element and every 10th element after that.
|
||||||
|
- Quota: Ensuring that all members of the sample all wear red jackets.
|
||||||
|
- Stratified: The population is 45% male and 55% female, so the proportion of the sample is also 45% male and 55% female.
|
||||||
|
|
||||||
|
### Types of data
|
||||||
|
|
||||||
|
!!! note "Definition"
|
||||||
|
- **Quantitative variable**: A variable that is numerical and can be sorted.
|
||||||
|
- **Discrete variable**: A quantitative variable that is countable.
|
||||||
|
- **Continuous variable**: A quantitative variable that can contain an infinite number of values between any two values.
|
||||||
|
- **Qualitative variable**: A variable that is not numerical and cannot be sorted.
|
||||||
|
- **Bias**: An unfair influence in data during the collection process, causing the data to be not truly representative of the population.
|
||||||
|
|
||||||
### Frequency distribution
|
### Frequency distribution
|
||||||
|
|
||||||
|
A **frequency distribution** is a table that lists categories/ranges and the number of values in each category/range.
|
||||||
|
|
||||||
|
A frequency distribution table includes:
|
||||||
|
|
||||||
|
- A number of classes, all of the same width.
|
||||||
|
- This number is arbitrarily chosen, but a commonly used formula is $\lceil\sqrt{\text{# of elements}}\rceil$.
|
||||||
|
- The width (size) of each class is $\lceil\frac{\text{max value} - \text{min value}}{\text{number of classes}}\rceil$.
|
||||||
|
- Each class includes its lower bound and excludes its upper bound ($\text{lower} ≤ x < \text{upper}$)
|
||||||
|
- The **relative frequency** of a data set is the percentage of the whole data set present in that class in decimal form.
|
||||||
|
- The number of values that fall under each class.
|
||||||
|
- The largest value can either be included in the final class (changing its range to $\text{lower} ≤ x ≤ \text{highest}$), or put in a completely new class above the largest class.
|
||||||
|
|
||||||
|
??? example
|
||||||
|
| Height $x$ (cm) | Frequency |
|
||||||
|
| --- | --- |
|
||||||
|
| $1≤x<5$ | 2 |
|
||||||
|
| $5≤x<9$ | 3 |
|
||||||
|
| $9≤x≤14$ | 1 |
|
||||||
|
|
||||||
|
For a given class $i$, the midpoint of that class is as follows:
|
||||||
|
$$x_{i} = \frac{\text{lower bound} + \text{upper bound}}{2}$$
|
||||||
|
|
||||||
|
### Quartiles
|
||||||
|
|
||||||
|
A **percentile** is a value indicates the percentage of a data set that is below it. To find the location of a given percentile, $P_k = \frac{kn}{100}$, where $k$ denotes the percentile number and $n$ represents the sample size.
|
||||||
|
|
||||||
|
A **decile** indicates that $n×10$% of data in the data set is below it.
|
||||||
|
|
||||||
|
!!! example
|
||||||
|
A score equal to or greater than 97% of all scores in a test is said to be in the *97th percentile*, or in the *9th decile*.
|
||||||
|
|
||||||
|
Quartiles split a data set into four equal sections.
|
||||||
|
|
||||||
|
- The **minimum** is the lowest value of a data set.
|
||||||
|
- The **first quartile** ($Q_1$) is at the 25th percentile.
|
||||||
|
- The **median** is at the 50th percentile.
|
||||||
|
- The **third quartile** ($Q_3$) is at the 75th percentile.
|
||||||
|
- The **maximum** is the highest value of a data set.
|
||||||
|
|
||||||
|
The first and third quartiles are the median of the **[minimum, median)** and **(median, maximum]** respectively.
|
||||||
|
|
||||||
|
!!! warning
|
||||||
|
When the median is equal to a data point in a set, it *cannot* be used to find $Q_1$ or $Q_3$. Only use the data below or above the median.
|
||||||
|
|
||||||
|
!!! warning
|
||||||
|
When working with grouped data given in ranges, the actual data is unavailable. The five numbers above are instead:
|
||||||
|
|
||||||
|
- The minimum value is now the lower class boundary of the lowest class.
|
||||||
|
- The first quartile is the midpoint of the class it resides in.
|
||||||
|
- The median is the midpoint of the class it resides in.
|
||||||
|
- The third quartile is the midpoint of the class it resides in.
|
||||||
|
- The maximum value is now the upper class boundary of the highest class. If the highest value is excluded (e.g., $90≤x<100$), it also must be excluded when representing data (e.g., open dot instead of filled dot).
|
||||||
|
|
||||||
|
The **interquartile range (IQR)** is equal to $Q_3 - Q_1$ and represents the range where 50% of the data lies.
|
||||||
|
|
||||||
|
### Outliers
|
||||||
|
|
||||||
|
Outliers are data values that significantly differ from the rest of the data set. They may be because of:
|
||||||
|
|
||||||
|
- a random natural occurrence, or
|
||||||
|
- abnormal circumstances
|
||||||
|
|
||||||
|
Outliers can be ignored once identified.
|
||||||
|
|
||||||
|
There are various methods to identify outliers. For **single-variable** data sets, the **lower and upper fences** may be used. Any data below the lower fence or above the upper fence can be considered outliers.
|
||||||
|
|
||||||
|
- The lower fence is equal to $Q_1 - 1.5×\text{IQR}$
|
||||||
|
- The upper fence is equal to $Q_3 + 1.5×\text{IQR}$
|
||||||
|
|
||||||
|
### Representing frequency
|
||||||
|
|
||||||
|
A **stem and leaf plot** can list out all the data points while grouping them simultaneously.
|
||||||
|
|
||||||
|
A **frequency histogram** can be used to represent frequency distribution, with the x-axis containing class boundaries, and the y-axis representing frequency.
|
||||||
|
|
||||||
|
<img src="/resources/images/frequency-discrete.png" width=700>(Source: Kognity)</img>
|
||||||
|
|
||||||
|
!!! note
|
||||||
|
If data is discrete, a gap must be left between the bars. If data is continuous, there must *not* be a gap between the bars.
|
||||||
|
|
||||||
|
A **cumulative frequency table** can be used to find the number of data values below a certain class boundary. It involves the addition of a **cumulative frequency** column which represents the sum of the frequency of the current class as well as every class before it. It is similar to a prefix sum array in computer science.
|
||||||
|
|
||||||
|
??? example
|
||||||
|
| Height $h$ (cm) | Frequency | Cumulative frequency |
|
||||||
|
| --- | --- | --- |
|
||||||
|
| $1≤h<10$ | 2 | 2 |
|
||||||
|
| $10≤h<19$ | 5 | 7 |
|
||||||
|
|
||||||
|
A **cumulative frequency curve** consists of an independent variable on the x-axis, and the cumulative frequency on the y-axis. In grouped data, the values on the x-axis correspond to the upper bound of a given class. This graph is useful for interpolation (e.g., the value of a given percentile).
|
||||||
|
|
||||||
|
<img src="/resources/images/cumulative-frequency-curve.png" width=700>(Source: Kognity)</img>
|
||||||
|
|
||||||
|
A **box-and-whisker plot** is a visual representation of the **"5-number summary"** of a data set. These five numbers are the minimum and maximum values, the median, and the first and third quartiles.
|
||||||
|
|
||||||
|
<img src="/resources/images/box-and-whisker.png" width=700>(Source: Kognity)</img>
|
||||||
|
|
||||||
|
!!! warning
|
||||||
|
In the image above, the maximum and minimum dots are filled. If these values were to be excluded (e.g., the upper class boundary in grouped data is excluded), they should be unfilled instead.
|
||||||
|
|
||||||
|
### Measures of central tendency
|
||||||
|
|
||||||
## Resources
|
## Resources
|
||||||
|
|
||||||
|
Loading…
Reference in New Issue
Block a user