Dataset statistics
Number of variables | 12 |
---|---|
Number of observations | 891 |
Missing cells | 866 |
Missing cells (%) | 8.1% |
Duplicate rows | 0 |
Duplicate rows (%) | 0.0% |
Total size in memory | 83.7 KiB |
Average record size in memory | 96.1 B |
Variable types
CAT | 6 |
---|---|
NUM | 5 |
BOOL | 1 |
Ticket has a high cardinality: 681 distinct values | High cardinality |
Cabin has a high cardinality: 147 distinct values | High cardinality |
Age has 177 (19.9%) missing values | Missing |
Cabin has 687 (77.1%) missing values | Missing |
Ticket is uniformly distributed | Uniform |
Cabin is uniformly distributed | Uniform |
PassengerId has unique values | Unique |
Name has unique values | Unique |
SibSp has 608 (68.2%) zeros | Zeros |
Parch has 678 (76.1%) zeros | Zeros |
Fare has 15 (1.7%) zeros | Zeros |
Reproduction
Analysis started | 2021-06-15 06:36:48.929254 |
---|---|
Analysis finished | 2021-06-15 06:36:57.804957 |
Duration | 8.88 seconds |
Software version | pandas-profiling v2.9.0 |
Download configuration | config.yaml |
Distinct | 891 |
---|---|
Distinct (%) | 100.0% |
Missing | 0 |
Missing (%) | 0.0% |
Infinite | 0 |
Infinite (%) | 0.0% |
Mean | 446 |
---|---|
Minimum | 1 |
Maximum | 891 |
Zeros | 0 |
Zeros (%) | 0.0% |
Memory size | 7.0 KiB |
Quantile statistics
Minimum | 1 |
---|---|
5-th percentile | 45.5 |
Q1 | 223.5 |
median | 446 |
Q3 | 668.5 |
95-th percentile | 846.5 |
Maximum | 891 |
Range | 890 |
Interquartile range (IQR) | 445 |
Descriptive statistics
Standard deviation | 257.353842 |
---|---|
Coefficient of variation (CV) | 0.5770265516 |
Kurtosis | -1.2 |
Mean | 446 |
Median Absolute Deviation (MAD) | 223 |
Skewness | 0 |
Sum | 397386 |
Variance | 66231 |
Monotocity | Strictly increasing |
Value | Count | Frequency (%) | |
891 | 1 | 0.1% | |
293 | 1 | 0.1% | |
304 | 1 | 0.1% | |
303 | 1 | 0.1% | |
302 | 1 | 0.1% | |
301 | 1 | 0.1% | |
300 | 1 | 0.1% | |
299 | 1 | 0.1% | |
298 | 1 | 0.1% | |
297 | 1 | 0.1% | |
Other values (881) | 881 | 98.9% |
Value | Count | Frequency (%) | |
1 | 1 | 0.1% | |
2 | 1 | 0.1% | |
3 | 1 | 0.1% | |
4 | 1 | 0.1% | |
5 | 1 | 0.1% |
Value | Count | Frequency (%) | |
891 | 1 | 0.1% | |
890 | 1 | 0.1% | |
889 | 1 | 0.1% | |
888 | 1 | 0.1% | |
887 | 1 | 0.1% |
Survived
Boolean
Distinct | 2 |
---|---|
Distinct (%) | 0.2% |
Missing | 0 |
Missing (%) | 0.0% |
Memory size | 7.0 KiB |
0 | |
---|---|
1 |
Value | Count | Frequency (%) | |
0 | 549 | 61.6% | |
1 | 342 | 38.4% |
Pclass
Categorical
Distinct | 3 |
---|---|
Distinct (%) | 0.3% |
Missing | 0 |
Missing (%) | 0.0% |
Memory size | 7.0 KiB |
3 | |
---|---|
1 | |
2 |
Value | Count | Frequency (%) | |
3 | 491 | 55.1% | |
1 | 216 | 24.2% | |
2 | 184 | 20.7% |
Unique
Unique | 0 ? |
---|---|
Unique (%) | 0.0% |
Length
Max length | 1 |
---|---|
Median length | 1 |
Mean length | 1 |
Min length | 1 |
Distinct | 891 |
---|---|
Distinct (%) | 100.0% |
Missing | 0 |
Missing (%) | 0.0% |
Memory size | 7.0 KiB |
Rogers, Mr. William John | 1 |
---|---|
Goldenberg, Mr. Samuel L | 1 |
Chronopoulos, Mr. Apostolos | 1 |
Saad, Mr. Khalil | 1 |
Robins, Mrs. Alexander A (Grace Charity Laury) | 1 |
Other values (886) |
Value | Count | Frequency (%) | |
Rogers, Mr. William John | 1 | 0.1% | |
Goldenberg, Mr. Samuel L | 1 | 0.1% | |
Chronopoulos, Mr. Apostolos | 1 | 0.1% | |
Saad, Mr. Khalil | 1 | 0.1% | |
Robins, Mrs. Alexander A (Grace Charity Laury) | 1 | 0.1% | |
Sundman, Mr. Johan Julian | 1 | 0.1% | |
Taylor, Mr. Elmer Zebley | 1 | 0.1% | |
Robert, Mrs. Edward Scott (Elisabeth Walton McMillan) | 1 | 0.1% | |
Connolly, Miss. Kate | 1 | 0.1% | |
Sheerlinck, Mr. Jan Baptist | 1 | 0.1% | |
Other values (881) | 881 | 98.9% |
Unique
Unique | 891 ? |
---|---|
Unique (%) | 100.0% |
Length
Max length | 82 |
---|---|
Median length | 25 |
Mean length | 26.96520763 |
Min length | 12 |
Sex
Categorical
Distinct | 2 |
---|---|
Distinct (%) | 0.2% |
Missing | 0 |
Missing (%) | 0.0% |
Memory size | 7.0 KiB |
male | |
---|---|
female |
Value | Count | Frequency (%) | |
male | 577 | 64.8% | |
female | 314 | 35.2% |
Unique
Unique | 0 ? |
---|---|
Unique (%) | 0.0% |
Length
Max length | 6 |
---|---|
Median length | 4 |
Mean length | 4.704826038 |
Min length | 4 |
Distinct | 88 |
---|---|
Distinct (%) | 12.3% |
Missing | 177 |
Missing (%) | 19.9% |
Infinite | 0 |
Infinite (%) | 0.0% |
Mean | 29.69911765 |
---|---|
Minimum | 0.42 |
Maximum | 80 |
Zeros | 0 |
Zeros (%) | 0.0% |
Memory size | 7.0 KiB |
Quantile statistics
Minimum | 0.42 |
---|---|
5-th percentile | 4 |
Q1 | 20.125 |
median | 28 |
Q3 | 38 |
95-th percentile | 56 |
Maximum | 80 |
Range | 79.58 |
Interquartile range (IQR) | 17.875 |
Descriptive statistics
Standard deviation | 14.52649733 |
---|---|
Coefficient of variation (CV) | 0.4891221855 |
Kurtosis | 0.1782741536 |
Mean | 29.69911765 |
Median Absolute Deviation (MAD) | 9 |
Skewness | 0.3891077823 |
Sum | 21205.17 |
Variance | 211.0191247 |
Monotocity | Not monotonic |
Value | Count | Frequency (%) | |
24 | 30 | 3.4% | |
22 | 27 | 3.0% | |
18 | 26 | 2.9% | |
28 | 25 | 2.8% | |
19 | 25 | 2.8% | |
30 | 25 | 2.8% | |
21 | 24 | 2.7% | |
25 | 23 | 2.6% | |
36 | 22 | 2.5% | |
29 | 20 | 2.2% | |
Other values (78) | 467 | 52.4% | |
(Missing) | 177 | 19.9% |
Value | Count | Frequency (%) | |
0.42 | 1 | 0.1% | |
0.67 | 1 | 0.1% | |
0.75 | 2 | 0.2% | |
0.83 | 2 | 0.2% | |
0.92 | 1 | 0.1% |
Value | Count | Frequency (%) | |
80 | 1 | 0.1% | |
74 | 1 | 0.1% | |
71 | 2 | 0.2% | |
70.5 | 1 | 0.1% | |
70 | 2 | 0.2% |
Distinct | 7 |
---|---|
Distinct (%) | 0.8% |
Missing | 0 |
Missing (%) | 0.0% |
Infinite | 0 |
Infinite (%) | 0.0% |
Mean | 0.5230078563 |
---|---|
Minimum | 0 |
Maximum | 8 |
Zeros | 608 |
Zeros (%) | 68.2% |
Memory size | 7.0 KiB |
Quantile statistics
Minimum | 0 |
---|---|
5-th percentile | 0 |
Q1 | 0 |
median | 0 |
Q3 | 1 |
95-th percentile | 3 |
Maximum | 8 |
Range | 8 |
Interquartile range (IQR) | 1 |
Descriptive statistics
Standard deviation | 1.102743432 |
---|---|
Coefficient of variation (CV) | 2.108464374 |
Kurtosis | 17.88041973 |
Mean | 0.5230078563 |
Median Absolute Deviation (MAD) | 0 |
Skewness | 3.695351727 |
Sum | 466 |
Variance | 1.216043077 |
Monotocity | Not monotonic |
Value | Count | Frequency (%) | |
0 | 608 | 68.2% | |
1 | 209 | 23.5% | |
2 | 28 | 3.1% | |
4 | 18 | 2.0% | |
3 | 16 | 1.8% | |
8 | 7 | 0.8% | |
5 | 5 | 0.6% |
Value | Count | Frequency (%) | |
0 | 608 | 68.2% | |
1 | 209 | 23.5% | |
2 | 28 | 3.1% | |
3 | 16 | 1.8% | |
4 | 18 | 2.0% |
Value | Count | Frequency (%) | |
8 | 7 | 0.8% | |
5 | 5 | 0.6% | |
4 | 18 | 2.0% | |
3 | 16 | 1.8% | |
2 | 28 | 3.1% |
Distinct | 7 |
---|---|
Distinct (%) | 0.8% |
Missing | 0 |
Missing (%) | 0.0% |
Infinite | 0 |
Infinite (%) | 0.0% |
Mean | 0.3815937149 |
---|---|
Minimum | 0 |
Maximum | 6 |
Zeros | 678 |
Zeros (%) | 76.1% |
Memory size | 7.0 KiB |
Quantile statistics
Minimum | 0 |
---|---|
5-th percentile | 0 |
Q1 | 0 |
median | 0 |
Q3 | 0 |
95-th percentile | 2 |
Maximum | 6 |
Range | 6 |
Interquartile range (IQR) | 0 |
Descriptive statistics
Standard deviation | 0.8060572211 |
---|---|
Coefficient of variation (CV) | 2.112344071 |
Kurtosis | 9.778125179 |
Mean | 0.3815937149 |
Median Absolute Deviation (MAD) | 0 |
Skewness | 2.749117047 |
Sum | 340 |
Variance | 0.6497282437 |
Monotocity | Not monotonic |
Value | Count | Frequency (%) | |
0 | 678 | 76.1% | |
1 | 118 | 13.2% | |
2 | 80 | 9.0% | |
5 | 5 | 0.6% | |
3 | 5 | 0.6% | |
4 | 4 | 0.4% | |
6 | 1 | 0.1% |
Value | Count | Frequency (%) | |
0 | 678 | 76.1% | |
1 | 118 | 13.2% | |
2 | 80 | 9.0% | |
3 | 5 | 0.6% | |
4 | 4 | 0.4% |
Value | Count | Frequency (%) | |
6 | 1 | 0.1% | |
5 | 5 | 0.6% | |
4 | 4 | 0.4% | |
3 | 5 | 0.6% | |
2 | 80 | 9.0% |
Distinct | 681 |
---|---|
Distinct (%) | 76.4% |
Missing | 0 |
Missing (%) | 0.0% |
Memory size | 7.0 KiB |
347082 | 7 |
---|---|
CA. 2343 | 7 |
1601 | 7 |
CA 2144 | 6 |
347088 | 6 |
Other values (676) |
Value | Count | Frequency (%) | |
347082 | 7 | 0.8% | |
CA. 2343 | 7 | 0.8% | |
1601 | 7 | 0.8% | |
CA 2144 | 6 | 0.7% | |
347088 | 6 | 0.7% | |
3101295 | 6 | 0.7% | |
S.O.C. 14879 | 5 | 0.6% | |
382652 | 5 | 0.6% | |
2666 | 4 | 0.4% | |
LINE | 4 | 0.4% | |
Other values (671) | 834 | 93.6% |
Unique
Unique | 547 ? |
---|---|
Unique (%) | 61.4% |
Length
Max length | 18 |
---|---|
Median length | 6 |
Mean length | 6.750841751 |
Min length | 3 |
Distinct | 248 |
---|---|
Distinct (%) | 27.8% |
Missing | 0 |
Missing (%) | 0.0% |
Infinite | 0 |
Infinite (%) | 0.0% |
Mean | 32.20420797 |
---|---|
Minimum | 0 |
Maximum | 512.3292 |
Zeros | 15 |
Zeros (%) | 1.7% |
Memory size | 7.0 KiB |
Quantile statistics
Minimum | 0 |
---|---|
5-th percentile | 7.225 |
Q1 | 7.9104 |
median | 14.4542 |
Q3 | 31 |
95-th percentile | 112.07915 |
Maximum | 512.3292 |
Range | 512.3292 |
Interquartile range (IQR) | 23.0896 |
Descriptive statistics
Standard deviation | 49.6934286 |
---|---|
Coefficient of variation (CV) | 1.543072528 |
Kurtosis | 33.39814088 |
Mean | 32.20420797 |
Median Absolute Deviation (MAD) | 6.9042 |
Skewness | 4.78731652 |
Sum | 28693.9493 |
Variance | 2469.436846 |
Monotocity | Not monotonic |
Value | Count | Frequency (%) | |
8.05 | 43 | 4.8% | |
13 | 42 | 4.7% | |
7.8958 | 38 | 4.3% | |
7.75 | 34 | 3.8% | |
26 | 31 | 3.5% | |
10.5 | 24 | 2.7% | |
7.925 | 18 | 2.0% | |
7.775 | 16 | 1.8% | |
26.55 | 15 | 1.7% | |
0 | 15 | 1.7% | |
Other values (238) | 615 | 69.0% |
Value | Count | Frequency (%) | |
0 | 15 | 1.7% | |
4.0125 | 1 | 0.1% | |
5 | 1 | 0.1% | |
6.2375 | 1 | 0.1% | |
6.4375 | 1 | 0.1% |
Value | Count | Frequency (%) | |
512.3292 | 3 | 0.3% | |
263 | 4 | 0.4% | |
262.375 | 2 | 0.2% | |
247.5208 | 2 | 0.2% | |
227.525 | 4 | 0.4% |
Distinct | 147 |
---|---|
Distinct (%) | 72.1% |
Missing | 687 |
Missing (%) | 77.1% |
Memory size | 7.0 KiB |
G6 | 4 |
---|---|
B96 B98 | 4 |
C23 C25 C27 | 4 |
E101 | 3 |
F33 | 3 |
Other values (142) |
Value | Count | Frequency (%) | |
G6 | 4 | 0.4% | |
B96 B98 | 4 | 0.4% | |
C23 C25 C27 | 4 | 0.4% | |
E101 | 3 | 0.3% | |
F33 | 3 | 0.3% | |
C22 C26 | 3 | 0.3% | |
F2 | 3 | 0.3% | |
D | 3 | 0.3% | |
B35 | 2 | 0.2% | |
F4 | 2 | 0.2% | |
Other values (137) | 173 | 19.4% | |
(Missing) | 687 | 77.1% |
Unique
Unique | 101 ? |
---|---|
Unique (%) | 49.5% |
Length
Max length | 15 |
---|---|
Median length | 3 |
Mean length | 3.134680135 |
Min length | 1 |
Embarked
Categorical
Distinct | 3 |
---|---|
Distinct (%) | 0.3% |
Missing | 2 |
Missing (%) | 0.2% |
Memory size | 7.0 KiB |
S | |
---|---|
C | |
Q |
Value | Count | Frequency (%) | |
S | 644 | 72.3% | |
C | 168 | 18.9% | |
Q | 77 | 8.6% | |
(Missing) | 2 | 0.2% |
Unique
Unique | 0 ? |
---|---|
Unique (%) | 0.0% |
Length
Max length | 3 |
---|---|
Median length | 1 |
Mean length | 1.004489338 |
Min length | 1 |
Pearson's r
The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.
Spearman's ρ
The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.
Kendall's τ
Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.
Phik (φk)
Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.Cramér's V (φc)
Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.First rows
PassengerId | Survived | Pclass | Name | Sex | Age | SibSp | Parch | Ticket | Fare | Cabin | Embarked | |
---|---|---|---|---|---|---|---|---|---|---|---|---|
0 | 1 | 0 | 3 | Braund, Mr. Owen Harris | male | 22.0 | 1 | 0 | A/5 21171 | 7.2500 | NaN | S |
1 | 2 | 1 | 1 | Cumings, Mrs. John Bradley (Florence Briggs Thayer) | female | 38.0 | 1 | 0 | PC 17599 | 71.2833 | C85 | C |
2 | 3 | 1 | 3 | Heikkinen, Miss. Laina | female | 26.0 | 0 | 0 | STON/O2. 3101282 | 7.9250 | NaN | S |
3 | 4 | 1 | 1 | Futrelle, Mrs. Jacques Heath (Lily May Peel) | female | 35.0 | 1 | 0 | 113803 | 53.1000 | C123 | S |
4 | 5 | 0 | 3 | Allen, Mr. William Henry | male | 35.0 | 0 | 0 | 373450 | 8.0500 | NaN | S |
5 | 6 | 0 | 3 | Moran, Mr. James | male | NaN | 0 | 0 | 330877 | 8.4583 | NaN | Q |
6 | 7 | 0 | 1 | McCarthy, Mr. Timothy J | male | 54.0 | 0 | 0 | 17463 | 51.8625 | E46 | S |
7 | 8 | 0 | 3 | Palsson, Master. Gosta Leonard | male | 2.0 | 3 | 1 | 349909 | 21.0750 | NaN | S |
8 | 9 | 1 | 3 | Johnson, Mrs. Oscar W (Elisabeth Vilhelmina Berg) | female | 27.0 | 0 | 2 | 347742 | 11.1333 | NaN | S |
9 | 10 | 1 | 2 | Nasser, Mrs. Nicholas (Adele Achem) | female | 14.0 | 1 | 0 | 237736 | 30.0708 | NaN | C |
Last rows
PassengerId | Survived | Pclass | Name | Sex | Age | SibSp | Parch | Ticket | Fare | Cabin | Embarked | |
---|---|---|---|---|---|---|---|---|---|---|---|---|
881 | 882 | 0 | 3 | Markun, Mr. Johann | male | 33.0 | 0 | 0 | 349257 | 7.8958 | NaN | S |
882 | 883 | 0 | 3 | Dahlberg, Miss. Gerda Ulrika | female | 22.0 | 0 | 0 | 7552 | 10.5167 | NaN | S |
883 | 884 | 0 | 2 | Banfield, Mr. Frederick James | male | 28.0 | 0 | 0 | C.A./SOTON 34068 | 10.5000 | NaN | S |
884 | 885 | 0 | 3 | Sutehall, Mr. Henry Jr | male | 25.0 | 0 | 0 | SOTON/OQ 392076 | 7.0500 | NaN | S |
885 | 886 | 0 | 3 | Rice, Mrs. William (Margaret Norton) | female | 39.0 | 0 | 5 | 382652 | 29.1250 | NaN | Q |
886 | 887 | 0 | 2 | Montvila, Rev. Juozas | male | 27.0 | 0 | 0 | 211536 | 13.0000 | NaN | S |
887 | 888 | 1 | 1 | Graham, Miss. Margaret Edith | female | 19.0 | 0 | 0 | 112053 | 30.0000 | B42 | S |
888 | 889 | 0 | 3 | Johnston, Miss. Catherine Helen "Carrie" | female | NaN | 1 | 2 | W./C. 6607 | 23.4500 | NaN | S |
889 | 890 | 1 | 1 | Behr, Mr. Karl Howell | male | 26.0 | 0 | 0 | 111369 | 30.0000 | C148 | C |
890 | 891 | 0 | 3 | Dooley, Mr. Patrick | male | 32.0 | 0 | 0 | 370376 | 7.7500 | NaN | Q |