Chap08：方差分析

往期要点回顾

本章要点目录

【知识点】方差分析（ANOVA）统计术语
【实践1】组间设计ANOVA（重点）
【实践2】组内设计ANOVA
【实践3】混合设计ANOVA
【实践4】组间设计ANOVA的多重比较（重点）
【探索发现】多重比较的p值校正方法
【实践5】组间设计ANOVA的简单效应检验（重点）
【探索发现】对于两因素方差分析（A × B），以下情况都有可能发生吗？
【实践6】交互作用显著，但A的两个简单效应都不显著
【实践7】交互作用不显著，但A的简单效应一个显著、一个不显著

## 本章所需R包
library(bruceR)

方差分析的统计知识回顾

【知识点】方差分析（ANOVA）统计术语

↑ 图源：https://www.nature.com/articles/s41598-023-47057-0

方差分析ANOVA（以2 × 2 “高低组别 × 男女性别”两因素组间设计ANOVA为例）
- 主效应（main effect）
  - 代表“平均效应”，某个因素在其他因素不同条件下的边际平均效应
  - 例：高组和低组之间的总体差异（无论男性和女性，组别的平均效应）
- 交互作用（interaction）
  - 代表“效应差异”，某个因素在其他因素不同条件下存在不同的效应
  - 例：高低组间的差异在男性和女性群体之间也存在差异（差异的差异）
交互作用显著后的简单效应检验
- 简单效应（simple effect），也称“条件效应”（conditional effect）
  - 通常特指：简单主效应（simple main effect），也称“条件主效应”（conditional main effect）
  - 例：分别在男性或女性群体中，高低组间的差异（组别的简单主效应）
- （拓展）三阶交互作用（A × B × C）中的复杂情况
  - 简单交互作用（simple interaction）：C不同条件下的A × B简单交互作用
  - 简单简单效应（simple-simple effect）：B和C不同组合条件下的A简单主效应
某个因素多个条件间（≥ 3）的两两对比
- 事后检验（post-hoc test）
  - 通常特指：事后多重比较（post-hoc multiple comparison）
  - 需要对p值做“多重比较校正”（adjust p-values for multiple comparisons）以降低假阳性概率（false discovery rate, FDR）

多因素方差分析

完全随机/组间设计ANOVA

【实践1】组间设计ANOVA

MANOVA()函数帮助文档

between.1  # 单因素四水平组间设计

MANOVA(between.1, dv="SCORE", between="A")


====== ANOVA (Between-Subjects Design) ======

Descriptives:
─────────────────────
 "A"   Mean    S.D. n
─────────────────────
  A1  4.375 (1.685) 8
  A2  3.875 (1.246) 8
  A3  7.000 (1.309) 8
  A4 10.000 (2.268) 8
─────────────────────
Total sample size: N = 32

ANOVA Table:
Dependent variable(s):      SCORE
Between-subjects factor(s): A
Within-subjects factor(s):  –
Covariate(s):               –
─────────────────────────────────────────────────────────────────
       MS   MSE df1 df2      F     p     η²p [90% CI of η²p]  η²G
─────────────────────────────────────────────────────────────────
A  63.375 2.812   3  28 22.533 <.001 ***   .707 [.526, .798] .707
─────────────────────────────────────────────────────────────────
MSE = mean square error (the residual variance of the linear model)
η²p = partial eta-squared = SS / (SS + SSE) = F * df1 / (F * df1 + df2)
ω²p = partial omega-squared = (F - 1) * df1 / (F * df1 + df2 + 1)
η²G = generalized eta-squared (see Olejnik & Algina, 2003)
Cohen’s f² = η²p / (1 - η²p)

Levene’s Test for Homogeneity of Variance:
───────────────────────────────────────
           Levene’s F df1 df2     p    
───────────────────────────────────────
DV: SCORE       3.235   3  28  .037 *  
───────────────────────────────────────

between.2  # 2×3两因素组间设计

   A B SCORE
1  1 1     3
2  1 1     6
3  1 1     4
4  1 1     3
5  1 2     4
6  1 2     6
7  1 2     4
8  1 2     2
9  1 3     5
10 1 3     7
11 1 3     5
12 1 3     2
13 2 1     4
14 2 1     5
15 2 1     3
16 2 1     3
17 2 2     8
18 2 2     9
19 2 2     8
20 2 2     7
21 2 3    12
22 2 3    13
23 2 3    12
24 2 3    11

MANOVA(between.2, dv="SCORE", between=c("A", "B"))


====== ANOVA (Between-Subjects Design) ======

Descriptives:
─────────────────────────
 "A" "B"   Mean    S.D. n
─────────────────────────
  A1  B1  4.000 (1.414) 4
  A1  B2  4.000 (1.633) 4
  A1  B3  4.750 (2.062) 4
  A2  B1  3.750 (0.957) 4
  A2  B2  8.000 (0.816) 4
  A2  B3 12.000 (0.816) 4
─────────────────────────
Total sample size: N = 24

ANOVA Table:
Dependent variable(s):      SCORE
Between-subjects factor(s): A, B
Within-subjects factor(s):  –
Covariate(s):               –
─────────────────────────────────────────────────────────────────────
           MS   MSE df1 df2      F     p     η²p [90% CI of η²p]  η²G
─────────────────────────────────────────────────────────────────────
A      80.667 1.861   1  18 43.343 <.001 ***   .707 [.482, .817] .707
B      40.542 1.861   2  18 21.784 <.001 ***   .708 [.470, .815] .708
A * B  28.292 1.861   2  18 15.201 <.001 ***   .628 [.347, .763] .628
─────────────────────────────────────────────────────────────────────
MSE = mean square error (the residual variance of the linear model)
η²p = partial eta-squared = SS / (SS + SSE) = F * df1 / (F * df1 + df2)
ω²p = partial omega-squared = (F - 1) * df1 / (F * df1 + df2 + 1)
η²G = generalized eta-squared (see Olejnik & Algina, 2003)
Cohen’s f² = η²p / (1 - η²p)

Levene’s Test for Homogeneity of Variance:
───────────────────────────────────────
           Levene’s F df1 df2     p    
───────────────────────────────────────
DV: SCORE       0.605   5  18  .697    
───────────────────────────────────────

## 使用 emmeans 包的 emmip() 函数绘制交互图
## 请查阅帮助文档：?emmeans::emmip()
m = MANOVA(between.2, dv="SCORE", between=c("A", "B"))


====== ANOVA (Between-Subjects Design) ======

Descriptives:
─────────────────────────
 "A" "B"   Mean    S.D. n
─────────────────────────
  A1  B1  4.000 (1.414) 4
  A1  B2  4.000 (1.633) 4
  A1  B3  4.750 (2.062) 4
  A2  B1  3.750 (0.957) 4
  A2  B2  8.000 (0.816) 4
  A2  B3 12.000 (0.816) 4
─────────────────────────
Total sample size: N = 24

ANOVA Table:
Dependent variable(s):      SCORE
Between-subjects factor(s): A, B
Within-subjects factor(s):  –
Covariate(s):               –
─────────────────────────────────────────────────────────────────────
           MS   MSE df1 df2      F     p     η²p [90% CI of η²p]  η²G
─────────────────────────────────────────────────────────────────────
A      80.667 1.861   1  18 43.343 <.001 ***   .707 [.482, .817] .707
B      40.542 1.861   2  18 21.784 <.001 ***   .708 [.470, .815] .708
A * B  28.292 1.861   2  18 15.201 <.001 ***   .628 [.347, .763] .628
─────────────────────────────────────────────────────────────────────
MSE = mean square error (the residual variance of the linear model)
η²p = partial eta-squared = SS / (SS + SSE) = F * df1 / (F * df1 + df2)
ω²p = partial omega-squared = (F - 1) * df1 / (F * df1 + df2 + 1)
η²G = generalized eta-squared (see Olejnik & Algina, 2003)
Cohen’s f² = η²p / (1 - η²p)

Levene’s Test for Homogeneity of Variance:
───────────────────────────────────────
           Levene’s F df1 df2     p    
───────────────────────────────────────
DV: SCORE       0.605   5  18  .697    
───────────────────────────────────────

emmip(m, ~ A | B, CIs=TRUE)

emmip(m, ~ B | A, CIs=TRUE)

emmip(m, B ~ A, CIs=TRUE)

emmip(m, A ~ B, CIs=TRUE)

between.3  # 2×2×2三因素组间设计

   A B C SCORE
1  1 1 1     3
2  1 1 1     6
3  1 1 1     4
4  1 1 1     3
5  1 1 2     5
6  1 1 2     7
7  1 1 2     5
8  1 1 2     2
9  1 2 1     4
10 1 2 1     6
11 1 2 1     4
12 1 2 1     2
13 1 2 2     4
14 1 2 2     5
15 1 2 2     3
16 1 2 2     3
17 2 1 1     8
18 2 1 1     9
19 2 1 1     8
20 2 1 1     7
21 2 1 2     5
22 2 1 2     6
23 2 1 2     7
24 2 1 2     6
25 2 2 1     9
26 2 2 1     8
27 2 2 1     8
28 2 2 1     7
29 2 2 2    12
30 2 2 2    13
31 2 2 2    12
32 2 2 2    11

MANOVA(between.3, dv="SCORE", between=c("A", "B", "C"))


====== ANOVA (Between-Subjects Design) ======

Descriptives:
─────────────────────────────
 "A" "B" "C"   Mean    S.D. n
─────────────────────────────
  A1  B1  C1  4.000 (1.414) 4
  A1  B1  C2  4.750 (2.062) 4
  A1  B2  C1  4.000 (1.633) 4
  A1  B2  C2  3.750 (0.957) 4
  A2  B1  C1  8.000 (0.816) 4
  A2  B1  C2  6.000 (0.816) 4
  A2  B2  C1  8.000 (0.816) 4
  A2  B2  C2 12.000 (0.816) 4
─────────────────────────────
Total sample size: N = 32

ANOVA Table:
Dependent variable(s):      SCORE
Between-subjects factor(s): A, B, C
Within-subjects factor(s):  –
Covariate(s):               –
──────────────────────────────────────────────────────────────────────────
                MS   MSE df1 df2      F     p     η²p [90% CI of η²p]  η²G
──────────────────────────────────────────────────────────────────────────
A          153.125 1.563   1  24 98.000 <.001 ***   .803 [.670, .870] .803
B           12.500 1.563   1  24  8.000  .009 **    .250 [.042, .466] .250
C            3.125 1.563   1  24  2.000  .170       .077 [.000, .283] .077
A * B       24.500 1.563   1  24 15.680 <.001 ***   .395 [.147, .585] .395
A * C        1.125 1.563   1  24  0.720  .405       .029 [.000, .206] .029
B * C       12.500 1.563   1  24  8.000  .009 **    .250 [.042, .466] .250
A * B * C   24.500 1.563   1  24 15.680 <.001 ***   .395 [.147, .585] .395
──────────────────────────────────────────────────────────────────────────
MSE = mean square error (the residual variance of the linear model)
η²p = partial eta-squared = SS / (SS + SSE) = F * df1 / (F * df1 + df2)
ω²p = partial omega-squared = (F - 1) * df1 / (F * df1 + df2 + 1)
η²G = generalized eta-squared (see Olejnik & Algina, 2003)
Cohen’s f² = η²p / (1 - η²p)

Levene’s Test for Homogeneity of Variance:
───────────────────────────────────────
           Levene’s F df1 df2     p    
───────────────────────────────────────
DV: SCORE       0.668   7  24  .697    
───────────────────────────────────────

重复测量/组内设计ANOVA

【实践2】组内设计ANOVA

MANOVA()函数帮助文档

within.1  # 单因素四水平组内设计

  ID A1 A2 A3 A4
1 S1  3  4  8  9
2 S2  6  6  9  8
3 S3  4  4  8  8
4 S4  3  2  7  7
5 S5  5  4  5 12
6 S6  7  5  6 13
7 S7  5  3  7 12
8 S8  2  3  6 11

MANOVA(within.1,
       dvs = "A1:A4",
       dvs.pattern = "A(.)",
       within = "A")


Note:
dvs="A1:A4" is matched to variables:
A1, A2, A3, A4


====== ANOVA (Within-Subjects Design) ======

Descriptives:
─────────────────────
 "A"   Mean    S.D. n
─────────────────────
  A1  4.375 (1.685) 8
  A2  3.875 (1.246) 8
  A3  7.000 (1.309) 8
  A4 10.000 (2.268) 8
─────────────────────
Total sample size: N = 8

ANOVA Table:
Dependent variable(s):      A1, A2, A3, A4
Between-subjects factor(s): –
Within-subjects factor(s):  A
Covariate(s):               –
─────────────────────────────────────────────────────────────────
       MS   MSE df1 df2      F     p     η²p [90% CI of η²p]  η²G
─────────────────────────────────────────────────────────────────
A  63.375 2.518   3  21 25.170 <.001 ***   .782 [.609, .858] .707
─────────────────────────────────────────────────────────────────
MSE = mean square error (the residual variance of the linear model)
η²p = partial eta-squared = SS / (SS + SSE) = F * df1 / (F * df1 + df2)
ω²p = partial omega-squared = (F - 1) * df1 / (F * df1 + df2 + 1)
η²G = generalized eta-squared (see Olejnik & Algina, 2003)
Cohen’s f² = η²p / (1 - η²p)

Levene’s Test for Homogeneity of Variance:
No between-subjects factors. No need to do the Levene’s test.

Mauchly’s Test of Sphericity:
────────────────────────
   Mauchly's W     p    
────────────────────────
A       0.1899  .095 .  
────────────────────────

# 相同：
MANOVA(within.1,
       dvs = c("A1", "A2", "A3", "A4"),
       dvs.pattern = "A(.)",
       within = "AnyVarNameIsOK")


====== ANOVA (Within-Subjects Design) ======

Descriptives:
──────────────────────────────────
 "AnyVarNameIsOK"   Mean    S.D. n
──────────────────────────────────
  AnyVarNameIsOK1  4.375 (1.685) 8
  AnyVarNameIsOK2  3.875 (1.246) 8
  AnyVarNameIsOK3  7.000 (1.309) 8
  AnyVarNameIsOK4 10.000 (2.268) 8
──────────────────────────────────
Total sample size: N = 8

ANOVA Table:
Dependent variable(s):      A1, A2, A3, A4
Between-subjects factor(s): –
Within-subjects factor(s):  AnyVarNameIsOK
Covariate(s):               –
──────────────────────────────────────────────────────────────────────────────
                    MS   MSE df1 df2      F     p     η²p [90% CI of η²p]  η²G
──────────────────────────────────────────────────────────────────────────────
AnyVarNameIsOK  63.375 2.518   3  21 25.170 <.001 ***   .782 [.609, .858] .707
──────────────────────────────────────────────────────────────────────────────
MSE = mean square error (the residual variance of the linear model)
η²p = partial eta-squared = SS / (SS + SSE) = F * df1 / (F * df1 + df2)
ω²p = partial omega-squared = (F - 1) * df1 / (F * df1 + df2 + 1)
η²G = generalized eta-squared (see Olejnik & Algina, 2003)
Cohen’s f² = η²p / (1 - η²p)

Levene’s Test for Homogeneity of Variance:
No between-subjects factors. No need to do the Levene’s test.

Mauchly’s Test of Sphericity:
─────────────────────────────────────
                Mauchly's W     p    
─────────────────────────────────────
AnyVarNameIsOK       0.1899  .095 .  
─────────────────────────────────────

within.2  # 2×3两因素组内设计

  ID A1B1 A1B2 A1B3 A2B1 A2B2 A2B3
1 S1    3    4    5    4    8   12
2 S2    6    6    7    5    9   13
3 S3    4    4    5    3    8   12
4 S4    3    2    2    3    7   11

m = MANOVA(within.2,
           dvs = "A1B1:A2B3",
           dvs.pattern = "A(.)B(.)",
           within = c("A", "B"))


Note:
dvs="A1B1:A2B3" is matched to variables:
A1B1, A1B2, A1B3, A2B1, A2B2, A2B3


====== ANOVA (Within-Subjects Design) ======

Descriptives:
─────────────────────────
 "A" "B"   Mean    S.D. n
─────────────────────────
  A1  B1  4.000 (1.414) 4
  A1  B2  4.000 (1.633) 4
  A1  B3  4.750 (2.062) 4
  A2  B1  3.750 (0.957) 4
  A2  B2  8.000 (0.816) 4
  A2  B3 12.000 (0.816) 4
─────────────────────────
Total sample size: N = 4

ANOVA Table:
Dependent variable(s):      A1B1, A1B2, A1B3, A2B1, A2B2, A2B3
Between-subjects factor(s): –
Within-subjects factor(s):  A, B
Covariate(s):               –
──────────────────────────────────────────────────────────────────────
           MS   MSE df1 df2       F     p     η²p [90% CI of η²p]  η²G
──────────────────────────────────────────────────────────────────────
A      80.667 1.111   1   3  72.600  .003 **    .960 [.699, .985] .707
B      40.542 0.264   2   6 153.632 <.001 ***   .981 [.930, .991] .708
A * B  28.292 0.236   2   6 119.824 <.001 ***   .976 [.911, .988] .628
──────────────────────────────────────────────────────────────────────
MSE = mean square error (the residual variance of the linear model)
η²p = partial eta-squared = SS / (SS + SSE) = F * df1 / (F * df1 + df2)
ω²p = partial omega-squared = (F - 1) * df1 / (F * df1 + df2 + 1)
η²G = generalized eta-squared (see Olejnik & Algina, 2003)
Cohen’s f² = η²p / (1 - η²p)

Levene’s Test for Homogeneity of Variance:
No between-subjects factors. No need to do the Levene’s test.

Mauchly’s Test of Sphericity:
────────────────────────────
       Mauchly's W     p    
────────────────────────────
B           0.0665  .066 .  
A * B       0.2491  .249    
────────────────────────────

emmip(m, ~ A | B, CIs=TRUE)

emmip(m, ~ B | A, CIs=TRUE)

emmip(m, B ~ A, CIs=TRUE)

emmip(m, A ~ B, CIs=TRUE)

within.3  # 2×2×2三因素组内设计

  ID A1B1C1 A1B1C2 A1B2C1 A1B2C2 A2B1C1 A2B1C2 A2B2C1 A2B2C2
1 S1      3      5      4      4      8      5      9     12
2 S2      6      7      6      5      9      6      8     13
3 S3      4      5      4      3      8      7      8     12
4 S4      3      2      2      3      7      6      7     11

MANOVA(within.3,
       dvs = "A1B1C1:A2B2C2",
       dvs.pattern = "A(.)B(.)C(.)",
       within = c("A", "B", "C"))


Note:
dvs="A1B1C1:A2B2C2" is matched to variables:
A1B1C1, A1B1C2, A1B2C1, A1B2C2, A2B1C1, A2B1C2, A2B2C1, A2B2C2


====== ANOVA (Within-Subjects Design) ======

Descriptives:
─────────────────────────────
 "A" "B" "C"   Mean    S.D. n
─────────────────────────────
  A1  B1  C1  4.000 (1.414) 4
  A1  B1  C2  4.750 (2.062) 4
  A1  B2  C1  4.000 (1.633) 4
  A1  B2  C2  3.750 (0.957) 4
  A2  B1  C1  8.000 (0.816) 4
  A2  B1  C2  6.000 (0.816) 4
  A2  B2  C1  8.000 (0.816) 4
  A2  B2  C2 12.000 (0.816) 4
─────────────────────────────
Total sample size: N = 4

ANOVA Table:
Dependent variable(s):      A1B1C1, A1B1C2, A1B2C1, A1B2C2, A2B1C1, A2B1C2, A2B2C1, A2B2C2
Between-subjects factor(s): –
Within-subjects factor(s):  A, B, C
Covariate(s):               –
──────────────────────────────────────────────────────────────────────────
                MS   MSE df1 df2      F     p     η²p [90% CI of η²p]  η²G
──────────────────────────────────────────────────────────────────────────
A          153.125 1.875   1   3 81.667  .003 **    .965 [.727, .986] .803
B           12.500 0.583   1   3 21.429  .019 *     .877 [.279, .954] .250
C            3.125 0.042   1   3 75.000  .003 **    .962 [.707, .985] .077
A * B       24.500 0.250   1   3 98.000  .002 **    .970 [.768, .989] .395
A * C        1.125 0.708   1   3  1.588  .297       .346 [.000, .751] .029
B * C       12.500 0.417   1   3 30.000  .012 *     .909 [.411, .965] .250
A * B * C   24.500 1.083   1   3 22.615  .018 *     .883 [.300, .956] .395
──────────────────────────────────────────────────────────────────────────
MSE = mean square error (the residual variance of the linear model)
η²p = partial eta-squared = SS / (SS + SSE) = F * df1 / (F * df1 + df2)
ω²p = partial omega-squared = (F - 1) * df1 / (F * df1 + df2 + 1)
η²G = generalized eta-squared (see Olejnik & Algina, 2003)
Cohen’s f² = η²p / (1 - η²p)

Levene’s Test for Homogeneity of Variance:
No between-subjects factors. No need to do the Levene’s test.

Mauchly’s Test of Sphericity:
The repeated measures have only two levels. The assumption of sphericity is always met.

混合设计ANOVA

【实践3】混合设计ANOVA

MANOVA()函数帮助文档

mixed.2_1b1w  # 2×3两因素混合设计（A为组间，B为组内）

  A B1 B2 B3
1 1  3  4  5
2 1  6  6  7
3 1  4  4  5
4 1  3  2  2
5 2  4  8 12
6 2  5  9 13
7 2  3  8 12
8 2  3  7 11

MANOVA(mixed.2_1b1w,
       dvs = "B1:B3",
       dvs.pattern = "B(.)",
       between = "A",
       within = "B")


Note:
dvs="B1:B3" is matched to variables:
B1, B2, B3


====== ANOVA (Mixed Design) ======

Descriptives:
─────────────────────────
 "A" "B"   Mean    S.D. n
─────────────────────────
  A1  B1  4.000 (1.414) 4
  A1  B2  4.000 (1.633) 4
  A1  B3  4.750 (2.062) 4
  A2  B1  3.750 (0.957) 4
  A2  B2  8.000 (0.816) 4
  A2  B3 12.000 (0.816) 4
─────────────────────────
Total sample size: N = 8

ANOVA Table:
Dependent variable(s):      B1, B2, B3
Between-subjects factor(s): A
Within-subjects factor(s):  B
Covariate(s):               –
──────────────────────────────────────────────────────────────────────
           MS   MSE df1 df2       F     p     η²p [90% CI of η²p]  η²G
──────────────────────────────────────────────────────────────────────
A      80.667 5.083   1   6  15.869  .007 **    .726 [.248, .871] .707
B      40.542 0.250   2  12 162.167 <.001 ***   .964 [.918, .980] .708
A * B  28.292 0.250   2  12 113.167 <.001 ***   .950 [.885, .971] .628
──────────────────────────────────────────────────────────────────────
MSE = mean square error (the residual variance of the linear model)
η²p = partial eta-squared = SS / (SS + SSE) = F * df1 / (F * df1 + df2)
ω²p = partial omega-squared = (F - 1) * df1 / (F * df1 + df2 + 1)
η²G = generalized eta-squared (see Olejnik & Algina, 2003)
Cohen’s f² = η²p / (1 - η²p)

Levene’s Test for Homogeneity of Variance:
────────────────────────────────────
        Levene’s F df1 df2     p    
────────────────────────────────────
DV: B1       0.300   1   6  .604    
DV: B2       0.600   1   6  .468    
DV: B3       1.485   1   6  .269    
────────────────────────────────────

Mauchly’s Test of Sphericity:
────────────────────────────
       Mauchly's W     p    
────────────────────────────
B           0.1574  .010 ** 
A * B       0.1574  .010 ** 
────────────────────────────
The sphericity assumption is violated.
You may specify: sph.correction="GG" (or ="HF")

MANOVA(mixed.2_1b1w,
       dvs = "B1:B3",
       dvs.pattern = "B(.)",
       between = "A",
       within = "B",
       sph.correction = "GG")


Note:
dvs="B1:B3" is matched to variables:
B1, B2, B3


====== ANOVA (Mixed Design) ======

Descriptives:
─────────────────────────
 "A" "B"   Mean    S.D. n
─────────────────────────
  A1  B1  4.000 (1.414) 4
  A1  B2  4.000 (1.633) 4
  A1  B3  4.750 (2.062) 4
  A2  B1  3.750 (0.957) 4
  A2  B2  8.000 (0.816) 4
  A2  B3 12.000 (0.816) 4
─────────────────────────
Total sample size: N = 8

ANOVA Table:
Dependent variable(s):      B1, B2, B3
Between-subjects factor(s): A
Within-subjects factor(s):  B
Covariate(s):               –
──────────────────────────────────────────────────────────────────────────
           MS   MSE   df1   df2       F     p     η²p [90% CI of η²p]  η²G
──────────────────────────────────────────────────────────────────────────
A      80.667 5.083 1.000 6.000  15.869  .007 **    .726 [.248, .871] .707
B      74.702 0.461 1.085 6.513 162.167 <.001 ***   .964 [.880, .983] .708
A * B  52.130 0.461 1.085 6.513 113.167 <.001 ***   .950 [.833, .976] .628
──────────────────────────────────────────────────────────────────────────
Sphericity correction method: GG (Greenhouse-Geisser)
MSE = mean square error (the residual variance of the linear model)
η²p = partial eta-squared = SS / (SS + SSE) = F * df1 / (F * df1 + df2)
ω²p = partial omega-squared = (F - 1) * df1 / (F * df1 + df2 + 1)
η²G = generalized eta-squared (see Olejnik & Algina, 2003)
Cohen’s f² = η²p / (1 - η²p)

Levene’s Test for Homogeneity of Variance:
────────────────────────────────────
        Levene’s F df1 df2     p    
────────────────────────────────────
DV: B1       0.300   1   6  .604    
DV: B2       0.600   1   6  .468    
DV: B3       1.485   1   6  .269    
────────────────────────────────────

Mauchly’s Test of Sphericity:
────────────────────────────
       Mauchly's W     p    
────────────────────────────
B           0.1574  .010 ** 
A * B       0.1574  .010 ** 
────────────────────────────

mixed.3_1b2w  # 2×2×2三因素混合设计（A为组间，B、C为组内）

  A B1C1 B1C2 B2C1 B2C2
1 1    3    5    4    4
2 1    6    7    6    5
3 1    4    5    4    3
4 1    3    2    2    3
5 2    8    5    9   12
6 2    9    6    8   13
7 2    8    7    8   12
8 2    7    6    7   11

MANOVA(mixed.3_1b2w,
       dvs = "B1C1:B2C2",
       dvs.pattern = "B(.)C(.)",
       between = "A",
       within = c("B", "C"))


Note:
dvs="B1C1:B2C2" is matched to variables:
B1C1, B1C2, B2C1, B2C2


====== ANOVA (Mixed Design) ======

Descriptives:
─────────────────────────────
 "A" "B" "C"   Mean    S.D. n
─────────────────────────────
  A1  B1  C1  4.000 (1.414) 4
  A1  B1  C2  4.750 (2.062) 4
  A1  B2  C1  4.000 (1.633) 4
  A1  B2  C2  3.750 (0.957) 4
  A2  B1  C1  8.000 (0.816) 4
  A2  B1  C2  6.000 (0.816) 4
  A2  B2  C1  8.000 (0.816) 4
  A2  B2  C2 12.000 (0.816) 4
─────────────────────────────
Total sample size: N = 8

ANOVA Table:
Dependent variable(s):      B1C1, B1C2, B2C1, B2C2
Between-subjects factor(s): A
Within-subjects factor(s):  B, C
Covariate(s):               –
──────────────────────────────────────────────────────────────────────────
                MS   MSE df1 df2      F     p     η²p [90% CI of η²p]  η²G
──────────────────────────────────────────────────────────────────────────
A          153.125 4.708   1   6 32.522  .001 **    .844 [.503, .926] .803
B           12.500 0.417   1   6 30.000  .002 **    .833 [.475, .921] .250
A * B       24.500 0.417   1   6 58.800 <.001 ***   .907 [.684, .956] .395
C            3.125 0.375   1   6  8.333  .028 *     .581 [.064, .801] .077
A * C        1.125 0.375   1   6  3.000  .134       .333 [.000, .671] .029
B * C       12.500 0.750   1   6 16.667  .006 **    .735 [.264, .875] .250
A * B * C   24.500 0.750   1   6 32.667  .001 **    .845 [.505, .927] .395
──────────────────────────────────────────────────────────────────────────
MSE = mean square error (the residual variance of the linear model)
η²p = partial eta-squared = SS / (SS + SSE) = F * df1 / (F * df1 + df2)
ω²p = partial omega-squared = (F - 1) * df1 / (F * df1 + df2 + 1)
η²G = generalized eta-squared (see Olejnik & Algina, 2003)
Cohen’s f² = η²p / (1 - η²p)

Levene’s Test for Homogeneity of Variance:
──────────────────────────────────────
          Levene’s F df1 df2     p    
──────────────────────────────────────
DV: B1C1       1.000   1   6  .356    
DV: B1C2       1.485   1   6  .269    
DV: B2C1       0.600   1   6  .468    
DV: B2C2       0.500   1   6  .506    
──────────────────────────────────────

Mauchly’s Test of Sphericity:
The repeated measures have only two levels. The assumption of sphericity is always met.

mixed.3_2b1w  # 2×2×2三因素混合设计（A、C为组间，B为组内）

   A C B1 B2
1  1 1  3  4
2  1 1  6  6
3  1 1  4  4
4  1 1  3  2
5  1 2  5  4
6  1 2  7  5
7  1 2  5  3
8  1 2  2  3
9  2 1  8  9
10 2 1  9  8
11 2 1  8  8
12 2 1  7  7
13 2 2  5 12
14 2 2  6 13
15 2 2  7 12
16 2 2  6 11

MANOVA(mixed.3_2b1w,
       dvs = "B1:B2",
       dvs.pattern = "B(.)",
       between = c("A", "C"),
       within = "B")


Note:
dvs="B1:B2" is matched to variables:
B1, B2


====== ANOVA (Mixed Design) ======

Descriptives:
─────────────────────────────
 "A" "C" "B"   Mean    S.D. n
─────────────────────────────
  A1  C1  B1  4.000 (1.414) 4
  A1  C1  B2  4.000 (1.633) 4
  A1  C2  B1  4.750 (2.062) 4
  A1  C2  B2  3.750 (0.957) 4
  A2  C1  B1  8.000 (0.816) 4
  A2  C1  B2  8.000 (0.816) 4
  A2  C2  B1  6.000 (0.816) 4
  A2  C2  B2 12.000 (0.816) 4
─────────────────────────────
Total sample size: N = 16

ANOVA Table:
Dependent variable(s):      B1, B2
Between-subjects factor(s): A, C
Within-subjects factor(s):  B
Covariate(s):               –
──────────────────────────────────────────────────────────────────────────
                MS   MSE df1 df2      F     p     η²p [90% CI of η²p]  η²G
──────────────────────────────────────────────────────────────────────────
A          153.125 2.542   1  12 60.246 <.001 ***   .834 [.639, .906] .803
C            3.125 2.542   1  12  1.230  .289       .093 [.000, .390] .077
A * C        1.125 2.542   1  12  0.443  .518       .036 [.000, .305] .029
B           12.500 0.583   1  12 21.429 <.001 ***   .641 [.308, .795] .250
A * B       24.500 0.583   1  12 42.000 <.001 ***   .778 [.532, .874] .395
C * B       12.500 0.583   1  12 21.429 <.001 ***   .641 [.308, .795] .250
A * C * B   24.500 0.583   1  12 42.000 <.001 ***   .778 [.532, .874] .395
──────────────────────────────────────────────────────────────────────────
MSE = mean square error (the residual variance of the linear model)
η²p = partial eta-squared = SS / (SS + SSE) = F * df1 / (F * df1 + df2)
ω²p = partial omega-squared = (F - 1) * df1 / (F * df1 + df2 + 1)
η²G = generalized eta-squared (see Olejnik & Algina, 2003)
Cohen’s f² = η²p / (1 - η²p)

Levene’s Test for Homogeneity of Variance:
────────────────────────────────────
        Levene’s F df1 df2     p    
────────────────────────────────────
DV: B1       0.946   3  12  .449    
DV: B2       0.423   3  12  .740    
────────────────────────────────────

Mauchly’s Test of Sphericity:
The repeated measures have only two levels. The assumption of sphericity is always met.

简单效应检验与多重比较

多重比较

【实践4】组间设计ANOVA的多重比较

EMMEANS()函数帮助文档（Estimated Marginal Means，估计边际均值）

m = MANOVA(between.1, dv="SCORE", between="A")


====== ANOVA (Between-Subjects Design) ======

Descriptives:
─────────────────────
 "A"   Mean    S.D. n
─────────────────────
  A1  4.375 (1.685) 8
  A2  3.875 (1.246) 8
  A3  7.000 (1.309) 8
  A4 10.000 (2.268) 8
─────────────────────
Total sample size: N = 32

ANOVA Table:
Dependent variable(s):      SCORE
Between-subjects factor(s): A
Within-subjects factor(s):  –
Covariate(s):               –
─────────────────────────────────────────────────────────────────
       MS   MSE df1 df2      F     p     η²p [90% CI of η²p]  η²G
─────────────────────────────────────────────────────────────────
A  63.375 2.812   3  28 22.533 <.001 ***   .707 [.526, .798] .707
─────────────────────────────────────────────────────────────────
MSE = mean square error (the residual variance of the linear model)
η²p = partial eta-squared = SS / (SS + SSE) = F * df1 / (F * df1 + df2)
ω²p = partial omega-squared = (F - 1) * df1 / (F * df1 + df2 + 1)
η²G = generalized eta-squared (see Olejnik & Algina, 2003)
Cohen’s f² = η²p / (1 - η²p)

Levene’s Test for Homogeneity of Variance:
───────────────────────────────────────
           Levene’s F df1 df2     p    
───────────────────────────────────────
DV: SCORE       3.235   3  28  .037 *  
───────────────────────────────────────

emmip(m, ~ A, CIs=TRUE)

EMMEANS(m, "A", p.adjust="none")

------ EMMEANS (effect = "A") ------

Joint Tests of "A":
────────────────────────────────────────────────────
 Effect df1 df2      F     p     η²p [90% CI of η²p]
────────────────────────────────────────────────────
      A   3  28 22.533 <.001 ***   .707 [.526, .798]
────────────────────────────────────────────────────
Note. Simple effects of repeated measures with 3 or more levels
are different from the results obtained with SPSS MANOVA syntax.

Univariate Tests of "A":
─────────────────────────────────────────────────────────
           Sum of Squares df Mean Square      F     p    
─────────────────────────────────────────────────────────
Mean: "A"         190.125  3      63.375 22.533 <.001 ***
Residuals          78.750 28       2.812                 
─────────────────────────────────────────────────────────
Note. Identical to the results obtained with SPSS GLM EMMEANS syntax.

Estimated Marginal Means of "A":
───────────────────────────────────
 "A"  Mean [95% CI of Mean]    S.E.
───────────────────────────────────
  A1  4.375 [3.160,  5.590] (0.593)
  A2  3.875 [2.660,  5.090] (0.593)
  A3  7.000 [5.785,  8.215] (0.593)
  A4 10.000 [8.785, 11.215] (0.593)
───────────────────────────────────

Pairwise Comparisons of "A":
──────────────────────────────────────────────────────────────────────
 Contrast Estimate    S.E. df      t     p     Cohen’s d [95% CI of d]
──────────────────────────────────────────────────────────────────────
  A2 - A1   -0.500 (0.839) 28 -0.596  .556      -0.298 [-1.322, 0.726]
  A3 - A1    2.625 (0.839) 28  3.130  .004 **    1.565 [ 0.541, 2.589]
  A3 - A2    3.125 (0.839) 28  3.727 <.001 ***   1.863 [ 0.839, 2.888]
  A4 - A1    5.625 (0.839) 28  6.708 <.001 ***   3.354 [ 2.330, 4.378]
  A4 - A2    6.125 (0.839) 28  7.304 <.001 ***   3.652 [ 2.628, 4.676]
  A4 - A3    3.000 (0.839) 28  3.578  .001 **    1.789 [ 0.765, 2.813]
──────────────────────────────────────────────────────────────────────
Pooled SD for computing Cohen’s d: 1.677

Disclaimer:
By default, pooled SD is Root Mean Square Error (RMSE).
There is much disagreement on how to compute Cohen’s d.
You are completely responsible for setting `sd.pooled`.
You might also use `effectsize::t_to_d()` to compute d.

EMMEANS(m, "A", p.adjust="bonferroni")

------ EMMEANS (effect = "A") ------

Joint Tests of "A":
────────────────────────────────────────────────────
 Effect df1 df2      F     p     η²p [90% CI of η²p]
────────────────────────────────────────────────────
      A   3  28 22.533 <.001 ***   .707 [.526, .798]
────────────────────────────────────────────────────
Note. Simple effects of repeated measures with 3 or more levels
are different from the results obtained with SPSS MANOVA syntax.

Univariate Tests of "A":
─────────────────────────────────────────────────────────
           Sum of Squares df Mean Square      F     p    
─────────────────────────────────────────────────────────
Mean: "A"         190.125  3      63.375 22.533 <.001 ***
Residuals          78.750 28       2.812                 
─────────────────────────────────────────────────────────
Note. Identical to the results obtained with SPSS GLM EMMEANS syntax.

Estimated Marginal Means of "A":
───────────────────────────────────
 "A"  Mean [95% CI of Mean]    S.E.
───────────────────────────────────
  A1  4.375 [3.160,  5.590] (0.593)
  A2  3.875 [2.660,  5.090] (0.593)
  A3  7.000 [5.785,  8.215] (0.593)
  A4 10.000 [8.785, 11.215] (0.593)
───────────────────────────────────

Pairwise Comparisons of "A":
──────────────────────────────────────────────────────────────────────
 Contrast Estimate    S.E. df      t     p     Cohen’s d [95% CI of d]
──────────────────────────────────────────────────────────────────────
  A2 - A1   -0.500 (0.839) 28 -0.596 1.000      -0.298 [-1.718, 1.121]
  A3 - A1    2.625 (0.839) 28  3.130  .024 *     1.565 [ 0.146, 2.985]
  A3 - A2    3.125 (0.839) 28  3.727  .005 **    1.863 [ 0.444, 3.283]
  A4 - A1    5.625 (0.839) 28  6.708 <.001 ***   3.354 [ 1.935, 4.774]
  A4 - A2    6.125 (0.839) 28  7.304 <.001 ***   3.652 [ 2.233, 5.072]
  A4 - A3    3.000 (0.839) 28  3.578  .008 **    1.789 [ 0.369, 3.208]
──────────────────────────────────────────────────────────────────────
Pooled SD for computing Cohen’s d: 1.677
P-value adjustment: Bonferroni method for 6 tests.

Disclaimer:
By default, pooled SD is Root Mean Square Error (RMSE).
There is much disagreement on how to compute Cohen’s d.
You are completely responsible for setting `sd.pooled`.
You might also use `effectsize::t_to_d()` to compute d.

EMMEANS(m, "A", contrast="seq")

------ EMMEANS (effect = "A") ------

Joint Tests of "A":
────────────────────────────────────────────────────
 Effect df1 df2      F     p     η²p [90% CI of η²p]
────────────────────────────────────────────────────
      A   3  28 22.533 <.001 ***   .707 [.526, .798]
────────────────────────────────────────────────────
Note. Simple effects of repeated measures with 3 or more levels
are different from the results obtained with SPSS MANOVA syntax.

Univariate Tests of "A":
─────────────────────────────────────────────────────────
           Sum of Squares df Mean Square      F     p    
─────────────────────────────────────────────────────────
Mean: "A"         190.125  3      63.375 22.533 <.001 ***
Residuals          78.750 28       2.812                 
─────────────────────────────────────────────────────────
Note. Identical to the results obtained with SPSS GLM EMMEANS syntax.

Estimated Marginal Means of "A":
───────────────────────────────────
 "A"  Mean [95% CI of Mean]    S.E.
───────────────────────────────────
  A1  4.375 [3.160,  5.590] (0.593)
  A2  3.875 [2.660,  5.090] (0.593)
  A3  7.000 [5.785,  8.215] (0.593)
  A4 10.000 [8.785, 11.215] (0.593)
───────────────────────────────────

Consecutive (Sequential) Comparisons of "A":
──────────────────────────────────────────────────────────────────────
 Contrast Estimate    S.E. df      t     p     Cohen’s d [95% CI of d]
──────────────────────────────────────────────────────────────────────
  A2 - A1   -0.500 (0.839) 28 -0.596 1.000      -0.298 [-1.571, 0.975]
  A3 - A2    3.125 (0.839) 28  3.727  .003 **    1.863 [ 0.590, 3.137]
  A4 - A3    3.000 (0.839) 28  3.578  .004 **    1.789 [ 0.516, 3.062]
──────────────────────────────────────────────────────────────────────
Pooled SD for computing Cohen’s d: 1.677
P-value adjustment: Bonferroni method for 3 tests.

Disclaimer:
By default, pooled SD is Root Mean Square Error (RMSE).
There is much disagreement on how to compute Cohen’s d.
You are completely responsible for setting `sd.pooled`.
You might also use `effectsize::t_to_d()` to compute d.

EMMEANS(m, "A", contrast="poly")

------ EMMEANS (effect = "A") ------

Joint Tests of "A":
────────────────────────────────────────────────────
 Effect df1 df2      F     p     η²p [90% CI of η²p]
────────────────────────────────────────────────────
      A   3  28 22.533 <.001 ***   .707 [.526, .798]
────────────────────────────────────────────────────
Note. Simple effects of repeated measures with 3 or more levels
are different from the results obtained with SPSS MANOVA syntax.

Univariate Tests of "A":
─────────────────────────────────────────────────────────
           Sum of Squares df Mean Square      F     p    
─────────────────────────────────────────────────────────
Mean: "A"         190.125  3      63.375 22.533 <.001 ***
Residuals          78.750 28       2.812                 
─────────────────────────────────────────────────────────
Note. Identical to the results obtained with SPSS GLM EMMEANS syntax.

Estimated Marginal Means of "A":
───────────────────────────────────
 "A"  Mean [95% CI of Mean]    S.E.
───────────────────────────────────
  A1  4.375 [3.160,  5.590] (0.593)
  A2  3.875 [2.660,  5.090] (0.593)
  A3  7.000 [5.785,  8.215] (0.593)
  A4 10.000 [8.785, 11.215] (0.593)
───────────────────────────────────

Polynomial Contrasts of "A":
───────────────────────────────────────────────
  Contrast Estimate    S.E. df      t     p    
───────────────────────────────────────────────
 linear      20.000 (2.652) 28  7.542 <.001 ***
 quadratic    3.500 (1.186) 28  2.951  .006 ** 
 cubic       -3.750 (2.652) 28 -1.414  .168    
───────────────────────────────────────────────


Disclaimer:
By default, pooled SD is Root Mean Square Error (RMSE).
There is much disagreement on how to compute Cohen’s d.
You are completely responsible for setting `sd.pooled`.
You might also use `effectsize::t_to_d()` to compute d.

【探索发现】多重比较的p值校正方法

p.adjust参数

"none"（无校正）
"fdr"
"hochberg"
"hommel"
"holm"
"tukey"
"mvt"
"dunnettx"
"sidak"
"scheffe"
"bonferroni"（默认，最严格）
- Bonferroni校正：直接将原始p值与多重比较次数n相乘，得到校正后的p值
  - 比如，3个条件之间的两两比较组合有C(3, 2) = 3次，某效应的原始p = .04，校正后p = .04 × 3 = .12，不再显著

简单效应检验

【实践5】组间设计ANOVA的简单效应检验

EMMEANS()函数帮助文档（Estimated Marginal Means，估计边际均值）

m = MANOVA(between.2, dv="SCORE", between=c("A", "B"))


====== ANOVA (Between-Subjects Design) ======

Descriptives:
─────────────────────────
 "A" "B"   Mean    S.D. n
─────────────────────────
  A1  B1  4.000 (1.414) 4
  A1  B2  4.000 (1.633) 4
  A1  B3  4.750 (2.062) 4
  A2  B1  3.750 (0.957) 4
  A2  B2  8.000 (0.816) 4
  A2  B3 12.000 (0.816) 4
─────────────────────────
Total sample size: N = 24

ANOVA Table:
Dependent variable(s):      SCORE
Between-subjects factor(s): A, B
Within-subjects factor(s):  –
Covariate(s):               –
─────────────────────────────────────────────────────────────────────
           MS   MSE df1 df2      F     p     η²p [90% CI of η²p]  η²G
─────────────────────────────────────────────────────────────────────
A      80.667 1.861   1  18 43.343 <.001 ***   .707 [.482, .817] .707
B      40.542 1.861   2  18 21.784 <.001 ***   .708 [.470, .815] .708
A * B  28.292 1.861   2  18 15.201 <.001 ***   .628 [.347, .763] .628
─────────────────────────────────────────────────────────────────────
MSE = mean square error (the residual variance of the linear model)
η²p = partial eta-squared = SS / (SS + SSE) = F * df1 / (F * df1 + df2)
ω²p = partial omega-squared = (F - 1) * df1 / (F * df1 + df2 + 1)
η²G = generalized eta-squared (see Olejnik & Algina, 2003)
Cohen’s f² = η²p / (1 - η²p)

Levene’s Test for Homogeneity of Variance:
───────────────────────────────────────
           Levene’s F df1 df2     p    
───────────────────────────────────────
DV: SCORE       0.605   5  18  .697    
───────────────────────────────────────

emmip(m, ~ A | B, CIs=TRUE)

EMMEANS(m, "A", by="B")

------ EMMEANS (effect = "A") ------

Joint Tests of "A":
────────────────────────────────────────────────────────
 Effect "B" df1 df2      F     p     η²p [90% CI of η²p]
────────────────────────────────────────────────────────
      A  B1   1  18  0.067  .798       .004 [.000, .137]
      A  B2   1  18 17.194 <.001 ***   .489 [.198, .674]
      A  B3   1  18 56.485 <.001 ***   .758 [.564, .849]
────────────────────────────────────────────────────────
Note. Simple effects of repeated measures with 3 or more levels
are different from the results obtained with SPSS MANOVA syntax.

Univariate Tests of "A":
─────────────────────────────────────────────────────────
           Sum of Squares df Mean Square      F     p    
─────────────────────────────────────────────────────────
B1: "A"             0.125  1       0.125  0.067  .798    
B2: "A"            32.000  1      32.000 17.194 <.001 ***
B3: "A"           105.125  1     105.125 56.485 <.001 ***
Residuals          33.500 18       1.861                 
─────────────────────────────────────────────────────────
Note. Identical to the results obtained with SPSS GLM EMMEANS syntax.

Estimated Marginal Means of "A":
────────────────────────────────────────
 "A" "B"   Mean [95% CI of Mean]    S.E.
────────────────────────────────────────
  A1  B1  4.000 [ 2.567,  5.433] (0.682)
  A2  B1  3.750 [ 2.317,  5.183] (0.682)
  A1  B2  4.000 [ 2.567,  5.433] (0.682)
  A2  B2  8.000 [ 6.567,  9.433] (0.682)
  A1  B3  4.750 [ 3.317,  6.183] (0.682)
  A2  B3 12.000 [10.567, 13.433] (0.682)
────────────────────────────────────────

Pairwise Comparisons of "A":
──────────────────────────────────────────────────────────────────────────
 Contrast "B" Estimate    S.E. df      t     p     Cohen’s d [95% CI of d]
──────────────────────────────────────────────────────────────────────────
  A2 - A1  B1   -0.250 (0.965) 18 -0.259  .798      -0.183 [-1.669, 1.302]
  A2 - A1  B2    4.000 (0.965) 18  4.147 <.001 ***   2.932 [ 1.446, 4.418]
  A2 - A1  B3    7.250 (0.965) 18  7.516 <.001 ***   5.314 [ 3.829, 6.800]
──────────────────────────────────────────────────────────────────────────
Pooled SD for computing Cohen’s d: 1.364
No need to adjust p values.

Disclaimer:
By default, pooled SD is Root Mean Square Error (RMSE).
There is much disagreement on how to compute Cohen’s d.
You are completely responsible for setting `sd.pooled`.
You might also use `effectsize::t_to_d()` to compute d.

emmip(m, ~ B | A, CIs=TRUE)

EMMEANS(m, "B", by="A")

------ EMMEANS (effect = "B") ------

Joint Tests of "B":
────────────────────────────────────────────────────────
 Effect "A" df1 df2      F     p     η²p [90% CI of η²p]
────────────────────────────────────────────────────────
      B  A1   2  18  0.403  .674       .043 [.000, .205]
      B  A2   2  18 36.582 <.001 ***   .803 [.631, .876]
────────────────────────────────────────────────────────
Note. Simple effects of repeated measures with 3 or more levels
are different from the results obtained with SPSS MANOVA syntax.

Univariate Tests of "B":
─────────────────────────────────────────────────────────
           Sum of Squares df Mean Square      F     p    
─────────────────────────────────────────────────────────
A1: "B"             1.500  2       0.750  0.403  .674    
A2: "B"           136.167  2      68.083 36.582 <.001 ***
Residuals          33.500 18       1.861                 
─────────────────────────────────────────────────────────
Note. Identical to the results obtained with SPSS GLM EMMEANS syntax.

Estimated Marginal Means of "B":
────────────────────────────────────────
 "B" "A"   Mean [95% CI of Mean]    S.E.
────────────────────────────────────────
  B1  A1  4.000 [ 2.567,  5.433] (0.682)
  B2  A1  4.000 [ 2.567,  5.433] (0.682)
  B3  A1  4.750 [ 3.317,  6.183] (0.682)
  B1  A2  3.750 [ 2.317,  5.183] (0.682)
  B2  A2  8.000 [ 6.567,  9.433] (0.682)
  B3  A2 12.000 [10.567, 13.433] (0.682)
────────────────────────────────────────

Pairwise Comparisons of "B":
──────────────────────────────────────────────────────────────────────────
 Contrast "A" Estimate    S.E. df      t     p     Cohen’s d [95% CI of d]
──────────────────────────────────────────────────────────────────────────
  B2 - B1  A1   -0.000 (0.965) 18 -0.000 1.000      -0.000 [-1.866, 1.866]
  B3 - B1  A1    0.750 (0.965) 18  0.777 1.000       0.550 [-1.316, 2.416]
  B3 - B2  A1    0.750 (0.965) 18  0.777 1.000       0.550 [-1.316, 2.416]
  B2 - B1  A2    4.250 (0.965) 18  4.406  .001 **    3.115 [ 1.249, 4.981]
  B3 - B1  A2    8.250 (0.965) 18  8.552 <.001 ***   6.047 [ 4.181, 7.914]
  B3 - B2  A2    4.000 (0.965) 18  4.147  .002 **    2.932 [ 1.066, 4.798]
──────────────────────────────────────────────────────────────────────────
Pooled SD for computing Cohen’s d: 1.364
P-value adjustment: Bonferroni method for 3 tests.

Disclaimer:
By default, pooled SD is Root Mean Square Error (RMSE).
There is much disagreement on how to compute Cohen’s d.
You are completely responsible for setting `sd.pooled`.
You might also use `effectsize::t_to_d()` to compute d.

## 使用管道操作符 %>% 连接多个 EMMEANS()
MANOVA(between.3, dv="SCORE", between=c("A", "B", "C")) %>%
  EMMEANS("A", by="B") %>%
  EMMEANS(c("A", "B"), by="C") %>%
  EMMEANS("A", by=c("B", "C"))


====== ANOVA (Between-Subjects Design) ======

Descriptives:
─────────────────────────────
 "A" "B" "C"   Mean    S.D. n
─────────────────────────────
  A1  B1  C1  4.000 (1.414) 4
  A1  B1  C2  4.750 (2.062) 4
  A1  B2  C1  4.000 (1.633) 4
  A1  B2  C2  3.750 (0.957) 4
  A2  B1  C1  8.000 (0.816) 4
  A2  B1  C2  6.000 (0.816) 4
  A2  B2  C1  8.000 (0.816) 4
  A2  B2  C2 12.000 (0.816) 4
─────────────────────────────
Total sample size: N = 32

ANOVA Table:
Dependent variable(s):      SCORE
Between-subjects factor(s): A, B, C
Within-subjects factor(s):  –
Covariate(s):               –
──────────────────────────────────────────────────────────────────────────
                MS   MSE df1 df2      F     p     η²p [90% CI of η²p]  η²G
──────────────────────────────────────────────────────────────────────────
A          153.125 1.563   1  24 98.000 <.001 ***   .803 [.670, .870] .803
B           12.500 1.563   1  24  8.000  .009 **    .250 [.042, .466] .250
C            3.125 1.563   1  24  2.000  .170       .077 [.000, .283] .077
A * B       24.500 1.563   1  24 15.680 <.001 ***   .395 [.147, .585] .395
A * C        1.125 1.563   1  24  0.720  .405       .029 [.000, .206] .029
B * C       12.500 1.563   1  24  8.000  .009 **    .250 [.042, .466] .250
A * B * C   24.500 1.563   1  24 15.680 <.001 ***   .395 [.147, .585] .395
──────────────────────────────────────────────────────────────────────────
MSE = mean square error (the residual variance of the linear model)
η²p = partial eta-squared = SS / (SS + SSE) = F * df1 / (F * df1 + df2)
ω²p = partial omega-squared = (F - 1) * df1 / (F * df1 + df2 + 1)
η²G = generalized eta-squared (see Olejnik & Algina, 2003)
Cohen’s f² = η²p / (1 - η²p)

Levene’s Test for Homogeneity of Variance:
───────────────────────────────────────
           Levene’s F df1 df2     p    
───────────────────────────────────────
DV: SCORE       0.668   7  24  .697    
───────────────────────────────────────

------ EMMEANS (effect = "A") ------

Joint Tests of "A":
────────────────────────────────────────────────────────
 Effect "B" df1 df2      F     p     η²p [90% CI of η²p]
────────────────────────────────────────────────────────
  A      B1   1  24 17.640 <.001 ***   .424 [.173, .607]
  A      B2   1  24 96.040 <.001 ***   .800 [.665, .868]
  C      B1   1  24  1.000  .327       .040 [.000, .226]
  C      B2   1  24  9.000  .006 **    .273 [.055, .486]
  A * C  B1   1  24  4.840  .038 *     .168 [.006, .388]
  A * C  B2   1  24 11.560  .002 **    .325 [.090, .530]
────────────────────────────────────────────────────────
Note. Simple effects of repeated measures with 3 or more levels
are different from the results obtained with SPSS MANOVA syntax.

Univariate Tests of "A":
─────────────────────────────────────────────────────────
           Sum of Squares df Mean Square      F     p    
─────────────────────────────────────────────────────────
B1: "A"            27.562  1      27.562 17.640 <.001 ***
B2: "A"           150.063  1     150.063 96.040 <.001 ***
Residuals          37.500 24       1.563                 
─────────────────────────────────────────────────────────
Note. Identical to the results obtained with SPSS GLM EMMEANS syntax.

Estimated Marginal Means of "A":
───────────────────────────────────────
 "A" "B"  Mean [95% CI of Mean]    S.E.
───────────────────────────────────────
  A1  B1  4.375 [3.463,  5.287] (0.442)
  A2  B1  7.000 [6.088,  7.912] (0.442)
  A1  B2  3.875 [2.963,  4.787] (0.442)
  A2  B2 10.000 [9.088, 10.912] (0.442)
───────────────────────────────────────

Pairwise Comparisons of "A":
─────────────────────────────────────────────────────────────────────────
 Contrast "B" Estimate    S.E. df     t     p     Cohen’s d [95% CI of d]
─────────────────────────────────────────────────────────────────────────
  A2 - A1  B1    2.625 (0.625) 24 4.200 <.001 ***    2.100 [1.068, 3.132]
  A2 - A1  B2    6.125 (0.625) 24 9.800 <.001 ***    4.900 [3.868, 5.932]
─────────────────────────────────────────────────────────────────────────
Pooled SD for computing Cohen’s d: 1.250
Results are averaged over the levels of: C
No need to adjust p values.

Disclaimer:
By default, pooled SD is Root Mean Square Error (RMSE).
There is much disagreement on how to compute Cohen’s d.
You are completely responsible for setting `sd.pooled`.
You might also use `effectsize::t_to_d()` to compute d.

------ EMMEANS (effect = "A" & "B") ------

Joint Tests of "A" & "B":
────────────────────────────────────────────────────────
 Effect "C" df1 df2      F     p     η²p [90% CI of η²p]
────────────────────────────────────────────────────────
  A      C1   1  24 40.960 <.001 ***   .631 [.414, .754]
  A      C2   1  24 57.760 <.001 ***   .706 [.521, .806]
  B      C1   1  24  0.000 1.000       .000 [.000, .000]
  B      C2   1  24 16.000 <.001 ***   .400 [.151, .589]
  A * B  C1   1  24  0.000 1.000       .000 [.000, .000]
  A * B  C2   1  24 31.360 <.001 ***   .566 [.331, .710]
────────────────────────────────────────────────────────
Note. Simple effects of repeated measures with 3 or more levels
are different from the results obtained with SPSS MANOVA syntax.

Univariate Tests of "A" & "B":
─────────────────────────────────────────────────────────────
               Sum of Squares df Mean Square      F     p    
─────────────────────────────────────────────────────────────
C1: "A" & "B"           0.000  1       0.000  0.000 1.000    
C2: "A" & "B"          49.000  1      49.000 31.360 <.001 ***
Residuals              37.500 24       1.563                 
─────────────────────────────────────────────────────────────
Note. Identical to the results obtained with SPSS GLM EMMEANS syntax.

Estimated Marginal Means of "A" & "B":
────────────────────────────────────────
 "A" "B"   Mean [95% CI of Mean]    S.E.
────────────────────────────────────────
  A1  B1  4.000 [ 2.710,  5.290] (0.625)
  A2  B1  8.000 [ 6.710,  9.290] (0.625)
  A1  B2  4.000 [ 2.710,  5.290] (0.625)
  A2  B2  8.000 [ 6.710,  9.290] (0.625)
  A1  B1  4.750 [ 3.460,  6.040] (0.625)
  A2  B1  6.000 [ 4.710,  7.290] (0.625)
  A1  B2  3.750 [ 2.460,  5.040] (0.625)
  A2  B2 12.000 [10.710, 13.290] (0.625)
────────────────────────────────────────

Pairwise Comparisons of "A" & "B":
───────────────────────────────────────────────────────────────────────────────
      Contrast "C" Estimate    S.E. df      t     p     Cohen’s d [95% CI of d]
───────────────────────────────────────────────────────────────────────────────
 A2 B1 - A1 B1  C1    4.000 (0.884) 24  4.525 <.001 ***  3.200 [ 1.167,  5.233]
 A1 B2 - A1 B1  C1   -0.000 (0.884) 24 -0.000 1.000     -0.000 [-2.033,  2.033]
 A1 B2 - A2 B1  C1   -4.000 (0.884) 24 -4.525 <.001 *** -3.200 [-5.233, -1.167]
 A2 B2 - A1 B1  C1    4.000 (0.884) 24  4.525 <.001 ***  3.200 [ 1.167,  5.233]
 A2 B2 - A2 B1  C1   -0.000 (0.884) 24 -0.000 1.000     -0.000 [-2.033,  2.033]
 A2 B2 - A1 B2  C1    4.000 (0.884) 24  4.525 <.001 ***  3.200 [ 1.167,  5.233]
 A2 B1 - A1 B1  C2    1.250 (0.884) 24  1.414 1.000      1.000 [-1.033,  3.033]
 A1 B2 - A1 B1  C2   -1.000 (0.884) 24 -1.131 1.000     -0.800 [-2.833,  1.233]
 A1 B2 - A2 B1  C2   -2.250 (0.884) 24 -2.546  .107     -1.800 [-3.833,  0.233]
 A2 B2 - A1 B1  C2    7.250 (0.884) 24  8.202 <.001 ***  5.800 [ 3.767,  7.833]
 A2 B2 - A2 B1  C2    6.000 (0.884) 24  6.788 <.001 ***  4.800 [ 2.767,  6.833]
 A2 B2 - A1 B2  C2    8.250 (0.884) 24  9.334 <.001 ***  6.600 [ 4.567,  8.633]
───────────────────────────────────────────────────────────────────────────────
Pooled SD for computing Cohen’s d: 1.250
P-value adjustment: Bonferroni method for 6 tests.

Disclaimer:
By default, pooled SD is Root Mean Square Error (RMSE).
There is much disagreement on how to compute Cohen’s d.
You are completely responsible for setting `sd.pooled`.
You might also use `effectsize::t_to_d()` to compute d.

------ EMMEANS (effect = "A") ------

Joint Tests of "A":
────────────────────────────────────────────────────────────
 Effect "B" "C" df1 df2      F     p     η²p [90% CI of η²p]
────────────────────────────────────────────────────────────
      A  B1  C1   1  24 20.480 <.001 ***   .460 [.210, .634]
      A  B2  C1   1  24 20.480 <.001 ***   .460 [.210, .634]
      A  B1  C2   1  24  2.000  .170       .077 [.000, .283]
      A  B2  C2   1  24 87.120 <.001 ***   .784 [.639, .858]
────────────────────────────────────────────────────────────
Note. Simple effects of repeated measures with 3 or more levels
are different from the results obtained with SPSS MANOVA syntax.

Univariate Tests of "A":
────────────────────────────────────────────────────────────
              Sum of Squares df Mean Square      F     p    
────────────────────────────────────────────────────────────
B1 & C1: "A"          32.000  1      32.000 20.480 <.001 ***
B2 & C1: "A"          32.000  1      32.000 20.480 <.001 ***
B1 & C2: "A"           3.125  1       3.125  2.000  .170    
B2 & C2: "A"         136.125  1     136.125 87.120 <.001 ***
Residuals             37.500 24       1.563                 
────────────────────────────────────────────────────────────
Note. Identical to the results obtained with SPSS GLM EMMEANS syntax.

Estimated Marginal Means of "A":
────────────────────────────────────────────
 "A" "B" "C"   Mean [95% CI of Mean]    S.E.
────────────────────────────────────────────
  A1  B1  C1  4.000 [ 2.710,  5.290] (0.625)
  A2  B1  C1  8.000 [ 6.710,  9.290] (0.625)
  A1  B2  C1  4.000 [ 2.710,  5.290] (0.625)
  A2  B2  C1  8.000 [ 6.710,  9.290] (0.625)
  A1  B1  C2  4.750 [ 3.460,  6.040] (0.625)
  A2  B1  C2  6.000 [ 4.710,  7.290] (0.625)
  A1  B2  C2  3.750 [ 2.460,  5.040] (0.625)
  A2  B2  C2 12.000 [10.710, 13.290] (0.625)
────────────────────────────────────────────

Pairwise Comparisons of "A":
─────────────────────────────────────────────────────────────────────────────
 Contrast "B" "C" Estimate    S.E. df     t     p     Cohen’s d [95% CI of d]
─────────────────────────────────────────────────────────────────────────────
  A2 - A1  B1  C1    4.000 (0.884) 24 4.525 <.001 ***   3.200 [ 1.741, 4.659]
  A2 - A1  B2  C1    4.000 (0.884) 24 4.525 <.001 ***   3.200 [ 1.741, 4.659]
  A2 - A1  B1  C2    1.250 (0.884) 24 1.414  .170       1.000 [-0.459, 2.459]
  A2 - A1  B2  C2    8.250 (0.884) 24 9.334 <.001 ***   6.600 [ 5.141, 8.059]
─────────────────────────────────────────────────────────────────────────────
Pooled SD for computing Cohen’s d: 1.250
No need to adjust p values.

Disclaimer:
By default, pooled SD is Root Mean Square Error (RMSE).
There is much disagreement on how to compute Cohen’s d.
You are completely responsible for setting `sd.pooled`.
You might also use `effectsize::t_to_d()` to compute d.

* 拓展：特殊情况

【实践6】交互作用显著，但A的两个简单效应都不显著

data1 = data.table(
  A = c(1, 1, 1, 1, 2, 2, 2, 2),
  B = c(1, 1, 2, 2, 1, 1, 2, 2),
  Y = c(0, 7, 10, 12, 12, 10, 7, 0)
)
m = MANOVA(data1, dv="Y", between=c("A", "B"))


====== ANOVA (Between-Subjects Design) ======

Descriptives:
─────────────────────────
 "A" "B"   Mean    S.D. n
─────────────────────────
  A1  B1  3.500 (4.950) 2
  A1  B2 11.000 (1.414) 2
  A2  B1 11.000 (1.414) 2
  A2  B2  3.500 (4.950) 2
─────────────────────────
Total sample size: N = 8

ANOVA Table:
Dependent variable(s):      Y
Between-subjects factor(s): A, B
Within-subjects factor(s):  –
Covariate(s):               –
──────────────────────────────────────────────────────────────────────
            MS    MSE df1 df2     F     p     η²p [90% CI of η²p]  η²G
──────────────────────────────────────────────────────────────────────
A        0.000 13.250   1   4 0.000 1.000       .000 [.000, .000] .000
B        0.000 13.250   1   4 0.000 1.000       .000 [.000, .000] .000
A * B  112.500 13.250   1   4 8.491  .044 *     .680 [.025, .867] .680
──────────────────────────────────────────────────────────────────────
MSE = mean square error (the residual variance of the linear model)
η²p = partial eta-squared = SS / (SS + SSE) = F * df1 / (F * df1 + df2)
ω²p = partial omega-squared = (F - 1) * df1 / (F * df1 + df2 + 1)
η²G = generalized eta-squared (see Olejnik & Algina, 2003)
Cohen’s f² = η²p / (1 - η²p)

Levene’s Test for Homogeneity of Variance:

Warning in anova.lm(lm(resp ~ group)): 对几乎是完全拟合进行ANOVA
F-检验的结果不会可靠

─────────────────────────────────────────────────────────────
                                 Levene’s F df1 df2     p    
─────────────────────────────────────────────────────────────
DV: Y  11361861823696222742664246882006.000   3   4 <.001 ***
─────────────────────────────────────────────────────────────

emmip(m, B ~ A, CIs=TRUE)

EMMEANS(m, "A", by="B")

------ EMMEANS (effect = "A") ------

Joint Tests of "A":
───────────────────────────────────────────────────────
 Effect "B" df1 df2     F     p     η²p [90% CI of η²p]
───────────────────────────────────────────────────────
      A  B1   1   4 4.245  .108       .515 [.000, .798]
      A  B2   1   4 4.245  .108       .515 [.000, .798]
───────────────────────────────────────────────────────
Note. Simple effects of repeated measures with 3 or more levels
are different from the results obtained with SPSS MANOVA syntax.

Univariate Tests of "A":
────────────────────────────────────────────────────────
           Sum of Squares df Mean Square     F     p    
────────────────────────────────────────────────────────
B1: "A"            56.250  1      56.250 4.245  .108    
B2: "A"            56.250  1      56.250 4.245  .108    
Residuals          53.000  4      13.250                
────────────────────────────────────────────────────────
Note. Identical to the results obtained with SPSS GLM EMMEANS syntax.

Estimated Marginal Means of "A":
────────────────────────────────────────
 "A" "B"   Mean [95% CI of Mean]    S.E.
────────────────────────────────────────
  A1  B1  3.500 [-3.646, 10.646] (2.574)
  A2  B1 11.000 [ 3.854, 18.146] (2.574)
  A1  B2 11.000 [ 3.854, 18.146] (2.574)
  A2  B2  3.500 [-3.646, 10.646] (2.574)
────────────────────────────────────────

Pairwise Comparisons of "A":
──────────────────────────────────────────────────────────────────────────
 Contrast "B" Estimate    S.E. df      t     p     Cohen’s d [95% CI of d]
──────────────────────────────────────────────────────────────────────────
  A2 - A1  B1    7.500 (3.640)  4  2.060  .108       2.060 [-0.716, 4.837]
  A2 - A1  B2   -7.500 (3.640)  4 -2.060  .108      -2.060 [-4.837, 0.716]
──────────────────────────────────────────────────────────────────────────
Pooled SD for computing Cohen’s d: 3.640
No need to adjust p values.

Disclaimer:
By default, pooled SD is Root Mean Square Error (RMSE).
There is much disagreement on how to compute Cohen’s d.
You are completely responsible for setting `sd.pooled`.
You might also use `effectsize::t_to_d()` to compute d.

【实践7】交互作用不显著，但A的简单效应一个显著、一个不显著

data2 = data.table(
  A = c(1, 1, 1, 1, 2, 2, 2, 2),
  B = c(1, 1, 2, 2, 1, 1, 2, 2),
  Y = c(0, 1, 0, 4, 5, 6, 2, 4)
)
m = MANOVA(data2, dv="Y", between=c("A", "B"))


====== ANOVA (Between-Subjects Design) ======

Descriptives:
────────────────────────
 "A" "B"  Mean    S.D. n
────────────────────────
  A1  B1 0.500 (0.707) 2
  A1  B2 2.000 (2.828) 2
  A2  B1 5.500 (0.707) 2
  A2  B2 3.000 (1.414) 2
────────────────────────
Total sample size: N = 8

ANOVA Table:
Dependent variable(s):      Y
Between-subjects factor(s): A, B
Within-subjects factor(s):  –
Covariate(s):               –
────────────────────────────────────────────────────────────────────
           MS   MSE df1 df2     F     p     η²p [90% CI of η²p]  η²G
────────────────────────────────────────────────────────────────────
A      18.000 2.750   1   4 6.545  .063 .     .621 [.000, .843] .621
B       0.500 2.750   1   4 0.182  .692       .043 [.000, .495] .043
A * B   8.000 2.750   1   4 2.909  .163       .421 [.000, .756] .421
────────────────────────────────────────────────────────────────────
MSE = mean square error (the residual variance of the linear model)
η²p = partial eta-squared = SS / (SS + SSE) = F * df1 / (F * df1 + df2)
ω²p = partial omega-squared = (F - 1) * df1 / (F * df1 + df2 + 1)
η²G = generalized eta-squared (see Olejnik & Algina, 2003)
Cohen’s f² = η²p / (1 - η²p)

Levene’s Test for Homogeneity of Variance:

Warning in anova.lm(lm(resp ~ group)): 对几乎是完全拟合进行ANOVA
F-检验的结果不会可靠

─────────────────────────────────────────────────────────────
                                 Levene’s F df1 df2     p    
─────────────────────────────────────────────────────────────
DV: Y  13645983859487056935286622800820.000   3   4 <.001 ***
─────────────────────────────────────────────────────────────

emmip(m, B ~ A, CIs=TRUE)

EMMEANS(m, "A", by="B")

------ EMMEANS (effect = "A") ------

Joint Tests of "A":
───────────────────────────────────────────────────────
 Effect "B" df1 df2     F     p     η²p [90% CI of η²p]
───────────────────────────────────────────────────────
      A  B1   1   4 9.091  .039 *     .694 [.043, .874]
      A  B2   1   4 0.364  .579       .083 [.000, .551]
───────────────────────────────────────────────────────
Note. Simple effects of repeated measures with 3 or more levels
are different from the results obtained with SPSS MANOVA syntax.

Univariate Tests of "A":
────────────────────────────────────────────────────────
           Sum of Squares df Mean Square     F     p    
────────────────────────────────────────────────────────
B1: "A"            25.000  1      25.000 9.091  .039 *  
B2: "A"             1.000  1       1.000 0.364  .579    
Residuals          11.000  4       2.750                
────────────────────────────────────────────────────────
Note. Identical to the results obtained with SPSS GLM EMMEANS syntax.

Estimated Marginal Means of "A":
──────────────────────────────────────
 "A" "B" Mean [95% CI of Mean]    S.E.
──────────────────────────────────────
  A1  B1 0.500 [-2.756, 3.756] (1.173)
  A2  B1 5.500 [ 2.244, 8.756] (1.173)
  A1  B2 2.000 [-1.256, 5.256] (1.173)
  A2  B2 3.000 [-0.256, 6.256] (1.173)
──────────────────────────────────────

Pairwise Comparisons of "A":
─────────────────────────────────────────────────────────────────────────
 Contrast "B" Estimate    S.E. df     t     p     Cohen’s d [95% CI of d]
─────────────────────────────────────────────────────────────────────────
  A2 - A1  B1    5.000 (1.658)  4 3.015  .039 *     3.015 [ 0.239, 5.792]
  A2 - A1  B2    1.000 (1.658)  4 0.603  .579       0.603 [-2.173, 3.379]
─────────────────────────────────────────────────────────────────────────
Pooled SD for computing Cohen’s d: 1.658
No need to adjust p values.

Disclaimer:
By default, pooled SD is Root Mean Square Error (RMSE).
There is much disagreement on how to compute Cohen’s d.
You are completely responsible for setting `sd.pooled`.
You might also use `effectsize::t_to_d()` to compute d.

【作业8】方差分析练习

作业要求：

基于【作业4】和【作业6】的期末自选数据和代码积累，运用本章所学的方差分析方法和代码，练习方差分析（根据自己的数据情况选择最合适的一种方差分析类型）
使用R Markdown完成，对关键代码及结果要有注释说明

平台提交：

运行得到的HTML网页，及其关键部分截图

LS0tDQp0aXRsZTogIuOAilLor63oqIDjgIvnrKw456ug77ya5pa55beu5YiG5p6QIg0Kc3VidGl0bGU6IDxhIGhyZWY9Imh0dHBzOi8vcHN5Y2hicnVjZS5naXRodWIuaW8vUkNvdXJzZS8iPui/lOWbnuivvueoi+S4u+mhtTwvYT4NCmF1dGhvcjogIuaOiOivvuaVmeW4iO+8muWMheWvkuWQtOmcnCINCiMgZGF0ZTogImByIFN5cy5EYXRlKClgIg0Kb3V0cHV0Og0KICBodG1sX2RvY3VtZW50Og0KICAgIHRvYzogdHJ1ZQ0KICAgIHRvY19kZXB0aDogMw0KICAgIHRvY19mbG9hdDoNCiAgICAgIGNvbGxhcHNlZDogZmFsc2UNCiAgICAgIHNtb290aF9zY3JvbGw6IGZhbHNlDQogICAgY29kZV9kb3dubG9hZDogdHJ1ZQ0KICAgIGFuY2hvcl9zZWN0aW9uczogdHJ1ZQ0KICAgIGhpZ2hsaWdodDogcHlnbWVudHMNCiAgICBjc3M6IFJtZENTUy5jc3MNCi0tLQ0KDQpgYGB7PWh0bWx9DQo8cCBzdHlsZT0iZm9udC1zaXplOiAxMnB4Ij7niYjmnYPlo7DmmI7vvJrmnKzlpZfor77nqIvmnZDmlpnlvIDmupDvvIzkvb/nlKjlkozliIbkuqvlv4XpobvpgbXlrojjgIzliJvkvZzlhbHnlKjorrjlj6/ljY/orq4gQ0MgQlktTkMtU0HjgI3vvIjmnaXmupDlvJXnlKgt6Z2e5ZWG5Lia55So6YCU5L2/55SoLeS7peebuOWQjOaWueW8j+WFseS6q++8ieOAgjxpbWcgc3JjPSJpbWcvQ0MtQlktTkMtU0EuanBnIiB3aWR0aD0iMTIwcHgiIGhlaWdodD0iNDJweCIgc3R5bGU9ImZsb2F0OiByaWdodCIgLz48L3A+DQpgYGANCg0KYGBge3IgQ29uZmlnLCBpbmNsdWRlPUZBTFNFfQ0Kb3B0aW9ucygNCiAga25pdHIua2FibGUuTkEgPSAiIiwNCiAgZGlnaXRzID0gNA0KKQ0Ka25pdHI6Om9wdHNfY2h1bmskc2V0KA0KICBjb21tZW50ID0gIiIsDQogIGZpZy53aWR0aCA9IDYsDQogIGZpZy5oZWlnaHQgPSA0LA0KICBkcGkgPSAzMDANCikNCmBgYA0KDQotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0NCg0KIyBDaGFwMDjvvJrmlrnlt67liIbmnpANCg0KIyMjIyDlvoDmnJ/opoHngrnlm57pob4NCg0KLSAgIFtDaGFwMDcgXCMg5o+P6L+w57uf6K6h5LiO55u45YWz5YiG5p6QXShodHRwczovL3BzeWNoYnJ1Y2UuZ2l0aHViLmlvL1JDb3Vyc2UvQ2hhcDA3IyVFNiU4RiU4RiVFOCVCRiVCMCVFNyVCQiU5RiVFOCVBRSVBMSVFNCVCOCU4RSVFNyU5QiVCOCVFNSU4NSVCMyVFNSU4OCU4NiVFNiU5RSU5MCl7LnVyaX0NCi0gICBbQ2hhcDA3IFwjIHTmo4DpqoxdKGh0dHBzOi8vcHN5Y2hicnVjZS5naXRodWIuaW8vUkNvdXJzZS9DaGFwMDcjdCVFNiVBMyU4MCVFOSVBQSU4Qyl7LnVyaX0NCg0KIyMjIyDmnKznq6DopoHngrnnm67lvZUNCg0KLSAgIFvjgJDnn6Xor4bngrnjgJHmlrnlt67liIbmnpDvvIhBTk9WQe+8iee7n+iuoeacr+ivrV0oI+efpeivhueCueaWueW3ruWIhuaekGFub3Zh57uf6K6h5pyv6K+tKQ0KLSAgIFvjgJDlrp7ot7Ux44CR57uE6Ze06K6+6K6hQU5PVkFdKCPlrp7ot7Ux57uE6Ze06K6+6K6hYW5vdmEp77yI6YeN54K577yJDQotICAgW+OAkOWunui3tTLjgJHnu4TlhoXorr7orqFBTk9WQV0oI+Wunui3tTLnu4TlhoXorr7orqFhbm92YSkNCi0gICBb44CQ5a6e6Le1M+OAkea3t+WQiOiuvuiuoUFOT1ZBXSgj5a6e6Le1M+a3t+WQiOiuvuiuoWFub3ZhKQ0KLSAgIFvjgJDlrp7ot7U044CR57uE6Ze06K6+6K6hQU5PVkHnmoTlpJrph43mr5TovoNdKCPlrp7ot7U057uE6Ze06K6+6K6hYW5vdmHnmoTlpJrph43mr5TovoMp77yI6YeN54K577yJDQotICAgW+OAkOaOoue0ouWPkeeOsOOAkeWkmumHjeavlOi+g+eahHDlgLzmoKHmraPmlrnms5VdKCPmjqLntKLlj5HnjrDlpJrph43mr5TovoPnmoRw5YC85qCh5q2j5pa55rOVKQ0KLSAgIFvjgJDlrp7ot7U144CR57uE6Ze06K6+6K6hQU5PVkHnmoTnroDljZXmlYjlupTmo4DpqoxdKCPlrp7ot7U157uE6Ze06K6+6K6hYW5vdmHnmoTnroDljZXmlYjlupTmo4Dpqowp77yI6YeN54K577yJDQotICAgW+OAkOaOoue0ouWPkeeOsOOAkeWvueS6juS4pOWboOe0oOaWueW3ruWIhuaekO+8iEEgw5cgQu+8ie+8jOS7peS4i+aDheWGtemDveacieWPr+iDveWPkeeUn+WQl++8n10oI+aOoue0ouWPkeeOsOWvueS6juS4pOWboOe0oOaWueW3ruWIhuaekGEtYuS7peS4i+aDheWGtemDveacieWPr+iDveWPkeeUn+WQlykNCi0gICBb44CQ5a6e6Le1NuOAkeS6pOS6kuS9nOeUqOaYvuiRl++8jOS9hkHnmoTkuKTkuKrnroDljZXmlYjlupTpg73kuI3mmL7okZddKCPlrp7ot7U25Lqk5LqS5L2c55So5pi+6JGX5L2GYeeahOS4pOS4queugOWNleaViOW6lOmDveS4jeaYvuiRlykNCi0gICBb44CQ5a6e6Le1N+OAkeS6pOS6kuS9nOeUqOS4jeaYvuiRl++8jOS9hkHnmoTnroDljZXmlYjlupTkuIDkuKrmmL7okZfjgIHkuIDkuKrkuI3mmL7okZddKCPlrp7ot7U35Lqk5LqS5L2c55So5LiN5pi+6JGX5L2GYeeahOeugOWNleaViOW6lOS4gOS4quaYvuiRl+S4gOS4quS4jeaYvuiRlykNCg0KYGBge3IsIG1lc3NhZ2U9RkFMU0UsIHdhcm5pbmc9RkFMU0V9DQojIyDmnKznq6DmiYDpnIBS5YyFDQpsaWJyYXJ5KGJydWNlUikNCmBgYA0KDQojIOaWueW3ruWIhuaekOeahOe7n+iuoeefpeivhuWbnumhvg0KDQojIyMjIOOAkOefpeivhueCueOAkeaWueW3ruWIhuaekO+8iEFOT1ZB77yJ57uf6K6h5pyv6K+tIHsj55+l6K+G54K55pa55beu5YiG5p6QYW5vdmHnu5/orqHmnK/or619DQoNCiFb4oaRIOWbvua6kO+8mjxodHRwczovL3d3dy5uYXR1cmUuY29tL2FydGljbGVzL3M0MTU5OC0wMjMtNDcwNTctMD5dKGltYWdlcy9jbGlwYm9hcmQtMjM0MjA5MDk4MC5wbmcpDQoNCi0gICAqKuaWueW3ruWIhuaekEFOT1ZBKirvvIjku6UyIMOXIDIg4oCc6auY5L2O57uE5YirIMOXIOeUt+Wls+aAp+WIq+KAneS4pOWboOe0oOe7hOmXtOiuvuiuoUFOT1ZB5Li65L6L77yJDQogICAgLSAgICoq5Li75pWI5bqU77yIbWFpbiBlZmZlY3TvvIkqKg0KICAgICAgICAtICAg5Luj6KGo4oCc5bmz5Z2H5pWI5bqU4oCd77yM5p+Q5Liq5Zug57Sg5Zyo5YW25LuW5Zug57Sg5LiN5ZCM5p2h5Lu25LiL55qE6L656ZmF5bmz5Z2H5pWI5bqUDQogICAgICAgIC0gICBb5L6L77ya6auY57uE5ZKM5L2O57uE5LmL6Ze055qE5oC75L2T5beu5byC77yI5peg6K6655S35oCn5ZKM5aWz5oCn77yM57uE5Yir55qE5bmz5Z2H5pWI5bqU77yJXXsudW5kZXJsaW5lfQ0KICAgIC0gICAqKuS6pOS6kuS9nOeUqO+8iGludGVyYWN0aW9u77yJKioNCiAgICAgICAgLSAgIOS7o+ihqOKAnOaViOW6lOW3ruW8guKAne+8jOafkOS4quWboOe0oOWcqOWFtuS7luWboOe0oOS4jeWQjOadoeS7tuS4i+WtmOWcqOS4jeWQjOeahOaViOW6lA0KICAgICAgICAtICAgW+S+i++8mumrmOS9jue7hOmXtOeahOW3ruW8guWcqOeUt+aAp+WSjOWls+aAp+e+pOS9k+S5i+mXtOS5n+WtmOWcqOW3ruW8gu+8iOW3ruW8gueahOW3ruW8gu+8iV17LnVuZGVybGluZX0NCi0gICAqKuS6pOS6kuS9nOeUqOaYvuiRl+WQjueahOeugOWNleaViOW6lOajgOmqjCoqDQogICAgLSAgICoq566A5Y2V5pWI5bqU77yIc2ltcGxlIGVmZmVjdO+8iSoq77yM5Lmf56ew4oCc5p2h5Lu25pWI5bqU4oCd77yIY29uZGl0aW9uYWwgZWZmZWN077yJDQogICAgICAgIC0gICDpgJrluLjnibnmjIfvvJrnroDljZXkuLvmlYjlupTvvIhzaW1wbGUgbWFpbiBlZmZlY3TvvInvvIzkuZ/np7DigJzmnaHku7bkuLvmlYjlupTigJ3vvIhjb25kaXRpb25hbCBtYWluIGVmZmVjdO+8iQ0KICAgICAgICAtICAgW+S+i++8muWIhuWIq+WcqOeUt+aAp+aIluWls+aAp+e+pOS9k+S4re+8jOmrmOS9jue7hOmXtOeahOW3ruW8gu+8iOe7hOWIq+eahOeugOWNleS4u+aViOW6lO+8iV17LnVuZGVybGluZX0NCiAgICAtICAg77yI5ouT5bGV77yJ5LiJ6Zi25Lqk5LqS5L2c55So77yIQSDDlyBCIMOXIEPvvInkuK3nmoTlpI3mnYLmg4XlhrUNCiAgICAgICAgLSAgIOeugOWNleS6pOS6kuS9nOeUqO+8iHNpbXBsZSBpbnRlcmFjdGlvbu+8ie+8mkPkuI3lkIzmnaHku7bkuIvnmoRBIMOXIELnroDljZXkuqTkupLkvZznlKgNCiAgICAgICAgLSAgIOeugOWNleeugOWNleaViOW6lO+8iHNpbXBsZS1zaW1wbGUgZWZmZWN077yJ77yaQuWSjEPkuI3lkIznu4TlkIjmnaHku7bkuIvnmoRB566A5Y2V5Li75pWI5bqUDQotICAgKirmn5DkuKrlm6DntKDlpJrkuKrmnaHku7bpl7TvvIjiiaUgM++8ieeahOS4pOS4pOWvueavlCoqDQogICAgLSAgIOS6i+WQjuajgOmqjO+8iHBvc3QtaG9jIHRlc3TvvIkNCiAgICAgICAgLSAgIOmAmuW4uOeJueaMh++8mioq5LqL5ZCO5aSa6YeN5q+U6L6D77yIcG9zdC1ob2MgbXVsdGlwbGUgY29tcGFyaXNvbu+8iSoqDQogICAgICAgIC0gICDpnIDopoHlr7kqcCrlgLzlgZoqKuKAnOWkmumHjeavlOi+g+agoeato+KAne+8iGFkanVzdCAqcCotdmFsdWVzIGZvciBtdWx0aXBsZSBjb21wYXJpc29uc++8iSoq5Lul6ZmN5L2O5YGH6Ziz5oCn5qaC546H77yIZmFsc2UgZGlzY292ZXJ5IHJhdGUsIEZEUu+8iQ0KDQohW10oaW1hZ2VzL2NsaXBib2FyZC0zNTM4MzE3MjIucG5nKQ0KDQojIOWkmuWboOe0oOaWueW3ruWIhuaekA0KDQohW10oaW1hZ2VzL2NsaXBib2FyZC0xMjM3ODM1NTgxLnBuZykNCg0KIyMg5a6M5YWo6ZqP5py6L+e7hOmXtOiuvuiuoUFOT1ZBDQoNCiMjIyMg44CQ5a6e6Le1MeOAkee7hOmXtOiuvuiuoUFOT1ZBIHsj5a6e6Le1Mee7hOmXtOiuvuiuoWFub3ZhfQ0KDQotICAgW2BNQU5PVkEoKWDlh73mlbDluK7liqnmlofmoaNdKGh0dHBzOi8vcHN5Y2hicnVjZS5naXRodWIuaW8vYnJ1Y2VSL3JlZmVyZW5jZS9NQU5PVkEuaHRtbCl7LnVyaX0NCg0KYGBge3J9DQpiZXR3ZWVuLjEgICMg5Y2V5Zug57Sg5Zub5rC05bmz57uE6Ze06K6+6K6hDQpNQU5PVkEoYmV0d2Vlbi4xLCBkdj0iU0NPUkUiLCBiZXR3ZWVuPSJBIikNCmBgYA0KDQpgYGB7cn0NCmJldHdlZW4uMiAgIyAyw5cz5Lik5Zug57Sg57uE6Ze06K6+6K6hDQpNQU5PVkEoYmV0d2Vlbi4yLCBkdj0iU0NPUkUiLCBiZXR3ZWVuPWMoIkEiLCAiQiIpKQ0KDQojIyDkvb/nlKggZW1tZWFucyDljIXnmoQgZW1taXAoKSDlh73mlbDnu5jliLbkuqTkupLlm74NCiMjIOivt+afpemYheW4ruWKqeaWh+aho++8mj9lbW1lYW5zOjplbW1pcCgpDQptID0gTUFOT1ZBKGJldHdlZW4uMiwgZHY9IlNDT1JFIiwgYmV0d2Vlbj1jKCJBIiwgIkIiKSkNCmVtbWlwKG0sIH4gQSB8IEIsIENJcz1UUlVFKQ0KZW1taXAobSwgfiBCIHwgQSwgQ0lzPVRSVUUpDQplbW1pcChtLCBCIH4gQSwgQ0lzPVRSVUUpDQplbW1pcChtLCBBIH4gQiwgQ0lzPVRSVUUpDQpgYGANCg0KYGBge3J9DQpiZXR3ZWVuLjMgICMgMsOXMsOXMuS4ieWboOe0oOe7hOmXtOiuvuiuoQ0KTUFOT1ZBKGJldHdlZW4uMywgZHY9IlNDT1JFIiwgYmV0d2Vlbj1jKCJBIiwgIkIiLCAiQyIpKQ0KYGBgDQoNCiMjIOmHjeWkjea1i+mHjy/nu4TlhoXorr7orqFBTk9WQQ0KDQojIyMjIOOAkOWunui3tTLjgJHnu4TlhoXorr7orqFBTk9WQSB7I+Wunui3tTLnu4TlhoXorr7orqFhbm92YX0NCg0KLSAgIFtgTUFOT1ZBKClg5Ye95pWw5biu5Yqp5paH5qGjXShodHRwczovL3BzeWNoYnJ1Y2UuZ2l0aHViLmlvL2JydWNlUi9yZWZlcmVuY2UvTUFOT1ZBLmh0bWwpey51cml9DQoNCmBgYHtyfQ0Kd2l0aGluLjEgICMg5Y2V5Zug57Sg5Zub5rC05bmz57uE5YaF6K6+6K6hDQpNQU5PVkEod2l0aGluLjEsDQogICAgICAgZHZzID0gIkExOkE0IiwNCiAgICAgICBkdnMucGF0dGVybiA9ICJBKC4pIiwNCiAgICAgICB3aXRoaW4gPSAiQSIpDQoNCiMg55u45ZCM77yaDQpNQU5PVkEod2l0aGluLjEsDQogICAgICAgZHZzID0gYygiQTEiLCAiQTIiLCAiQTMiLCAiQTQiKSwNCiAgICAgICBkdnMucGF0dGVybiA9ICJBKC4pIiwNCiAgICAgICB3aXRoaW4gPSAiQW55VmFyTmFtZUlzT0siKQ0KYGBgDQoNCmBgYHtyfQ0Kd2l0aGluLjIgICMgMsOXM+S4pOWboOe0oOe7hOWGheiuvuiuoQ0KbSA9IE1BTk9WQSh3aXRoaW4uMiwNCiAgICAgICAgICAgZHZzID0gIkExQjE6QTJCMyIsDQogICAgICAgICAgIGR2cy5wYXR0ZXJuID0gIkEoLilCKC4pIiwNCiAgICAgICAgICAgd2l0aGluID0gYygiQSIsICJCIikpDQplbW1pcChtLCB+IEEgfCBCLCBDSXM9VFJVRSkNCmVtbWlwKG0sIH4gQiB8IEEsIENJcz1UUlVFKQ0KZW1taXAobSwgQiB+IEEsIENJcz1UUlVFKQ0KZW1taXAobSwgQSB+IEIsIENJcz1UUlVFKQ0KYGBgDQoNCmBgYHtyfQ0Kd2l0aGluLjMgICMgMsOXMsOXMuS4ieWboOe0oOe7hOWGheiuvuiuoQ0KTUFOT1ZBKHdpdGhpbi4zLA0KICAgICAgIGR2cyA9ICJBMUIxQzE6QTJCMkMyIiwNCiAgICAgICBkdnMucGF0dGVybiA9ICJBKC4pQiguKUMoLikiLA0KICAgICAgIHdpdGhpbiA9IGMoIkEiLCAiQiIsICJDIikpDQpgYGANCg0KIyMg5re35ZCI6K6+6K6hQU5PVkENCg0KIyMjIyDjgJDlrp7ot7Uz44CR5re35ZCI6K6+6K6hQU5PVkEgeyPlrp7ot7Uz5re35ZCI6K6+6K6hYW5vdmF9DQoNCi0gICBbYE1BTk9WQSgpYOWHveaVsOW4ruWKqeaWh+aho10oaHR0cHM6Ly9wc3ljaGJydWNlLmdpdGh1Yi5pby9icnVjZVIvcmVmZXJlbmNlL01BTk9WQS5odG1sKXsudXJpfQ0KDQpgYGB7cn0NCm1peGVkLjJfMWIxdyAgIyAyw5cz5Lik5Zug57Sg5re35ZCI6K6+6K6h77yIQeS4uue7hOmXtO+8jELkuLrnu4TlhoXvvIkNCk1BTk9WQShtaXhlZC4yXzFiMXcsDQogICAgICAgZHZzID0gIkIxOkIzIiwNCiAgICAgICBkdnMucGF0dGVybiA9ICJCKC4pIiwNCiAgICAgICBiZXR3ZWVuID0gIkEiLA0KICAgICAgIHdpdGhpbiA9ICJCIikNCk1BTk9WQShtaXhlZC4yXzFiMXcsDQogICAgICAgZHZzID0gIkIxOkIzIiwNCiAgICAgICBkdnMucGF0dGVybiA9ICJCKC4pIiwNCiAgICAgICBiZXR3ZWVuID0gIkEiLA0KICAgICAgIHdpdGhpbiA9ICJCIiwNCiAgICAgICBzcGguY29ycmVjdGlvbiA9ICJHRyIpDQpgYGANCg0KYGBge3J9DQptaXhlZC4zXzFiMncgICMgMsOXMsOXMuS4ieWboOe0oOa3t+WQiOiuvuiuoe+8iEHkuLrnu4Tpl7TvvIxC44CBQ+S4uue7hOWGhe+8iQ0KTUFOT1ZBKG1peGVkLjNfMWIydywNCiAgICAgICBkdnMgPSAiQjFDMTpCMkMyIiwNCiAgICAgICBkdnMucGF0dGVybiA9ICJCKC4pQyguKSIsDQogICAgICAgYmV0d2VlbiA9ICJBIiwNCiAgICAgICB3aXRoaW4gPSBjKCJCIiwgIkMiKSkNCmBgYA0KDQpgYGB7cn0NCm1peGVkLjNfMmIxdyAgIyAyw5cyw5cy5LiJ5Zug57Sg5re35ZCI6K6+6K6h77yIQeOAgUPkuLrnu4Tpl7TvvIxC5Li657uE5YaF77yJDQpNQU5PVkEobWl4ZWQuM18yYjF3LA0KICAgICAgIGR2cyA9ICJCMTpCMiIsDQogICAgICAgZHZzLnBhdHRlcm4gPSAiQiguKSIsDQogICAgICAgYmV0d2VlbiA9IGMoIkEiLCAiQyIpLA0KICAgICAgIHdpdGhpbiA9ICJCIikNCmBgYA0KDQojIOeugOWNleaViOW6lOajgOmqjOS4juWkmumHjeavlOi+gw0KDQojIyDlpJrph43mr5TovoMNCg0KIyMjIyDjgJDlrp7ot7U044CR57uE6Ze06K6+6K6hQU5PVkHnmoTlpJrph43mr5TovoMgeyPlrp7ot7U057uE6Ze06K6+6K6hYW5vdmHnmoTlpJrph43mr5TovoN9DQoNCi0gICBbYEVNTUVBTlMoKWDlh73mlbDluK7liqnmlofmoaNdKGh0dHBzOi8vcHN5Y2hicnVjZS5naXRodWIuaW8vYnJ1Y2VSL3JlZmVyZW5jZS9FTU1FQU5TLmh0bWwpey51cml977yIKipFKipzdGltYXRlZCAqKk0qKmFyZ2luYWwgKipNZWFucyoq77yM5Lyw6K6h6L656ZmF5Z2H5YC877yJDQoNCmBgYHtyfQ0KbSA9IE1BTk9WQShiZXR3ZWVuLjEsIGR2PSJTQ09SRSIsIGJldHdlZW49IkEiKQ0KZW1taXAobSwgfiBBLCBDSXM9VFJVRSkNCg0KRU1NRUFOUyhtLCAiQSIsIHAuYWRqdXN0PSJub25lIikNCkVNTUVBTlMobSwgIkEiLCBwLmFkanVzdD0iYm9uZmVycm9uaSIpDQpFTU1FQU5TKG0sICJBIiwgY29udHJhc3Q9InNlcSIpDQpFTU1FQU5TKG0sICJBIiwgY29udHJhc3Q9InBvbHkiKQ0KYGBgDQoNCiMjIyMg44CQ5o6i57Si5Y+R546w44CR5aSa6YeN5q+U6L6D55qEcOWAvOagoeato+aWueazlSB7I+aOoue0ouWPkeeOsOWkmumHjeavlOi+g+eahHDlgLzmoKHmraPmlrnms5V9DQoNCmBwLmFkanVzdGDlj4LmlbANCg0KLSAgIGAibm9uZSJg77yI5peg5qCh5q2j77yJDQotICAgYCJmZHIiYA0KLSAgIGAiaG9jaGJlcmciYA0KLSAgIGAiaG9tbWVsImANCi0gICBgImhvbG0iYA0KLSAgIGAidHVrZXkiYA0KLSAgIGAibXZ0ImANCi0gICBgImR1bm5ldHR4ImANCi0gICBgInNpZGFrImANCi0gICBgInNjaGVmZmUiYA0KLSAgIGAiYm9uZmVycm9uaSJg77yI6buY6K6k77yM5pyA5Lil5qC877yJDQogICAgLSAgIEJvbmZlcnJvbmnmoKHmraPvvJrnm7TmjqXlsIbljp/lp4sqcCrlgLzkuI7lpJrph43mr5TovoPmrKHmlbAqbirnm7jkuZjvvIzlvpfliLDmoKHmraPlkI7nmoQqcCrlgLwNCiAgICAgICAgLSAgIOavlOWmgu+8jDPkuKrmnaHku7bkuYvpl7TnmoTkuKTkuKTmr5TovoPnu4TlkIjmnIlDKDMsIDIpID0gM+asoe+8jOafkOaViOW6lOeahOWOn+WniypwKiA9IC4wNO+8jOagoeato+WQjipwKiA9IC4wNCDDlyAzID0gLjEy77yM5LiN5YaN5pi+6JGXDQoNCiMjIOeugOWNleaViOW6lOajgOmqjA0KDQojIyMjIOOAkOWunui3tTXjgJHnu4Tpl7Torr7orqFBTk9WQeeahOeugOWNleaViOW6lOajgOmqjCB7I+Wunui3tTXnu4Tpl7Torr7orqFhbm92YeeahOeugOWNleaViOW6lOajgOmqjH0NCg0KLSAgIFtgRU1NRUFOUygpYOWHveaVsOW4ruWKqeaWh+aho10oaHR0cHM6Ly9wc3ljaGJydWNlLmdpdGh1Yi5pby9icnVjZVIvcmVmZXJlbmNlL0VNTUVBTlMuaHRtbCl7LnVyaX3vvIgqKkUqKnN0aW1hdGVkICoqTSoqYXJnaW5hbCAqKk1lYW5zKirvvIzkvLDorqHovrnpmYXlnYflgLzvvIkNCg0KYGBge3J9DQptID0gTUFOT1ZBKGJldHdlZW4uMiwgZHY9IlNDT1JFIiwgYmV0d2Vlbj1jKCJBIiwgIkIiKSkNCg0KZW1taXAobSwgfiBBIHwgQiwgQ0lzPVRSVUUpDQpFTU1FQU5TKG0sICJBIiwgYnk9IkIiKQ0KDQplbW1pcChtLCB+IEIgfCBBLCBDSXM9VFJVRSkNCkVNTUVBTlMobSwgIkIiLCBieT0iQSIpDQpgYGANCg0KYGBge3J9DQojIyDkvb/nlKjnrqHpgZPmk43kvZznrKYgJT4lIOi/nuaOpeWkmuS4qiBFTU1FQU5TKCkNCk1BTk9WQShiZXR3ZWVuLjMsIGR2PSJTQ09SRSIsIGJldHdlZW49YygiQSIsICJCIiwgIkMiKSkgJT4lDQogIEVNTUVBTlMoIkEiLCBieT0iQiIpICU+JQ0KICBFTU1FQU5TKGMoIkEiLCAiQiIpLCBieT0iQyIpICU+JQ0KICBFTU1FQU5TKCJBIiwgYnk9YygiQiIsICJDIikpDQpgYGANCg0KIyBcKiDmi5PlsZXvvJrnibnmrormg4XlhrUNCg0KIyMjIyDjgJDmjqLntKLlj5HnjrDjgJHlr7nkuo7kuKTlm6DntKDmlrnlt67liIbmnpDvvIhBIMOXIELvvInvvIzku6XkuIvmg4XlhrXpg73mnInlj6/og73lj5HnlJ/lkJfvvJ8geyPmjqLntKLlj5HnjrDlr7nkuo7kuKTlm6DntKDmlrnlt67liIbmnpBhLWLku6XkuIvmg4XlhrXpg73mnInlj6/og73lj5HnlJ/lkJd9DQoNCioq5Lqk5LqS5L2c55SoICYg5Li75pWI5bqU77yaKioNCg0KLSAgIFt4XSDkuqTkupLkvZznlKgqKuaYvuiRlyoq77yMQeWSjELnmoTkuLvmlYjlupQqKumDveaYvuiRlyoq77yI5b6I5q2j5bi477yJDQotICAgW3hdIOS6pOS6kuS9nOeUqCoq5pi+6JGXKirvvIxB5ZKMQueahOS4u+aViOW6lCoq6YO95LiN5pi+6JGXKirvvIjlvojmraPluLjvvIzlj6rmnInkuqTkupLkvZznlKjvvIkNCi0gICBbeF0g5Lqk5LqS5L2c55SoKirkuI3mmL7okZcqKu+8jEHlkoxC55qE5Li75pWI5bqUKirpg73mmL7okZcqKu+8iOW+iOato+W4uO+8jOWPquacieS4u+aViOW6lO+8iQ0KLSAgIFt4XSDkuqTkupLkvZznlKgqKuS4jeaYvuiRlyoq77yMQeWSjELnmoTkuLvmlYjlupQqKumDveS4jeaYvuiRlyoq77yI5b6I5q2j5bi477yM5ZWl5pWI5bqU6YO95rKh77yJDQoNCioq5Lqk5LqS5L2c55SoICYg566A5Y2V5pWI5bqU77yaKipcDQrvvIjkvovlpoLvvJpB5ZyoQjHjgIFCMuawtOW5s+S4iueahOS4pOS4queugOWNleS4u+aViOW6lO+8iQ0KDQotICAgW3hdIOS6pOS6kuS9nOeUqCoq5pi+6JGXKirvvIxB55qE5Lik5Liq566A5Y2V5pWI5bqUKirpg73mmL7okZcqKlwNCiAgICDvvIjlvojmraPluLjvvIzkuqTkupLkvZznlKjkvZPnjrDkuobnroDljZXmlYjlupTnmoTlrprph4/lt67lvILvvIkNCi0gICBbeF0g5Lqk5LqS5L2c55SoKirmmL7okZcqKu+8jEHnmoTkuKTkuKrnroDljZXmlYjlupQqKumDveS4jeaYvuiRlyoq4p2T77iPXA0KICAgIO+8iOavlOi+g+Wwkeinge+8jOS9huacieamgueOh+WPkeeUn++8ge+8iQ0KLSAgIFt4XSDkuqTkupLkvZznlKgqKuaYvuiRlyoq77yMQeeahOeugOWNleaViOW6lOS4gOS4qioq5pi+6JGXKirjgIHkuIDkuKoqKuS4jeaYvuiRlyoqXA0KICAgIO+8iOW+iOato+W4uO+8jOS6pOS6kuS9nOeUqOS9k+eOsOS6hueugOWNleaViOW6lOeahOWumuaAp+W3ruW8gu+8iQ0KLSAgIFt4XSDkuqTkupLkvZznlKgqKuS4jeaYvuiRlyoq77yMQeeahOS4pOS4queugOWNleaViOW6lCoq6YO95pi+6JGXKipcDQogICAg77yI5b6I5q2j5bi477yM5Li75pWI5bqU5Li65Li777yJDQotICAgW3hdIOS6pOS6kuS9nOeUqCoq5LiN5pi+6JGXKirvvIxB55qE5Lik5Liq566A5Y2V5pWI5bqUKirpg73kuI3mmL7okZcqKlwNCiAgICDvvIjlvojmraPluLjvvIzllaXmlYjlupTpg73msqHvvIkNCi0gICBbeF0g5Lqk5LqS5L2c55SoKirkuI3mmL7okZcqKu+8jEHnmoTnroDljZXmlYjlupTkuIDkuKoqKuaYvuiRlyoq44CB5LiA5LiqKirkuI3mmL7okZcqKuKdk++4j1wNCiAgICDvvIjlubbkuI3lsJHop4HvvIzmmL7okZfnmoTnroDljZXmlYjlupTmgbDlpb3ljaHlnKjkuobkuLTnlYzngrnpmYTov5HvvIHvvIkNCg0KPiDigJxTZWVpbmcgaXMgYmVsaWV2aW5nLuKAne+8iOecvOingeS4uuWunu+8iQ0KDQojIyMjIOOAkOWunui3tTbjgJHkuqTkupLkvZznlKjmmL7okZfvvIzkvYZB55qE5Lik5Liq566A5Y2V5pWI5bqU6YO95LiN5pi+6JGXIHsj5a6e6Le1NuS6pOS6kuS9nOeUqOaYvuiRl+S9hmHnmoTkuKTkuKrnroDljZXmlYjlupTpg73kuI3mmL7okZd9DQoNCmBgYHtyfQ0KZGF0YTEgPSBkYXRhLnRhYmxlKA0KICBBID0gYygxLCAxLCAxLCAxLCAyLCAyLCAyLCAyKSwNCiAgQiA9IGMoMSwgMSwgMiwgMiwgMSwgMSwgMiwgMiksDQogIFkgPSBjKDAsIDcsIDEwLCAxMiwgMTIsIDEwLCA3LCAwKQ0KKQ0KbSA9IE1BTk9WQShkYXRhMSwgZHY9IlkiLCBiZXR3ZWVuPWMoIkEiLCAiQiIpKQ0KZW1taXAobSwgQiB+IEEsIENJcz1UUlVFKQ0KRU1NRUFOUyhtLCAiQSIsIGJ5PSJCIikNCmBgYA0KDQohW10oaW1hZ2VzL2NsaXBib2FyZC0yODA1NzMwOTYxLnBuZykNCg0KIyMjIyDjgJDlrp7ot7U344CR5Lqk5LqS5L2c55So5LiN5pi+6JGX77yM5L2GQeeahOeugOWNleaViOW6lOS4gOS4quaYvuiRl+OAgeS4gOS4quS4jeaYvuiRlyB7I+Wunui3tTfkuqTkupLkvZznlKjkuI3mmL7okZfkvYZh55qE566A5Y2V5pWI5bqU5LiA5Liq5pi+6JGX5LiA5Liq5LiN5pi+6JGXfQ0KDQpgYGB7cn0NCmRhdGEyID0gZGF0YS50YWJsZSgNCiAgQSA9IGMoMSwgMSwgMSwgMSwgMiwgMiwgMiwgMiksDQogIEIgPSBjKDEsIDEsIDIsIDIsIDEsIDEsIDIsIDIpLA0KICBZID0gYygwLCAxLCAwLCA0LCA1LCA2LCAyLCA0KQ0KKQ0KbSA9IE1BTk9WQShkYXRhMiwgZHY9IlkiLCBiZXR3ZWVuPWMoIkEiLCAiQiIpKQ0KZW1taXAobSwgQiB+IEEsIENJcz1UUlVFKQ0KRU1NRUFOUyhtLCAiQSIsIGJ5PSJCIikNCmBgYA0KDQojIOOAkOS9nOS4mjjjgJHmlrnlt67liIbmnpDnu4PkuaANCg0K5L2c5Lia6KaB5rGC77yaDQoNCi0gICDln7rkuo5b44CQ5L2c5LiaNOOAkV0oaHR0cHM6Ly9wc3ljaGJydWNlLmdpdGh1Yi5pby9SQ291cnNlL0NoYXAwMyMlRTQlQkQlOUMlRTQlQjglOUE0JUU2JTlDJTlGJUU2JTlDJUFCJUU4JTg3JUFBJUU5JTgwJTg5JUU1JTg1JUFDJUU1JUJDJTgwJUU2JTk1JUIwJUU2JThEJUFFJUU1JUFGJUJDJUU1JTg1JUE1KeWSjFvjgJDkvZzkuJo244CRXShodHRwczovL3BzeWNoYnJ1Y2UuZ2l0aHViLmlvL1JDb3Vyc2UvQ2hhcDA1IyVFNCVCRCU5QyVFNCVCOCU5QTYlRTYlOUMlOUYlRTYlOUMlQUIlRTQlQkQlOUMlRTQlQjglOUElRTYlOTUlQjAlRTYlOEQlQUUlRTUlOEYlOTglRTklODclOEYlRTglQUUlQTElRTclQUUlOTcpey51cml955qE5pyf5pyr6Ieq6YCJ5pWw5o2u5ZKM5Luj56CB56ev57Sv77yM6L+Q55So5pys56ug5omA5a2m55qE5pa55beu5YiG5p6Q5pa55rOV5ZKM5Luj56CB77yM57uD5LmgKirmlrnlt67liIbmnpAqKu+8iOagueaNruiHquW3seeahOaVsOaNruaDheWGtemAieaLqeacgOWQiOmAgueahOS4gOenjeaWueW3ruWIhuaekOexu+Wei++8iQ0KLSAgIOS9v+eUqFIgTWFya2Rvd27lrozmiJDvvIzlr7nlhbPplK7ku6PnoIHlj4rnu5PmnpzopoHmnInms6jph4ror7TmmI4NCg0K5bmz5Y+w5o+Q5Lqk77yaDQoNCi0gICDov5DooYzlvpfliLDnmoRIVE1M572R6aG177yM5Y+K5YW25YWz6ZSu6YOo5YiG5oiq5Zu+DQo=

《R语言》第8章：方差分析

返回课程主页

授课教师：包寒吴霜