| Camera | OASIS | DeepSeek-V4.1-Flash | 1/128% | 12 metrics +OASIS · DeepSeek-V4.1-Flash · CameraPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | .08 | .03 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | .46 | .06 | Pass |
|---|
|
|---|
| Camera | OASIS | gpt-5.4-mini | 0/120% | 12 metrics +OASIS · gpt-5.4-mini · CameraPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| Camera | OASIS | gpt-4o-mini | 0/120% | 12 metrics +OASIS · gpt-4o-mini · CameraPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| Camera | SynthPAI | DeepSeek-V4.1-Flash | 1/128% | 12 metrics +SynthPAI · DeepSeek-V4.1-Flash · CameraPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | .08 | .11 | Pass |
|---|
Average depthavg_depth | Interaction | .01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | .39 | .03 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| Camera | SynthPAI | gpt-5.4-mini | 1/128% | 12 metrics +SynthPAI · gpt-5.4-mini · CameraPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | .55 | .14 | Pass |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | .46 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | .03 | .07 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| Camera | SynthPAI | gpt-4o-mini | 2/1217% | 12 metrics +SynthPAI · gpt-4o-mini · CameraPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | .05 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | .85 | .22 | Pass |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | .07 | .17 | Pass |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| Camera | ThreadPDG | DeepSeek-V4.1-Flash | 11/1292% | 12 metrics +ThreadPDG · DeepSeek-V4.1-Flash · CameraPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | .44 | .71 | Pass |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | .92 | .28 | Pass |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | .68 | .44 | Pass |
|---|
Average depthavg_depth | Interaction | .86 | .98 | Pass |
|---|
Structural viralitystructural_virality | Interaction | .81 | .85 | Pass |
|---|
Length variationlength_cv | Interaction | .21 | .44 | Pass |
|---|
Story probabilitymean_story_probability | Expression | .15 | .16 | Pass |
|---|
Emotion entropyemotion_entropy | Expression | .50 | .79 | Pass |
|---|
Polite ratepolite_rate | Tone | .76 | .33 | Pass |
|---|
Neutral rateneutral_rate | Tone | .15 | .07 | Pass |
|---|
Impolite rateimpolite_rate | Tone | <.01 | .05 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | .10 | .09 | Pass |
|---|
|
|---|
| Camera | ThreadPDG | gpt-5.4-mini | 10/1283% | 12 metrics +ThreadPDG · gpt-5.4-mini · CameraPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | .12 | .01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | .27 | .19 | Pass |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | .72 | .61 | Pass |
|---|
Average depthavg_depth | Interaction | .98 | .92 | Pass |
|---|
Structural viralitystructural_virality | Interaction | .70 | .57 | Pass |
|---|
Length variationlength_cv | Interaction | .70 | .34 | Pass |
|---|
Story probabilitymean_story_probability | Expression | .17 | .51 | Pass |
|---|
Emotion entropyemotion_entropy | Expression | .65 | .65 | Pass |
|---|
Polite ratepolite_rate | Tone | .02 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | .06 | .20 | Pass |
|---|
Impolite rateimpolite_rate | Tone | .83 | .90 | Pass |
|---|
Hard disagreementhard_disagree_rate | Tone | .19 | .37 | Pass |
|---|
|
|---|
| Camera | ThreadPDG | gpt-4o-mini | 2/1217% | 12 metrics +ThreadPDG · gpt-4o-mini · CameraPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | .03 | .02 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | .41 | .37 | Pass |
|---|
Structural viralitystructural_virality | Interaction | .23 | .23 | Pass |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| Celebrity | OASIS | DeepSeek-V4.1-Flash | 1/128% | 12 metrics +OASIS · DeepSeek-V4.1-Flash · CelebrityPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | .67 | .15 | Pass |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| Celebrity | OASIS | gpt-5.4-mini | 1/128% | 12 metrics +OASIS · gpt-5.4-mini · CelebrityPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | .37 | .27 | Pass |
|---|
|
|---|
| Celebrity | OASIS | gpt-4o-mini | 0/120% | 12 metrics +OASIS · gpt-4o-mini · CelebrityPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | .15 | <.01 | Fail |
|---|
|
|---|
| Celebrity | SynthPAI | DeepSeek-V4.1-Flash | 0/120% | 12 metrics +SynthPAI · DeepSeek-V4.1-Flash · CelebrityPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | .02 | .02 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| Celebrity | SynthPAI | gpt-5.4-mini | 0/120% | 12 metrics +SynthPAI · gpt-5.4-mini · CelebrityPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | .11 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | .02 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | .03 | .02 | Fail |
|---|
|
|---|
| Celebrity | SynthPAI | gpt-4o-mini | 0/120% | 12 metrics +SynthPAI · gpt-4o-mini · CelebrityPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| Celebrity | ThreadPDG | DeepSeek-V4.1-Flash | 12/12100% | 12 metrics +ThreadPDG · DeepSeek-V4.1-Flash · CelebrityPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | .77 | .71 | Pass |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | .77 | .88 | Pass |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | .90 | .88 | Pass |
|---|
Average depthavg_depth | Interaction | .58 | .56 | Pass |
|---|
Structural viralitystructural_virality | Interaction | .30 | .33 | Pass |
|---|
Length variationlength_cv | Interaction | .05 | .20 | Pass |
|---|
Story probabilitymean_story_probability | Expression | .56 | .67 | Pass |
|---|
Emotion entropyemotion_entropy | Expression | .67 | .80 | Pass |
|---|
Polite ratepolite_rate | Tone | .72 | .55 | Pass |
|---|
Neutral rateneutral_rate | Tone | .68 | .77 | Pass |
|---|
Impolite rateimpolite_rate | Tone | .69 | .66 | Pass |
|---|
Hard disagreementhard_disagree_rate | Tone | .78 | .64 | Pass |
|---|
|
|---|
| Celebrity | ThreadPDG | gpt-5.4-mini | 11/1292% | 12 metrics +ThreadPDG · gpt-5.4-mini · CelebrityPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | .12 | .12 | Pass |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | .29 | .70 | Pass |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | .91 | .79 | Pass |
|---|
Average depthavg_depth | Interaction | .56 | .50 | Pass |
|---|
Structural viralitystructural_virality | Interaction | .26 | .22 | Pass |
|---|
Length variationlength_cv | Interaction | .17 | .11 | Pass |
|---|
Story probabilitymean_story_probability | Expression | .24 | .53 | Pass |
|---|
Emotion entropyemotion_entropy | Expression | .49 | .52 | Pass |
|---|
Polite ratepolite_rate | Tone | .05 | .06 | Fail |
|---|
Neutral rateneutral_rate | Tone | .58 | .45 | Pass |
|---|
Impolite rateimpolite_rate | Tone | .31 | .43 | Pass |
|---|
Hard disagreementhard_disagree_rate | Tone | .41 | .62 | Pass |
|---|
|
|---|
| Celebrity | ThreadPDG | gpt-4o-mini | 3/1225% | 12 metrics +ThreadPDG · gpt-4o-mini · CelebrityPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | .77 | .71 | Pass |
|---|
Structural viralitystructural_virality | Interaction | .91 | .83 | Pass |
|---|
Length variationlength_cv | Interaction | .04 | .05 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | .02 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | .01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | .51 | .92 | Pass |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| Cellphone | OASIS | DeepSeek-V4.1-Flash | 1/128% | 12 metrics +OASIS · DeepSeek-V4.1-Flash · CellphonePublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | .87 | .90 | Pass |
|---|
|
|---|
| Cellphone | OASIS | gpt-5.4-mini | 1/128% | 12 metrics +OASIS · gpt-5.4-mini · CellphonePublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | .93 | .20 | Pass |
|---|
|
|---|
| Cellphone | OASIS | gpt-4o-mini | 0/120% | 12 metrics +OASIS · gpt-4o-mini · CellphonePublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | .05 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | .05 | .01 | Fail |
|---|
|
|---|
| Cellphone | SynthPAI | DeepSeek-V4.1-Flash | 1/128% | 12 metrics +SynthPAI · DeepSeek-V4.1-Flash · CellphonePublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | .17 | .12 | Pass |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | .17 | .03 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| Cellphone | SynthPAI | gpt-5.4-mini | 1/128% | 12 metrics +SynthPAI · gpt-5.4-mini · CellphonePublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | .64 | .06 | Pass |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | .07 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| Cellphone | SynthPAI | gpt-4o-mini | 1/128% | 12 metrics +SynthPAI · gpt-4o-mini · CellphonePublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | .63 | .26 | Pass |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | .11 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| Cellphone | ThreadPDG | DeepSeek-V4.1-Flash | 10/1283% | 12 metrics +ThreadPDG · DeepSeek-V4.1-Flash · CellphonePublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | .09 | .42 | Pass |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | .23 | .33 | Pass |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | .90 | .35 | Pass |
|---|
Average depthavg_depth | Interaction | .43 | .41 | Pass |
|---|
Structural viralitystructural_virality | Interaction | .20 | .43 | Pass |
|---|
Length variationlength_cv | Interaction | .07 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | .78 | .42 | Pass |
|---|
Emotion entropyemotion_entropy | Expression | .12 | .08 | Pass |
|---|
Polite ratepolite_rate | Tone | .18 | .15 | Pass |
|---|
Neutral rateneutral_rate | Tone | .97 | 1.0 | Pass |
|---|
Impolite rateimpolite_rate | Tone | .05 | .13 | Pass |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | .01 | Fail |
|---|
|
|---|
| Cellphone | ThreadPDG | gpt-5.4-mini | 10/1283% | 12 metrics +ThreadPDG · gpt-5.4-mini · CellphonePublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | .04 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | .95 | .70 | Pass |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | .13 | .41 | Pass |
|---|
Average depthavg_depth | Interaction | .76 | .70 | Pass |
|---|
Structural viralitystructural_virality | Interaction | .91 | .93 | Pass |
|---|
Length variationlength_cv | Interaction | .31 | .49 | Pass |
|---|
Story probabilitymean_story_probability | Expression | .92 | .88 | Pass |
|---|
Emotion entropyemotion_entropy | Expression | .84 | .55 | Pass |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | .26 | .12 | Pass |
|---|
Impolite rateimpolite_rate | Tone | .17 | .33 | Pass |
|---|
Hard disagreementhard_disagree_rate | Tone | .17 | .27 | Pass |
|---|
|
|---|
| Cellphone | ThreadPDG | gpt-4o-mini | 5/1242% | 12 metrics +ThreadPDG · gpt-4o-mini · CellphonePublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | .55 | .72 | Pass |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | .07 | .16 | Pass |
|---|
Structural viralitystructural_virality | Interaction | .01 | .04 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | .06 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | .46 | .29 | Pass |
|---|
Neutral rateneutral_rate | Tone | .20 | .15 | Pass |
|---|
Impolite rateimpolite_rate | Tone | .02 | .02 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | .10 | .07 | Pass |
|---|
|
|---|
| Game | OASIS | DeepSeek-V4.1-Flash | 2/1217% | 12 metrics +OASIS · DeepSeek-V4.1-Flash · GamePublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | .07 | .18 | Pass |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | .08 | .08 | Pass |
|---|
|
|---|
| Game | OASIS | gpt-5.4-mini | 0/120% | 12 metrics +OASIS · gpt-5.4-mini · GamePublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | .20 | .02 | Fail |
|---|
|
|---|
| Game | OASIS | gpt-4o-mini | 0/120% | 12 metrics +OASIS · gpt-4o-mini · GamePublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| Game | SynthPAI | DeepSeek-V4.1-Flash | 1/128% | 12 metrics +SynthPAI · DeepSeek-V4.1-Flash · GamePublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | .08 | .07 | Pass |
|---|
|
|---|
| Game | SynthPAI | gpt-5.4-mini | 2/1217% | 12 metrics +SynthPAI · gpt-5.4-mini · GamePublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | .07 | .07 | Pass |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | .04 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | .37 | .63 | Pass |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | .02 | <.01 | Fail |
|---|
|
|---|
| Game | SynthPAI | gpt-4o-mini | 0/120% | 12 metrics +SynthPAI · gpt-4o-mini · GamePublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | .48 | .01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| Game | ThreadPDG | DeepSeek-V4.1-Flash | 10/1283% | 12 metrics +ThreadPDG · DeepSeek-V4.1-Flash · GamePublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | .75 | .51 | Pass |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | .11 | .08 | Pass |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | .15 | .45 | Pass |
|---|
Average depthavg_depth | Interaction | .18 | .28 | Pass |
|---|
Structural viralitystructural_virality | Interaction | .03 | .05 | Fail |
|---|
Length variationlength_cv | Interaction | .71 | .69 | Pass |
|---|
Story probabilitymean_story_probability | Expression | .71 | .91 | Pass |
|---|
Emotion entropyemotion_entropy | Expression | .30 | .22 | Pass |
|---|
Polite ratepolite_rate | Tone | .17 | .05 | Pass |
|---|
Neutral rateneutral_rate | Tone | .60 | .63 | Pass |
|---|
Impolite rateimpolite_rate | Tone | .88 | .36 | Pass |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| Game | ThreadPDG | gpt-5.4-mini | 8/1267% | 12 metrics +ThreadPDG · gpt-5.4-mini · GamePublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | .36 | .72 | Pass |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | .03 | .02 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | .29 | .63 | Pass |
|---|
Average depthavg_depth | Interaction | .19 | .29 | Pass |
|---|
Structural viralitystructural_virality | Interaction | .07 | .03 | Fail |
|---|
Length variationlength_cv | Interaction | .22 | .29 | Pass |
|---|
Story probabilitymean_story_probability | Expression | .93 | 1.0 | Pass |
|---|
Emotion entropyemotion_entropy | Expression | .70 | .53 | Pass |
|---|
Polite ratepolite_rate | Tone | .03 | .02 | Fail |
|---|
Neutral rateneutral_rate | Tone | .63 | .89 | Pass |
|---|
Impolite rateimpolite_rate | Tone | .46 | .53 | Pass |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| Game | ThreadPDG | gpt-4o-mini | 3/1225% | 12 metrics +ThreadPDG · gpt-4o-mini · GamePublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | .06 | .07 | Pass |
|---|
Structural viralitystructural_virality | Interaction | .01 | .03 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | .69 | .84 | Pass |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | .02 | .04 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | .67 | .53 | Pass |
|---|
|
|---|
| Health Issue | OASIS | DeepSeek-V4.1-Flash | 1/128% | 12 metrics +OASIS · DeepSeek-V4.1-Flash · Health IssuePublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | .02 | .15 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | .08 | .09 | Pass |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| Health Issue | OASIS | gpt-5.4-mini | 1/128% | 12 metrics +OASIS · gpt-5.4-mini · Health IssuePublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | .51 | .10 | Pass |
|---|
|
|---|
| Health Issue | OASIS | gpt-4o-mini | 1/128% | 12 metrics +OASIS · gpt-4o-mini · Health IssuePublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | .79 | .66 | Pass |
|---|
|
|---|
| Health Issue | SynthPAI | DeepSeek-V4.1-Flash | 2/1217% | 12 metrics +SynthPAI · DeepSeek-V4.1-Flash · Health IssuePublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | .47 | .57 | Pass |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | .49 | .19 | Pass |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| Health Issue | SynthPAI | gpt-5.4-mini | 1/128% | 12 metrics +SynthPAI · gpt-5.4-mini · Health IssuePublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | .43 | .57 | Pass |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | .66 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | .13 | .02 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| Health Issue | SynthPAI | gpt-4o-mini | 0/120% | 12 metrics +SynthPAI · gpt-4o-mini · Health IssuePublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| Health Issue | ThreadPDG | DeepSeek-V4.1-Flash | 7/1258% | 12 metrics +ThreadPDG · DeepSeek-V4.1-Flash · Health IssuePublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | .02 | .02 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | .02 | .14 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | .40 | .53 | Pass |
|---|
Average depthavg_depth | Interaction | .48 | .23 | Pass |
|---|
Structural viralitystructural_virality | Interaction | .39 | .72 | Pass |
|---|
Length variationlength_cv | Interaction | .74 | .36 | Pass |
|---|
Story probabilitymean_story_probability | Expression | .37 | .72 | Pass |
|---|
Emotion entropyemotion_entropy | Expression | .35 | .36 | Pass |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | .03 | .11 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | .29 | .23 | Pass |
|---|
|
|---|
| Health Issue | ThreadPDG | gpt-5.4-mini | 8/1267% | 12 metrics +ThreadPDG · gpt-5.4-mini · Health IssuePublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | .44 | .11 | Pass |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | .92 | .96 | Pass |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | .21 | .25 | Pass |
|---|
Average depthavg_depth | Interaction | .47 | .23 | Pass |
|---|
Structural viralitystructural_virality | Interaction | .41 | .70 | Pass |
|---|
Length variationlength_cv | Interaction | .22 | .04 | Fail |
|---|
Story probabilitymean_story_probability | Expression | .76 | .82 | Pass |
|---|
Emotion entropyemotion_entropy | Expression | .06 | .09 | Pass |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | .02 | .08 | Fail |
|---|
Impolite rateimpolite_rate | Tone | .05 | .16 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | .34 | .16 | Pass |
|---|
|
|---|
| Health Issue | ThreadPDG | gpt-4o-mini | 3/1225% | 12 metrics +ThreadPDG · gpt-4o-mini · Health IssuePublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | .01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | .42 | .26 | Pass |
|---|
Structural viralitystructural_virality | Interaction | .41 | .67 | Pass |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | .04 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | .27 | .36 | Pass |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | .01 | .02 | Fail |
|---|
|
|---|
| Movies | OASIS | DeepSeek-V4.1-Flash | 2/1217% | 12 metrics +OASIS · DeepSeek-V4.1-Flash · MoviesPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | .12 | .13 | Pass |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | .34 | .70 | Pass |
|---|
Hard disagreementhard_disagree_rate | Tone | .02 | .07 | Fail |
|---|
|
|---|
| Movies | OASIS | gpt-5.4-mini | 0/120% | 12 metrics +OASIS · gpt-5.4-mini · MoviesPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | .02 | <.01 | Fail |
|---|
|
|---|
| Movies | OASIS | gpt-4o-mini | 0/120% | 12 metrics +OASIS · gpt-4o-mini · MoviesPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | .08 | <.01 | Fail |
|---|
|
|---|
| Movies | SynthPAI | DeepSeek-V4.1-Flash | 1/128% | 12 metrics +SynthPAI · DeepSeek-V4.1-Flash · MoviesPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | .03 | .04 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | .55 | .72 | Pass |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| Movies | SynthPAI | gpt-5.4-mini | 1/128% | 12 metrics +SynthPAI · gpt-5.4-mini · MoviesPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | .07 | .17 | Pass |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | .01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | .04 | .13 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| Movies | SynthPAI | gpt-4o-mini | 0/120% | 12 metrics +SynthPAI · gpt-4o-mini · MoviesPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | .08 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | .02 | .06 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| Movies | ThreadPDG | DeepSeek-V4.1-Flash | 10/1283% | 12 metrics +ThreadPDG · DeepSeek-V4.1-Flash · MoviesPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | .97 | .42 | Pass |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | .78 | .70 | Pass |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | .82 | .88 | Pass |
|---|
Average depthavg_depth | Interaction | .72 | .61 | Pass |
|---|
Structural viralitystructural_virality | Interaction | .28 | .36 | Pass |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | .47 | .56 | Pass |
|---|
Emotion entropyemotion_entropy | Expression | .80 | .96 | Pass |
|---|
Polite ratepolite_rate | Tone | .58 | .47 | Pass |
|---|
Neutral rateneutral_rate | Tone | .77 | .94 | Pass |
|---|
Impolite rateimpolite_rate | Tone | .02 | .09 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | .36 | .13 | Pass |
|---|
|
|---|
| Movies | ThreadPDG | gpt-5.4-mini | 11/1292% | 12 metrics +ThreadPDG · gpt-5.4-mini · MoviesPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | .13 | .08 | Pass |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | .31 | .64 | Pass |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | .38 | .38 | Pass |
|---|
Average depthavg_depth | Interaction | .61 | .34 | Pass |
|---|
Structural viralitystructural_virality | Interaction | .19 | .25 | Pass |
|---|
Length variationlength_cv | Interaction | .07 | .05 | Pass |
|---|
Story probabilitymean_story_probability | Expression | .67 | .65 | Pass |
|---|
Emotion entropyemotion_entropy | Expression | .73 | .76 | Pass |
|---|
Polite ratepolite_rate | Tone | .01 | .01 | Fail |
|---|
Neutral rateneutral_rate | Tone | .33 | .37 | Pass |
|---|
Impolite rateimpolite_rate | Tone | .09 | .15 | Pass |
|---|
Hard disagreementhard_disagree_rate | Tone | .50 | .11 | Pass |
|---|
|
|---|
| Movies | ThreadPDG | gpt-4o-mini | 3/1225% | 12 metrics +ThreadPDG · gpt-4o-mini · MoviesPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | .43 | .36 | Pass |
|---|
Structural viralitystructural_virality | Interaction | .05 | .14 | Fail |
|---|
Length variationlength_cv | Interaction | .03 | .04 | Fail |
|---|
Story probabilitymean_story_probability | Expression | .30 | .15 | Pass |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | .04 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | .08 | .15 | Pass |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| News | OASIS | DeepSeek-V4.1-Flash | 1/128% | 12 metrics +OASIS · DeepSeek-V4.1-Flash · NewsPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | .43 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | .50 | .09 | Pass |
|---|
|
|---|
| News | OASIS | gpt-5.4-mini | 0/120% | 12 metrics +OASIS · gpt-5.4-mini · NewsPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| News | OASIS | gpt-4o-mini | 0/120% | 12 metrics +OASIS · gpt-4o-mini · NewsPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | .02 | <.01 | Fail |
|---|
|
|---|
| News | SynthPAI | DeepSeek-V4.1-Flash | 0/120% | 12 metrics +SynthPAI · DeepSeek-V4.1-Flash · NewsPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| News | SynthPAI | gpt-5.4-mini | 0/120% | 12 metrics +SynthPAI · gpt-5.4-mini · NewsPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | .03 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | .01 | .05 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | .05 | .02 | Fail |
|---|
|
|---|
| News | SynthPAI | gpt-4o-mini | 2/1217% | 12 metrics +SynthPAI · gpt-4o-mini · NewsPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | .44 | .37 | Pass |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | .46 | .54 | Pass |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| News | ThreadPDG | DeepSeek-V4.1-Flash | 7/1258% | 12 metrics +ThreadPDG · DeepSeek-V4.1-Flash · NewsPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | .13 | .16 | Pass |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | .63 | .74 | Pass |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | .01 | .02 | Fail |
|---|
Average depthavg_depth | Interaction | .38 | .36 | Pass |
|---|
Structural viralitystructural_virality | Interaction | .78 | .29 | Pass |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | .14 | .19 | Pass |
|---|
Emotion entropyemotion_entropy | Expression | .55 | .83 | Pass |
|---|
Polite ratepolite_rate | Tone | .09 | .07 | Pass |
|---|
Neutral rateneutral_rate | Tone | .02 | .07 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | .01 | <.01 | Fail |
|---|
|
|---|
| News | ThreadPDG | gpt-5.4-mini | 9/1275% | 12 metrics +ThreadPDG · gpt-5.4-mini · NewsPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | .42 | .65 | Pass |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | .20 | .38 | Pass |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | .35 | .53 | Pass |
|---|
Average depthavg_depth | Interaction | .57 | .59 | Pass |
|---|
Structural viralitystructural_virality | Interaction | .99 | .57 | Pass |
|---|
Length variationlength_cv | Interaction | .45 | .57 | Pass |
|---|
Story probabilitymean_story_probability | Expression | .92 | 1.0 | Pass |
|---|
Emotion entropyemotion_entropy | Expression | .21 | .20 | Pass |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | .03 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | .12 | .06 | Pass |
|---|
|
|---|
| News | ThreadPDG | gpt-4o-mini | 4/1233% | 12 metrics +ThreadPDG · gpt-4o-mini · NewsPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | .45 | .66 | Pass |
|---|
Structural viralitystructural_virality | Interaction | .94 | .54 | Pass |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | .69 | .91 | Pass |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | .54 | .45 | Pass |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| TV Series | OASIS | DeepSeek-V4.1-Flash | 2/1217% | 12 metrics +OASIS · DeepSeek-V4.1-Flash · TV SeriesPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | .09 | .33 | Pass |
|---|
Hard disagreementhard_disagree_rate | Tone | .83 | .82 | Pass |
|---|
|
|---|
| TV Series | OASIS | gpt-5.4-mini | 0/120% | 12 metrics +OASIS · gpt-5.4-mini · TV SeriesPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| TV Series | OASIS | gpt-4o-mini | 0/120% | 12 metrics +OASIS · gpt-4o-mini · TV SeriesPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| TV Series | SynthPAI | DeepSeek-V4.1-Flash | 1/128% | 12 metrics +SynthPAI · DeepSeek-V4.1-Flash · TV SeriesPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | .87 | .09 | Pass |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| TV Series | SynthPAI | gpt-5.4-mini | 0/120% | 12 metrics +SynthPAI · gpt-5.4-mini · TV SeriesPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | .07 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| TV Series | SynthPAI | gpt-4o-mini | 0/120% | 12 metrics +SynthPAI · gpt-4o-mini · TV SeriesPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | <.01 | <.01 | Fail |
|---|
Structural viralitystructural_virality | Interaction | <.01 | <.01 | Fail |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | <.01 | <.01 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | .79 | .03 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | <.01 | Fail |
|---|
Impolite rateimpolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|
| TV Series | ThreadPDG | DeepSeek-V4.1-Flash | 11/1292% | 12 metrics +ThreadPDG · DeepSeek-V4.1-Flash · TV SeriesPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | .27 | .31 | Pass |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | .08 | .09 | Pass |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | .46 | .44 | Pass |
|---|
Average depthavg_depth | Interaction | .51 | .25 | Pass |
|---|
Structural viralitystructural_virality | Interaction | .63 | .76 | Pass |
|---|
Length variationlength_cv | Interaction | <.01 | <.01 | Fail |
|---|
Story probabilitymean_story_probability | Expression | .58 | .46 | Pass |
|---|
Emotion entropyemotion_entropy | Expression | .96 | .21 | Pass |
|---|
Polite ratepolite_rate | Tone | .61 | .72 | Pass |
|---|
Neutral rateneutral_rate | Tone | .20 | .34 | Pass |
|---|
Impolite rateimpolite_rate | Tone | .08 | .41 | Pass |
|---|
Hard disagreementhard_disagree_rate | Tone | .65 | .90 | Pass |
|---|
|
|---|
| TV Series | ThreadPDG | gpt-5.4-mini | 11/1292% | 12 metrics +ThreadPDG · gpt-5.4-mini · TV SeriesPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | .24 | .36 | Pass |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | 1.0 | .70 | Pass |
|---|
Average depthavg_depth | Interaction | .46 | .35 | Pass |
|---|
Structural viralitystructural_virality | Interaction | .58 | .74 | Pass |
|---|
Length variationlength_cv | Interaction | .06 | .16 | Pass |
|---|
Story probabilitymean_story_probability | Expression | .74 | .77 | Pass |
|---|
Emotion entropyemotion_entropy | Expression | .38 | .06 | Pass |
|---|
Polite ratepolite_rate | Tone | .19 | .14 | Pass |
|---|
Neutral rateneutral_rate | Tone | .43 | .30 | Pass |
|---|
Impolite rateimpolite_rate | Tone | .70 | .86 | Pass |
|---|
Hard disagreementhard_disagree_rate | Tone | .26 | .42 | Pass |
|---|
|
|---|
| TV Series | ThreadPDG | gpt-4o-mini | 4/1233% | 12 metrics +ThreadPDG · gpt-4o-mini · TV SeriesPublished rounded p-values and pass decisions| Metric | Family | MWU p | KS p | Decision |
|---|
Self-BLEU-4self_bleu_4 | Uniformity | <.01 | <.01 | Fail |
|---|
Self-BERTScoreself_bertscore_mean_f1 | Uniformity | <.01 | <.01 | Fail |
|---|
Semantic cosinesemantic_mean_cosine | Uniformity | <.01 | <.01 | Fail |
|---|
Average depthavg_depth | Interaction | .61 | .33 | Pass |
|---|
Structural viralitystructural_virality | Interaction | .82 | .89 | Pass |
|---|
Length variationlength_cv | Interaction | .05 | .11 | Pass |
|---|
Story probabilitymean_story_probability | Expression | .08 | .04 | Fail |
|---|
Emotion entropyemotion_entropy | Expression | <.01 | <.01 | Fail |
|---|
Polite ratepolite_rate | Tone | <.01 | <.01 | Fail |
|---|
Neutral rateneutral_rate | Tone | <.01 | .03 | Fail |
|---|
Impolite rateimpolite_rate | Tone | .18 | .15 | Pass |
|---|
Hard disagreementhard_disagree_rate | Tone | <.01 | <.01 | Fail |
|---|
|
|---|