CB 横条弹窗 A/B · 数据回收(自上线 6/19 ~ 6/25)

结账页遮挡假设验证 · 实验组横条 vs 对照组原 CB 弹窗 · 已用 DMP 人群包分桶(ITT)干净口径重算
口径:人群包 100000426(近30d 结账/购物车页 ≤3s 秒关 CB 者,每臂~3万)· 首批 8 家 · 仅桌面 · 版本 ≥6.30.69(6/18 上线,6/22 起大盘活跃度升,两臂同步)· 分组 = DMP 分桶 dws_dmp_guid_group_list_daily_d(100000426_2=实验 / _1=对照),按分配 ITT · 悬浮球 scene=FloatWin 按「同用户+同商家+同天」归因 · 窗口 6/19~6/25 · cp_dw/StarRocks · 订单 6/23-25 仍 T+1~3 不全
⚠️ 口径修正(v3,重要):此前用 extra.s_popup='0' 当对照组是错的——s_popup='0'全站所有用户普通 CB 弹窗的默认值,不是人群包对照臂。DMP 交叉验证:人群包对照臂当天仅 ~580 人有弹窗曝光,而 s_popup='0' 全站有 5,047 人 → 旧"对照组"混进了 ~4,467 个人群包之外的用户,把曝光做成假的「1:10 不均衡」、把对照 CTR 抬到全站的 25%。本版两臂都限定 DMP 人群包(_1 vs _2),曝光均衡(2,483 vs 2,527),对照 CTR 回落到秒关人群真实的 ~14%。实验组 s_popup='1' 本就≈纯净(554/555 落在 _2),无需改。
一句话结论(DMP 干净口径 · 自上线 7 天 · 待 T+4 收口): 横条 关闭率 57.9% ≪ 弹窗 80.2%(-22.3pp) ✅「遮挡假设」成立且信号更强(真对照是秒关人群,本就 80% 高关闭,横条把它压到 58%); CTR 9.3% < 弹窗 14.1%(-4.8pp)——横条点击仍偏低,但差距远小于此前污染口径的 -14pp。被横条"少关掉"的 22pp 用户大多转为忽略而非点击(banner-blindness)。悬浮球(同次访问)把横条拉到 横条+悬浮 CTR 10.6%、下单率/曝光 1.65%→2.09%,真实但有限,单位曝光转化仍约弹窗 66%

① 三组对比(核心 · DMP 人群包口径 · 6/19~6/25)

两臂均按 DMP 分桶分配(ITT):实验=横条臂(_2),对照=弹窗臂(_1)。实验组拆 横条横条+悬浮(同次访问悬浮球去重并集)。曝光率分母=DMP 分桶人数(exp 29,652 / ctrl 29,894)。下单率/曝光、佣金/曝光为归一化指标。

曝光UV曝光率点击UVCTR关闭率激活激活率下单UV订单sales佣金下单率/曝光佣金/曝光
对照 · 弹窗2,5278.45%35714.13%80.17%34095.24%71333$6,373.33$197.452.81%$0.0781
对照 · 弹窗+悬浮2,5278.45%38415.2%36695.31%80370$6,779.79$217.003.17%$0.0859
实验 · 横条2,4838.37%2319.3%57.87%22296.1%4194$1,811.23$58.851.65%$0.0237
实验 · 横条+悬浮2,4838.37%26210.55%25296.18%52114$5,579.67$97.912.09%$0.0394

两臂曝光率几乎相等(8.37% vs 8.45%)= A/B 分桶健康、弹窗/横条触发覆盖均衡。激活率两组 ~95-96%(点击即激活,瓶颈在点击)。订单 6/23-25 T+1~3 不全,佣金对比仅供参考(小样本+延迟)。

② 悬浮球归因阶梯(口径松紧)

悬浮球(FloatWin)是 CB 弹窗/横条关闭后页面残留悬浮窗,独立 impression(与横条 impress_id 0 命中)→ 只能按 client_id(guid) 归属。曝光表无 session_id,用「同用户+同商家+同天」近似同次访问。下表为点击UV 三档(本报告采用中间档):
实验组悬浮球口径点击UV
loose 任意站点(高估)64
同商家+同天(同次访问·采用)34
同页 exact-url(偏低)12
对照组悬浮球口径点击UV
loose 任意站点(高估)66
同商家+同天(同次访问·采用)33
同页 exact-url(偏低)15

loose(任意站点)会把用户在别的页/别的站点的悬浮球也算进来(高估);同页 exact-url 因悬浮球跨页跟随会偏低。取中间「同次访问」。悬浮球完整漏斗已并入①的「横条+悬浮」「弹窗+悬浮」行。

③ 按天(DMP 口径 · 两臂每天均衡)

日期曝光UV点击UVCTR关闭率下单UV订单佣金
2026-06-19对照1031716.5%70.87%316$2.95
2026-06-19实验8789.2%58.62%11$0.36
2026-06-20对照871213.79%73.56%37$1.19
2026-06-20实验8866.82%65.91%22$0.40
2026-06-21对照1141412.28%83.33%35$56.59
2026-06-21实验9877.14%64.29%413$12.18
2026-06-22对照7609011.84%78.68%2155$33.89
2026-06-22实验719608.34%60.92%716$7.24
2026-06-23对照93911011.71%80.62%32145$67.88
2026-06-23实验944687.2%61.33%1430$22.22
2026-06-24对照5448215.07%66.73%1767$22.53
2026-06-24实验568559.68%38.56%1319$11.70
2026-06-25对照58210017.18%66.67%1038$12.42
2026-06-25实验558549.68%31.0%513$4.75

两臂逐日曝光基本相等(如 6/23 对照 939 / 实验 944)。6/22 起量升是大盘活跃度,两臂同步,非分桶问题。横条关闭率每天都明显低于弹窗,CTR 每天都略低于弹窗。6/23-25 订单 T+1~3 偏低。

④ 按商家(DMP 口径)

商家曝光UV点击UVCTR关闭率下单UV订单佣金
aliexpress.com对照104419418.58%77.87%37293$124.87
aliexpress.com实验103814013.49%57.32%2578$52.53
etsy.com对照24172.9%84.65%33$43.59
etsy.com实验24552.04%76.33%11$0.41
lowes.com对照125129.6%84.0%34$19.77
lowes.com实验10776.54%66.36%22$2.52
samsclub.com对照16074.38%82.5%33$0.00
samsclub.com实验19473.61%60.82%33$0.16
shein.com对照700.0%85.71%00$—
shein.com实验1400.0%57.14%00$—
shopee.com.br对照5149418.29%74.71%1417$1.62
shopee.com.br实验485398.04%42.68%44$0.41
target.com对照315278.57%81.9%34$2.98
target.com实验273186.59%65.57%33$1.50
tesco.com对照2012110.45%84.08%89$4.63
tesco.com实验194168.25%45.88%33$1.32

各商家两臂曝光均衡。横条 CTR 普遍略低于弹窗、关闭率普遍明显低于弹窗。aliexpress 量最大(实验 1038 曝光 / CTR 13.5% vs 弹窗 18.6%);shein 两臂都几乎无量(7/14 曝光)= 商家横条/弹窗在该站基本没触发

⑤ 读数与结论(修正版)

建议:①横条「不挡操作」已强证实(关闭率↓22pp),方向正确;但 CTR 仍偏低、悬浮球只补 +1.3pp → 按 PRD 既定应对加「显眼度」(首屏微动效、放大预估金额、强化 Coupert 标识)把被"放过"的 22pp 忽略用户转化为点击;②等 6/29 T+4 订单收口后,用 DMP 口径看下单率/曝光是否随放量稳定(当前 66%)再定全量;③shein 等无量商家排查触发条件。

⑥ 计算逻辑 & 口径

⑦ 完整 SQL(DMP 口径 · 可复跑)

WITH dmp AS (   -- ⭐分组用 DMP 分桶,不用 s_popup
  SELECT guid, CASE WHEN array_contains(group_id_list,'100000426_2') THEN 'exp' ELSE 'ctrl' END grp
  FROM dws_dmp_guid_group_list_daily_d WHERE pt='2026-06-24'
    AND (array_contains(group_id_list,'100000426_1') OR array_contains(group_id_list,'100000426_2'))),
expo AS (SELECT i.impress_id, i.guid, i.sub_domain mch, substr(i.create_time,1,10) d, dm.grp
  FROM v_dwd_log_parse_extension_service_impress_di i JOIN dmp dm ON i.guid=dm.guid
  WHERE i.pt BETWEEN '2026-06-19' AND '2026-06-25' AND i.type='CB' AND i.scene='Popup' AND i.version>='6.30.69'
    AND i.sub_domain IN ('shein.com','shopee.com.br','tesco.com','lowes.com','target.com','aliexpress.com','etsy.com','samsclub.com')
    AND i.impress_id IS NOT NULL),
bp AS (SELECT DISTINCT grp, guid, mch, d FROM expo),
clkraw AS (SELECT client_id guid, click_id, impress_id, scene, sub_domain mch, substr(access_time,1,10) d
  FROM v_dwd_log_cp_click_cb_log_di WHERE pt BETWEEN '2026-06-19' AND '2026-06-25' AND action='click' AND click_id IS NOT NULL),
barclk AS (SELECT e.grp, c.guid, c.click_id, 'bar' src FROM clkraw c JOIN expo e ON c.impress_id=e.impress_id),
floclk AS (SELECT DISTINCT bp.grp, c.guid, c.click_id, 'float' src
  FROM clkraw c JOIN bp ON c.guid=bp.guid AND c.mch=bp.mch AND c.d=bp.d WHERE c.scene='FloatWin'),
allclk AS (SELECT DISTINCT grp,guid,click_id,src FROM (SELECT * FROM barclk UNION ALL SELECT * FROM floclk) u),
act AS (SELECT DISTINCT tracking_id FROM dwd_log_event_outbound_result_det_d
  WHERE DATE(access_at) BETWEEN '2026-06-19' AND '2026-06-30' AND business='2' AND outbound_state='1'
    AND NOT(outbound_state_reason='0' AND outbound_state_reason_type='1')),
ord AS (SELECT tracking_id, order_id, sales, commission FROM dwd_trd_user_orders_di
  WHERE create_date BETWEEN '2026-06-19' AND '2026-06-27' AND is_cb_order=1)
SELECT a.grp, a.src, COUNT(DISTINCT a.guid) clk_uv,
  COUNT(DISTINCT CASE WHEN ac.tracking_id IS NOT NULL THEN a.guid END) act_uv,
  COUNT(DISTINCT CASE WHEN o.order_id IS NOT NULL THEN a.guid END) ord_uv,
  COUNT(DISTINCT o.order_id) orders, ROUND(SUM(o.commission),2) comm
FROM allclk a LEFT JOIN act ac ON a.click_id=ac.tracking_id LEFT JOIN ord o ON a.click_id=o.tracking_id
GROUP BY GROUPING SETS ((a.grp,a.src),(a.grp)) ORDER BY a.grp,a.src;
-- 曝光UV/关闭UV:expo LEFT JOIN (action='close' DISTINCT impress_id) ON impress_id, GROUP BY grp