CB 横条弹窗 A/B · 数据回收(6/19-20 早期)

结账页遮挡假设验证 · 实验组横条 vs 对照组原 CB 弹窗 · 含回收逻辑 / 计算逻辑 / 完整 SQL
口径:人群包 100000426(近30d 结账/购物车页 ≤3s 秒关 CB 者)· 首批 7 家(shein/shopee.com.br/tesco/lowes/aliexpress/etsy/samsclub)· 仅桌面 · 版本 ≥6.30.69(20% 放量,2026-06-18 上线)· 分组 人群标识 s_popup(1=实验横条 / 0=对照弹窗)· 窗口 2026-06-19 ~ 06-20(6/21 尚未 ETL 落库)· 数据源 cp_dw / StarRocks · 订单 T+0~2 严重不全
一句话结论(早期 · 样本极小 · 不可下结论):横条 关闭率 34.5% < 弹窗 50.2%(更不挡操作、秒关↓,贴合假设),但 CTR 11.9% < 弹窗 28.8%(点击也腰斩)→ 更像横条不够显眼(banner-blindness)。且实验组 2 天仅 84 曝光 / 10 点击,两臂曝光 ≈ 1:10 不均衡,shein 开关未开(曝光 0)→ 需推动铺量 + 等订单 T+4 再复评

① 回收逻辑

分组(人群标识 s_popup + 版本门槛)

严格漏斗串联(看到 → 点击/关闭同一条弹窗 → 激活 → SP → 下单)

数据源表

环节关键字段
曝光v_dwd_log_parse_extension_service_impress_diguid / type / scene / version / impress_id / extra(s_popup,cb_small_popup)
点击·关闭v_dwd_log_cp_click_cb_log_diclient_id / impress_id / click_id / action(click/close)
激活成功(出站)dwd_log_event_outbound_result_det_dtracking_id / business / outbound_state / _reason / _reason_type / access_at
SPdws_log_sp_user_shopping_journey_detail_diguid / domain
订单dwd_trd_user_orders_diguid / tracking_id / is_cb_order / sales / commission / created_time
分桶人数dws_dmp_guid_group_list_daily_dguid / group_id_list(array)

② 计算逻辑(每指标定义)

指标定义 / 公式(均按 guid 去重)
组人数DMP 分桶 assignment 的 UV(exp=arm2 / ctrl=arm1)
曝光UV该组(s_popup)+ version≥6.30.69 + CB Popup + 7家 的 distinct guid
曝光率曝光UV ÷ 组人数
点击UV曝光人群中,存在 action='click' 且 impress_id 命中曝光的 distinct guid
CTR点击UV ÷ 曝光UV
关闭UV曝光人群中,存在 action='close' 且 impress_id 命中曝光的 distinct guid
关闭率关闭UV ÷ 曝光UV
激活成功UV点击人群中,click_id=出站tracking_id 且 business='2'(CB) outbound_state='1' 且排除 (state=1 AND reason=0 AND type=1) 的 distinct guid
激活成功率激活成功UV ÷ 点击UV
SP人数激活人群中,在 7 家有 SP 事件的 distinct guid
下单人数 / 订单数click_id=订单tracking_id 的 CB 单:distinct guid / distinct order_id
sales / commission上述 CB 单的 sum(sales) / sum(commission)(⚠️ T+0~2 不全)

③ 汇总数据

组人数曝光UV曝光率点击UVCTR关闭UV关闭率激活成功UV激活成功率SP下单订单salescomm
实验(横条)31,575840.266%1011.90%2934.52%10100%422$12.68$0.76
对照(弹窗)31,7648612.711%24828.80%43250.17%24598.79%12241121$2,279.77$75.74

对照曝光 861 已与 ava 口径校准一致。激活成功率两组 ~100%(点击即激活有效)。

④ 按天

日期组人数曝光UV曝光率点击UVCTR关闭UV关闭率激活成功UV激活成功率SP下单订单salescomm
6/19实验31,575500.158%714.00%1734.00%7100%211$5.23$0.36
6/19对照31,7644611.451%13930.15%22448.59%13798.56%652167$1,419.06$53.08
6/20实验31,575380.120%37.89%1231.58%3100%211$7.45$0.40
6/20对照31,7644481.410%11926.56%22149.33%11899.16%622154$860.71$22.66

⑤ 按商家

商家曝光UV曝光率点击UVCTR关闭UV关闭率激活成功率SP下单订单salescomm
aliexpress实验420.133%716.67%1228.57%100%322$12.68$0.76
aliexpress对照5061.593%17033.60%23045.45%99.4%9226101$1,219.27$60.94
shopee.com.br实验180.057%15.56%738.89%100%000
shopee.com.br对照1230.387%3931.71%5847.15%100%1169$152.13$0.97
etsy实验60.019%00%350.00%000
etsy对照850.268%89.41%4552.94%100%324$33.11$1.66
lowes实验80.025%112.50%562.50%100%000
lowes对照640.201%1015.63%4367.19%90%211$545.16$10.90
samsclub实验60.019%116.67%233.33%100%100
samsclub对照350.110%514.29%2365.71%100%333$0$0
tesco实验50.016%00%00%000
tesco对照510.161%1631.37%3364.71%93.8%1133$330.10$1.27
shein对照20.006%00%150.00%000
shein实验00%

⚠️ shein 实验组曝光 0 = 商家横条开关(cb:cb:small:frame)未开;aliexpress 是唯一有像样量的商家。

⑥ 完整 SQL(可复跑 · StarRocks / cp_dw db35)

汇总查询如下;按天 / 按商家只需在最外层 SELECTGROUP BY 增加 e.dt / e.mch

WITH
-- 组人数:DMP 镜像表分桶 (50/50 assignment)
arm_size AS (
  SELECT CASE WHEN array_contains(group_id_list,'100000426_2') THEN 'exp' ELSE 'ctrl' END grp,
         COUNT(DISTINCT guid) arm_n
  FROM dws_dmp_guid_group_list_daily_d
  WHERE pt='2026-06-20'
    AND (array_contains(group_id_list,'100000426_1') OR array_contains(group_id_list,'100000426_2'))
  GROUP BY 1),
-- 曝光:人群标识 s_popup 分组 + version>=6.30.69 + CB Popup + 7家
expo AS (
  SELECT i.guid, i.impress_id, i.pt dt, i.sub_domain mch,
         CASE WHEN get_json_string(i.extra,'$.s_popup')='1' THEN 'exp' ELSE 'ctrl' END grp
  FROM v_dwd_log_parse_extension_service_impress_di i
  WHERE i.pt >= '2026-06-19' AND i.type='CB' AND i.scene='Popup' AND i.version >= '6.30.69'
    AND i.sub_domain IN ('shein.com','shopee.com.br','tesco.com','lowes.com','aliexpress.com','etsy.com','samsclub.com')
    AND get_json_string(i.extra,'$.s_popup') IN ('0','1')),
-- 点击/关闭:靠 impress_id 回连"被曝光的同一条弹窗"
clk AS (SELECT DISTINCT impress_id, click_id, client_id guid FROM v_dwd_log_cp_click_cb_log_di
  WHERE pt >= '2026-06-19' AND action='click' AND impress_id IS NOT NULL
    AND sub_domain IN ('shein.com','shopee.com.br','tesco.com','lowes.com','aliexpress.com','etsy.com','samsclub.com')),
cls AS (SELECT DISTINCT impress_id, client_id guid FROM v_dwd_log_cp_click_cb_log_di
  WHERE pt >= '2026-06-19' AND action='close' AND impress_id IS NOT NULL
    AND sub_domain IN ('shein.com','shopee.com.br','tesco.com','lowes.com','aliexpress.com','etsy.com','samsclub.com')),
-- 激活成功:出站 CB(business=2) 成功,排除(state=1&reason=0&type=1)
act AS (SELECT DISTINCT tracking_id FROM dwd_log_event_outbound_result_det_d
  WHERE DATE(access_at) >= '2026-06-19' AND business='2' AND outbound_state='1'
    AND NOT (outbound_state_reason='0' AND outbound_state_reason_type='1')
    AND subdomain IN ('shein.com','shopee.com.br','tesco.com','lowes.com','aliexpress.com','etsy.com','samsclub.com')),
sp AS (SELECT DISTINCT guid FROM dws_log_sp_user_shopping_journey_detail_di
  WHERE pt >= '2026-06-19'
    AND domain IN ('shein.com','shopee.com.br','tesco.com','lowes.com','aliexpress.com','etsy.com','samsclub.com')),
ord AS (SELECT tracking_id, order_id, sales, commission FROM dwd_trd_user_orders_di
  WHERE DATE(created_time) >= '2026-06-19' AND is_cb_order=1
    AND root_domain IN ('shein.com','shopee.com.br','tesco.com','lowes.com','aliexpress.com','etsy.com','samsclub.com'))
SELECT e.grp 组,
  MAX(z.arm_n) 组人数,
  COUNT(DISTINCT e.guid) 曝光UV,
  ROUND(COUNT(DISTINCT e.guid)*100.0/NULLIF(MAX(z.arm_n),0),3) 曝光率,
  COUNT(DISTINCT CASE WHEN c.impress_id IS NOT NULL THEN e.guid END) 点击UV,
  ROUND(COUNT(DISTINCT CASE WHEN c.impress_id IS NOT NULL THEN e.guid END)*100.0
        /NULLIF(COUNT(DISTINCT e.guid),0),2) CTR,
  COUNT(DISTINCT CASE WHEN cl.impress_id IS NOT NULL THEN e.guid END) 关闭UV,
  ROUND(COUNT(DISTINCT CASE WHEN cl.impress_id IS NOT NULL THEN e.guid END)*100.0
        /NULLIF(COUNT(DISTINCT e.guid),0),2) 关闭率,
  COUNT(DISTINCT CASE WHEN a.tracking_id IS NOT NULL THEN e.guid END) 激活成功UV,
  ROUND(COUNT(DISTINCT CASE WHEN a.tracking_id IS NOT NULL THEN e.guid END)*100.0
        /NULLIF(COUNT(DISTINCT CASE WHEN c.impress_id IS NOT NULL THEN e.guid END),0),2) 激活成功率,
  COUNT(DISTINCT CASE WHEN a.tracking_id IS NOT NULL AND s.guid IS NOT NULL THEN e.guid END) SP人数,
  COUNT(DISTINCT CASE WHEN o.tracking_id IS NOT NULL THEN e.guid END) 下单人数,
  COUNT(DISTINCT o.order_id) 订单数,
  ROUND(SUM(o.sales),2) sales, ROUND(SUM(o.commission),2) commission
FROM expo e
JOIN arm_size z ON e.grp=z.grp
LEFT JOIN clk c  ON e.impress_id=c.impress_id   -- 点击⊆曝光(同一条弹窗)
LEFT JOIN cls cl ON e.impress_id=cl.impress_id  -- 关闭⊆曝光(同一条弹窗)
LEFT JOIN act a  ON c.click_id=a.tracking_id    -- 激活⊆点击
LEFT JOIN sp  s  ON e.guid=s.guid
LEFT JOIN ord o  ON c.click_id=o.tracking_id    -- 下单⊆点击(CB归因)
GROUP BY e.grp
ORDER BY e.grp;

⑦ 读数与数据质量

下一步:推动 shein 等商家横条开关全开 + 排查实验臂仅 0.27% 触发横条的原因 → 放量到两臂曝光均衡(每臂≥几百 UV)+ 等订单 T+4 → 用本页 SQL(s_popup 分组 + version≥6.30.69 + impress_id/click_id 严格串联)复评。