2251-2300 of 10000 results (113ms)
2023-03-15 ยง
19:37 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on doh3001.wikimedia.org with reason: host reimage [production]
19:35 <cmjohnson@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ms-fe1013'] [production]
19:35 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['ms-fe1013'] [production]
19:33 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on doh1001.wikimedia.org with reason: host reimage [production]
19:32 <herron@cumin1001> START - Cookbook sre.hosts.reimage for host kafka-logging1001.eqiad.wmnet with OS bullseye [production]
19:32 <brett@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on doh3001.wikimedia.org with reason: host reimage [production]
19:31 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on doh2001.wikimedia.org with reason: host reimage [production]
19:28 <cmjohnson@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['thanos-fe1004'] [production]
19:27 <cmjohnson@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ms-fe1014.mgmt.eqiad.wmnet'] [production]
19:26 <brett@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on doh2001.wikimedia.org with reason: host reimage [production]
19:26 <brett@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on doh1001.wikimedia.org with reason: host reimage [production]
19:25 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on doh6002.wikimedia.org with reason: host reimage [production]
19:24 <cmjohnson@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['ms-fe1013'] [production]
19:22 <brett@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on doh6002.wikimedia.org with reason: host reimage [production]
19:17 <brett@cumin2002> START - Cookbook sre.ganeti.reimage for host doh1001.wikimedia.org with OS bullseye [production]
19:16 <brett@cumin2002> START - Cookbook sre.ganeti.reimage for host doh2001.wikimedia.org with OS bullseye [production]
19:15 <brett@cumin2002> END (PASS) - Cookbook sre.ganeti.reimage (exit_code=0) for host doh5002.wikimedia.org with OS bullseye [production]
19:14 <brett@cumin2002> START - Cookbook sre.ganeti.reimage for host doh3001.wikimedia.org with OS bullseye [production]
19:05 <brett@cumin2002> START - Cookbook sre.ganeti.reimage for host doh6002.wikimedia.org with OS bullseye [production]
19:03 <brett@cumin2002> END (PASS) - Cookbook sre.ganeti.reimage (exit_code=0) for host doh6001.wikimedia.org with OS bullseye [production]
18:52 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on doh5002.wikimedia.org with reason: host reimage [production]
18:49 <mutante> adding new language prefix anp.wikipedia.org - Angika, an Eastern Indo-Aryan language spoken in some parts of the Indian states of Bihar and Jharkhand, as well as in parts of Nepal. (T332115) [production]
18:49 <brett@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on doh5002.wikimedia.org with reason: host reimage [production]
18:46 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on doh6001.wikimedia.org with reason: host reimage [production]
18:42 <brett@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on doh6001.wikimedia.org with reason: host reimage [production]
18:25 <brett@cumin2002> START - Cookbook sre.ganeti.reimage for host doh6001.wikimedia.org with OS bullseye [production]
18:24 <brennen@deploy2002> Synchronized php: group1 wikis to 1.40.0-wmf.27 refs T330205 (duration: 06m 08s) [production]
18:20 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes; selector: service=thumbor,name=thumbor1006.eqiad.wmnet [production]
18:19 <brett@cumin2002> START - Cookbook sre.ganeti.reimage for host doh5002.wikimedia.org with OS bullseye [production]
18:18 <brennen@deploy2002> rebuilt and synchronized wikiversions files: group1 wikis to 1.40.0-wmf.27 refs T330205 [production]
18:12 <ebernhardson@deploy2002> Finished deploy [airflow-dags/search@8685c9e]: newly ported dags, reduce failures in map_subgraph_queries (duration: 00m 05s) [production]
18:12 <ebernhardson@deploy2002> Started deploy [airflow-dags/search@8685c9e]: newly ported dags, reduce failures in map_subgraph_queries [production]
18:06 <brennen> 1.40.0-wmf.27 train (T330205): no current blockers, rolling to group1. [production]
18:04 <brett@cumin2002> END (PASS) - Cookbook sre.ganeti.reimage (exit_code=0) for host doh5001.wikimedia.org with OS bullseye [production]
17:45 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes; selector: service=thumbor,name=thumbor1005.eqiad.wmnet [production]
17:45 <hnowlan@puppetmaster1001> conftool action : set/pooled=no; selector: service=thumbor,name=thumbor1006.eqiad.wmnet [production]
17:44 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes; selector: service=thumbor,name=thumbor1005.eqiad.wmnet [production]
17:43 <hnowlan@puppetmaster1001> conftool action : set/pooled=no; selector: service=thumbor,name=thumbor1005.eqiad.wmnet [production]
17:43 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes; selector: service=thumbor,name=thumbor1002.eqiad.wmnet [production]
17:43 <hnowlan@puppetmaster1001> conftool action : set/pooled=no; selector: service=thumbor,name=thumbor1002.eqiad.wmnet [production]
17:42 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on doh5001.wikimedia.org with reason: host reimage [production]
17:39 <brett@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on doh5001.wikimedia.org with reason: host reimage [production]
17:37 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes; selector: service=thumbor,name=thumbor1001.eqiad.wmnet [production]
17:36 <hnowlan@puppetmaster1001> conftool action : set/pooled=no; selector: service=thumbor,name=thumbor1001.eqiad.wmnet [production]
17:36 <hnowlan@puppetmaster1001> conftool action : set/pooled=no; selector: service=thumbor,name=thumbor1001.wmnet [production]
17:35 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes; selector: service=thumbor,name=thumbor2006.codfw.wmnet [production]
17:34 <sukhe@cumin2002> END (PASS) - Cookbook sre.ganeti.reimage (exit_code=0) for host doh4001.wikimedia.org with OS bullseye [production]
17:34 <hnowlan@puppetmaster1001> conftool action : set/pooled=no; selector: service=thumbor,name=thumbor2006.codfw.wmnet [production]
17:33 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes; selector: service=thumbor,name=thumbor2004.codfw.wmnet [production]
17:32 <hnowlan@puppetmaster1001> conftool action : set/pooled=no; selector: service=thumbor,name=thumbor2004.codfw.wmnet [production]