751-800 of 10000 results (16ms)
2020-10-06 ยง
21:42 <ryankemper@deploy1001> Started deploy [wdqs/wdqs@e56a20e]: 0.3.51 [production]
21:14 <ppchelko@deploy1001> Synchronized wmf-config/CommonSettings.php: gerrit:632535 (duration: 01m 00s) [production]
20:25 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:23 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
18:40 <Urbanecm> Morning B&C done [production]
18:40 <urbanecm@deploy1001> Synchronized php-1.36.0-wmf.11/skins/MinervaNeue/: 2118d265c0f5b6c914efeba86ba7eacd30c5ee0f: Hot fix: Use display for hiding/showing sidebar on OS 14_0 (T264376) (duration: 01m 00s) [production]
18:37 <urbanecm@deploy1001> Synchronized php-1.36.0-wmf.10/skins/MinervaNeue/: d428ccbdf3be9a45139f8b8c0874c113f1732198: Hot fix: Use display for hiding/showing sidebar on OS 14_0 (T264376) (duration: 01m 03s) [production]
18:24 <ppchelko@deploy1001> Synchronized wmf-config/Wikibase.php: Wikibase.php gerrit:631775 T263493 T259622 (duration: 00m 58s) [production]
18:23 <ppchelko@deploy1001> Synchronized wmf-config/InitialiseSettings.php: IS.php gerrit:631775 T263493 T259622 (duration: 00m 59s) [production]
18:19 <ppchelko@deploy1001> Synchronized wmf-config/InitialiseSettings.php: gerrit:632516 T264043 (duration: 00m 59s) [production]
18:15 <ppchelko@deploy1001> Synchronized wmf-config/InitialiseSettings.php: gerrit:632323 T264637 (duration: 00m 58s) [production]
18:12 <ppchelko@deploy1001> Synchronized wmf-config/InitialiseSettings.php: gerrit:632484 T264637 (duration: 00m 58s) [production]
15:41 <godog> centrallog* delete archived logs from old, single file, organization [production]
15:23 <jayme@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'citoid' for release 'production' . [production]
15:23 <jayme> updated envoyproxy to 1.15.1-2 on mw-canary and restbase-canary [production]
14:57 <sukhe> upload dnsdist_1.5.0-1wm1 to apt.wm.o (buster) - T263789 [production]
14:47 <kormat@cumin1001> dbctl commit (dc=all): 'db2137:3314 (re)pooling @ 100%: schema change T259831', diff saved to https://phabricator.wikimedia.org/P12936 and previous config saved to /var/cache/conftool/dbconfig/20201006-144701-kormat.json [production]
14:45 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:45 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:45 <vgutierrez> Bump ECDHE-ECDSA-AES128-SHA pageview replacement to 5% - T262946 [production]
14:45 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:44 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:40 <jayme> updated envoyproxy to 1.15.1-2 on mw2295.codfw.wmnet,restbase2017.codfw.wmnet [production]
14:38 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes; selector: dc=codfw,cluster=restbase,service=restbase-backend,name=restbase2009.codfw.wmnet [production]
14:38 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes; selector: dc=codfw,cluster=restbase,service=restbase-ssl,name=restbase2009.codfw.wmnet [production]
14:38 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes; selector: dc=codfw,cluster=restbase,service=restbase,name=restbase2009.codfw.wmnet [production]
14:36 <hnowlan> repooling restbase2009 [production]
14:31 <kormat@cumin1001> dbctl commit (dc=all): 'db2137:3314 (re)pooling @ 75%: schema change T259831', diff saved to https://phabricator.wikimedia.org/P12935 and previous config saved to /var/cache/conftool/dbconfig/20201006-143157-kormat.json [production]
14:19 <volker-e@deploy1001> Finished deploy [design/style-guide@e3fda83]: Deploy design/style-guide: (duration: 00m 05s) [production]
14:19 <volker-e@deploy1001> Started deploy [design/style-guide@e3fda83]: Deploy design/style-guide: [production]
14:15 <jayme> installed envoyproxy 1.15.1-2 on mwdebug1001 [production]
14:08 <marostegui> Reboot db1076 for kernel upgrade T264755 [production]
14:04 <jayme@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'citoid' for release 'production' . [production]
14:03 <marostegui> Power cycle db1076 T264755 [production]
13:58 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1076 ', diff saved to https://phabricator.wikimedia.org/P12934 and previous config saved to /var/cache/conftool/dbconfig/20201006-135810-marostegui.json [production]
13:41 <kormat@cumin1001> dbctl commit (dc=all): 'db2137:3314 depooling: schema change T259831', diff saved to https://phabricator.wikimedia.org/P12932 and previous config saved to /var/cache/conftool/dbconfig/20201006-134149-kormat.json [production]
13:41 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:41 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
13:40 <kormat@cumin1001> dbctl commit (dc=all): 'Remove db2119 from dump/vslow, add to all other contributions/logpager/recentchanges*/watchlist temporarily T259831', diff saved to https://phabricator.wikimedia.org/P12931 and previous config saved to /var/cache/conftool/dbconfig/20201006-134020-kormat.json [production]
13:40 <jayme@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'citoid' for release 'staging' . [production]
13:14 <jayme> pushed docker-registry.discovery.wmnet/envoy:1.15.1-2 - T264157 [production]
13:04 <marostegui> Change innodb_change_buffering = inserts on db2075 db2089 db2099 db2111 db2128 T263443 [production]
12:55 <godog> swift codfw-prod: bump weight for ms-be2057 - T261633 [production]
12:20 <elukey> update HDFS Namenode GC/Heap settings on an-master100[1,2] [production]
12:13 <jayme> imported envoyproxy_1.15.1-2 to buster-wikimedia and stretch-wikimedia [production]
12:08 <jbond42> deploy puppetlabs-stdlib 5.2 [production]
11:50 <ayounsi@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
11:42 <ayounsi@cumin1001> START - Cookbook sre.dns.netbox [production]
11:39 <ayounsi@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
11:35 <ayounsi@cumin1001> START - Cookbook sre.dns.netbox [production]