1901-1950 of 10000 results (31ms)
2020-07-29 ยง
14:27 <pt1979@cumin2001> START - Cookbook sre.dns.netbox [production]
13:55 <volans> migrating *all* codfw mgmt DNS records to the autogenerated ones via Netbox - T233183 [production]
13:50 <volans@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:45 <volans@cumin1001> START - Cookbook sre.dns.netbox [production]
13:29 <jayme@cumin1001> conftool action : set/pooled=yes; selector: name=wtp2001.codfw.wmnet [production]
13:05 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:05 <liw@deploy1001> Synchronized php: group1 wikis to 1.36.0-wmf.2 (duration: 01m 07s) [production]
13:04 <liw@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.36.0-wmf.2 [production]
13:03 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime [production]
12:58 <volans@cumin1001> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
12:56 <volans@cumin1001> START - Cookbook sre.dns.netbox [production]
12:49 <cmjohnson@cumin1001> END (ERROR) - Cookbook sre.dns.netbox (exit_code=97) [production]
12:48 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
12:44 <moritzm> imported curl 7.38.0-4+deb8u16+wmf1 to apt.wikimedia.org (jessie-wikimedia) T259102 [production]
12:30 <urbanecm@deploy1001> Synchronized wmf-config/interwiki.php: Update interwiki cache (duration: 02m 21s) [production]
12:28 <urbanecm@deploy1001> Synchronized langlist: Creating avkwiki (T257943) (duration: 01m 05s) [production]
12:27 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Creating avkwiki (T257943) (duration: 01m 03s) [production]
12:26 <urbanecm@deploy1001> Synchronized static/images/project-logos/: Creating avkwiki (T257943) (duration: 01m 06s) [production]
12:24 <urbanecm@deploy1001> rebuilt and synchronized wikiversions files: Creating avkwiki (T257943) [production]
12:15 <urbanecm@deploy1001> Synchronized dblists: Creating avkwiki (T257943) (duration: 01m 06s) [production]
12:14 <urbanecm@deploy1001> Synchronized wmf-config/db-codfw.php: Creating avkwiki (T257943) (duration: 01m 06s) [production]
12:12 <urbanecm@deploy1001> Synchronized wmf-config/db-eqiad.php: Creating avkwiki (T257943) (duration: 01m 05s) [production]
12:09 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
12:07 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
12:07 <moritzm> rebooting idp2001 for kernel update [production]
11:41 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 252bb6c1bf83d96a14a0ef63e06eb544eef8a00b: Add Wikipedia wordmark for trwiki (T255489; sync 2/2) (duration: 01m 05s) [production]
11:39 <urbanecm@deploy1001> Synchronized static/images/mobile/copyright/wikipedia-wordmark-tr.svg: 252bb6c1bf83d96a14a0ef63e06eb544eef8a00b: Add Wikipedia wordmark for trwiki (T255489; sync 1/2) (duration: 01m 06s) [production]
11:36 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 9f7e03292941d0d782437862f406efa7e1c6463e: Fix overindentation (duration: 01m 08s) [production]
11:11 <Lucas_WMDE> EU B&C window done [production]
11:09 <Lucas_WMDE> lucaswerkmeister-wmde@mwmaint1002:~$ printf 'https://en.wikipedia.org/static/images/project-logos/%s\n' 'wuuwiki.png' 'wuuwiki-1.5x.png' 'wuuwiki-2x.png' | mwscript purgeList.php # T259005 [production]
11:08 <lucaswerkmeister-wmde@deploy1001> Synchronized static/images/project-logos/: Config: [[gerrit:616760|Change the logo for Wu Wikipedia (T259005)]] (duration: 01m 08s) [production]
10:40 <vgutierrez> rolling upgrade of ATS to version 8.0.8-1wm2 [production]
10:21 <tstarling@deploy1001> Synchronized php-1.36.0-wmf.1/extensions/Score/includes/Score.php: do not offer .ly downloads (duration: 01m 07s) [production]
10:19 <tstarling@deploy1001> Synchronized php-1.36.0-wmf.1/extensions/Score/extension.json: do not offer .ly downloads (duration: 01m 20s) [production]
10:12 <vgutierrez> upgrade ATS to version 8.0.8-1wm2 on cp3064 and cp3065 [production]
09:44 <vgutierrez> upgrade ATS to version 8.0.8-1wm2 on cp5006 and cp5012 [production]
09:20 <jayme@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
09:20 <jayme@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:16 <vgutierrez> upgrade ATS to version 8.0.8-1wm2 on cp4026 and cp4032 [production]
09:15 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1112', diff saved to https://phabricator.wikimedia.org/P12115 and previous config saved to /var/cache/conftool/dbconfig/20200729-091528-marostegui.json [production]
09:15 <vgutierrez> upload trafficserver 8.0.8-1wm2 to apt.wm.o (buster) [production]
09:13 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1112', diff saved to https://phabricator.wikimedia.org/P12114 and previous config saved to /var/cache/conftool/dbconfig/20200729-091319-marostegui.json [production]
09:10 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1112', diff saved to https://phabricator.wikimedia.org/P12113 and previous config saved to /var/cache/conftool/dbconfig/20200729-091006-marostegui.json [production]
08:55 <marostegui> The above was db1112 [production]
08:55 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1121', diff saved to https://phabricator.wikimedia.org/P12112 and previous config saved to /var/cache/conftool/dbconfig/20200729-085504-marostegui.json [production]
08:42 <jayme@cumin1001> conftool action : set/pooled=inactive; selector: name=wtp2001.codfw.wmnet [production]
08:26 <filippo@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
08:24 <filippo@cumin1001> START - Cookbook sre.hosts.downtime [production]
08:05 <marostegui> Deploy MCR schema change on db1121 (lag will show up on s4), also remove triggers on db1124:3314 [production]
08:04 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1121', diff saved to https://phabricator.wikimedia.org/P12111 and previous config saved to /var/cache/conftool/dbconfig/20200729-080442-marostegui.json [production]