|
2020-07-29
ยง
|
| 14:29 |
<moritzm> |
installing exiv2 security updates |
[production] |
| 14:27 |
<pt1979@cumin2001> |
START - Cookbook sre.dns.netbox |
[production] |
| 13:55 |
<volans> |
migrating *all* codfw mgmt DNS records to the autogenerated ones via Netbox - T233183 |
[production] |
| 13:50 |
<volans@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 13:45 |
<volans@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 13:29 |
<jayme@cumin1001> |
conftool action : set/pooled=yes; selector: name=wtp2001.codfw.wmnet |
[production] |
| 13:05 |
<cmjohnson@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 13:05 |
<liw@deploy1001> |
Synchronized php: group1 wikis to 1.36.0-wmf.2 (duration: 01m 07s) |
[production] |
| 13:04 |
<liw@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.36.0-wmf.2 |
[production] |
| 13:03 |
<cmjohnson@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 12:58 |
<volans@cumin1001> |
END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) |
[production] |
| 12:56 |
<volans@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 12:49 |
<cmjohnson@cumin1001> |
END (ERROR) - Cookbook sre.dns.netbox (exit_code=97) |
[production] |
| 12:48 |
<cmjohnson@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 12:44 |
<moritzm> |
imported curl 7.38.0-4+deb8u16+wmf1 to apt.wikimedia.org (jessie-wikimedia) T259102 |
[production] |
| 12:30 |
<urbanecm@deploy1001> |
Synchronized wmf-config/interwiki.php: Update interwiki cache (duration: 02m 21s) |
[production] |
| 12:28 |
<urbanecm@deploy1001> |
Synchronized langlist: Creating avkwiki (T257943) (duration: 01m 05s) |
[production] |
| 12:27 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Creating avkwiki (T257943) (duration: 01m 03s) |
[production] |
| 12:26 |
<urbanecm@deploy1001> |
Synchronized static/images/project-logos/: Creating avkwiki (T257943) (duration: 01m 06s) |
[production] |
| 12:24 |
<urbanecm@deploy1001> |
rebuilt and synchronized wikiversions files: Creating avkwiki (T257943) |
[production] |
| 12:15 |
<urbanecm@deploy1001> |
Synchronized dblists: Creating avkwiki (T257943) (duration: 01m 06s) |
[production] |
| 12:14 |
<urbanecm@deploy1001> |
Synchronized wmf-config/db-codfw.php: Creating avkwiki (T257943) (duration: 01m 06s) |
[production] |
| 12:12 |
<urbanecm@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Creating avkwiki (T257943) (duration: 01m 05s) |
[production] |
| 12:09 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 12:07 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 12:07 |
<moritzm> |
rebooting idp2001 for kernel update |
[production] |
| 11:41 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: 252bb6c1bf83d96a14a0ef63e06eb544eef8a00b: Add Wikipedia wordmark for trwiki (T255489; sync 2/2) (duration: 01m 05s) |
[production] |
| 11:39 |
<urbanecm@deploy1001> |
Synchronized static/images/mobile/copyright/wikipedia-wordmark-tr.svg: 252bb6c1bf83d96a14a0ef63e06eb544eef8a00b: Add Wikipedia wordmark for trwiki (T255489; sync 1/2) (duration: 01m 06s) |
[production] |
| 11:36 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: 9f7e03292941d0d782437862f406efa7e1c6463e: Fix overindentation (duration: 01m 08s) |
[production] |
| 11:11 |
<Lucas_WMDE> |
EU B&C window done |
[production] |
| 11:09 |
<Lucas_WMDE> |
lucaswerkmeister-wmde@mwmaint1002:~$ printf 'https://en.wikipedia.org/static/images/project-logos/%s\n' 'wuuwiki.png' 'wuuwiki-1.5x.png' 'wuuwiki-2x.png' | mwscript purgeList.php # T259005 |
[production] |
| 11:08 |
<lucaswerkmeister-wmde@deploy1001> |
Synchronized static/images/project-logos/: Config: [[gerrit:616760|Change the logo for Wu Wikipedia (T259005)]] (duration: 01m 08s) |
[production] |
| 10:40 |
<vgutierrez> |
rolling upgrade of ATS to version 8.0.8-1wm2 |
[production] |
| 10:21 |
<tstarling@deploy1001> |
Synchronized php-1.36.0-wmf.1/extensions/Score/includes/Score.php: do not offer .ly downloads (duration: 01m 07s) |
[production] |
| 10:19 |
<tstarling@deploy1001> |
Synchronized php-1.36.0-wmf.1/extensions/Score/extension.json: do not offer .ly downloads (duration: 01m 20s) |
[production] |
| 10:12 |
<vgutierrez> |
upgrade ATS to version 8.0.8-1wm2 on cp3064 and cp3065 |
[production] |
| 09:44 |
<vgutierrez> |
upgrade ATS to version 8.0.8-1wm2 on cp5006 and cp5012 |
[production] |
| 09:20 |
<jayme@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 09:20 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 09:16 |
<vgutierrez> |
upgrade ATS to version 8.0.8-1wm2 on cp4026 and cp4032 |
[production] |
| 09:15 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Fully repool db1112', diff saved to https://phabricator.wikimedia.org/P12115 and previous config saved to /var/cache/conftool/dbconfig/20200729-091528-marostegui.json |
[production] |
| 09:15 |
<vgutierrez> |
upload trafficserver 8.0.8-1wm2 to apt.wm.o (buster) |
[production] |
| 09:13 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1112', diff saved to https://phabricator.wikimedia.org/P12114 and previous config saved to /var/cache/conftool/dbconfig/20200729-091319-marostegui.json |
[production] |
| 09:10 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1112', diff saved to https://phabricator.wikimedia.org/P12113 and previous config saved to /var/cache/conftool/dbconfig/20200729-091006-marostegui.json |
[production] |
| 08:55 |
<marostegui> |
The above was db1112 |
[production] |
| 08:55 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1121', diff saved to https://phabricator.wikimedia.org/P12112 and previous config saved to /var/cache/conftool/dbconfig/20200729-085504-marostegui.json |
[production] |
| 08:42 |
<jayme@cumin1001> |
conftool action : set/pooled=inactive; selector: name=wtp2001.codfw.wmnet |
[production] |
| 08:26 |
<filippo@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 08:24 |
<filippo@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 08:05 |
<marostegui> |
Deploy MCR schema change on db1121 (lag will show up on s4), also remove triggers on db1124:3314 |
[production] |