|
2018-12-13
ยง
|
| 11:43 |
<moritzm> |
rebooting vega/bromine to pick up SSBD-enabled qemu |
[production] |
| 11:39 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@29a0902]: Remove restbase200[1-6] and ensure body.tfa exists for feed responses - T211070 T211871 |
[production] |
| 11:39 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@29a0902]: Remove restbase200[1-6] and ensure body.tfa exists for feed responses - T211070 T211871 (duration: 07m 08s) |
[production] |
| 11:38 |
<fsero@deploy1001> |
scap-helm zotero finished |
[production] |
| 11:38 |
<fsero@deploy1001> |
scap-helm zotero cluster codfw completed |
[production] |
| 11:38 |
<fsero@deploy1001> |
scap-helm zotero upgrade production -f ../zotero-values-codfw.yaml stable/zotero [namespace: zotero, clusters: codfw] |
[production] |
| 11:38 |
<moritzm> |
rebooting krypton to pick up SSBD-enabled qemu |
[production] |
| 11:31 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@29a0902]: Remove restbase200[1-6] and ensure body.tfa exists for feed responses - T211070 T211871 |
[production] |
| 11:31 |
<fsero@deploy1001> |
scap-helm zotero finished |
[production] |
| 11:31 |
<fsero@deploy1001> |
scap-helm zotero cluster eqiad completed |
[production] |
| 11:31 |
<fsero@deploy1001> |
scap-helm zotero upgrade production -f ../zotero-values-eqiad.yaml stable/zotero [namespace: zotero, clusters: eqiad] |
[production] |
| 11:14 |
<moritzm> |
rebooting webperf hosts to pick up SSBD-enabled qemu |
[production] |
| 10:51 |
<moritzm> |
rebooting dbmonitor hosts to pick up SSBD-enabled qemu |
[production] |
| 10:44 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1101:3317 T86338 T202167 (duration: 00m 51s) |
[production] |
| 10:00 |
<elukey> |
upgrade nodejs on aqs100[5-9] |
[production] |
| 09:59 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1101:3317 T86338 T202167 (duration: 00m 51s) |
[production] |
| 09:55 |
<moritzm> |
removed openssl 1.1.0f-3+deb9u2+wmf1 from stretch-wikimedia/component/node10 (superseded by openssl update in DSA 4348 for stretch) |
[production] |
| 09:35 |
<moritzm> |
rebooting etcd/kubernetes hosts in codfw to pick up SSBD-enabled qemu |
[production] |
| 09:34 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1090:3317 T86338 T202167 (duration: 00m 51s) |
[production] |
| 09:06 |
<filippo@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=restbase2006.codfw.wmnet |
[production] |
| 09:06 |
<filippo@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=restbase2005.codfw.wmnet |
[production] |
| 09:06 |
<filippo@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=restbase2004.codfw.wmnet |
[production] |
| 09:06 |
<filippo@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=restbase2003.codfw.wmnet |
[production] |
| 09:05 |
<filippo@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=restbase2002.codfw.wmnet |
[production] |
| 09:05 |
<filippo@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=restbase2001.codfw.wmnet |
[production] |
| 08:50 |
<godog> |
stress-test ms-be10[44-50] - T209618 |
[production] |
| 08:45 |
<marostegui> |
Deploy schema change on db1090:3317 T86338 T202167 |
[production] |
| 08:45 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1090:3317 T86338 T202167 (duration: 00m 53s) |
[production] |
| 08:45 |
<moritzm> |
installing openssl security updates on stretch |
[production] |
| 08:26 |
<vgutierrez> |
Use certcentral managed TLS certificates in mx[12]001.wikimedia.org - T207050 |
[production] |
| 08:15 |
<marostegui> |
Drop unused flaggedrevs tables from srwikinews - T209761 |
[production] |
| 08:11 |
<moritzm> |
rolling reboot of scb in eqiad for kernel security update (combined with nodejs update) |
[production] |
| 08:09 |
<marostegui> |
Repool labsdb1011 T86338 |
[production] |
| 08:08 |
<moritzm> |
installing nodejs updates on restbase1007 |
[production] |
| 07:28 |
<marostegui> |
Depool labsdb1011 T86338 |
[production] |
| 07:25 |
<marostegui> |
Repool labsdb1010 T86338 |
[production] |
| 07:22 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1079 T86338 T202167 (duration: 00m 52s) |
[production] |
| 06:46 |
<marostegui> |
Deploy schema change on db1079 with replication, lag will be generated on labsdb:s7 T86338 T202167 |
[production] |
| 06:45 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1079 T86338 T202167 (duration: 00m 53s) |
[production] |
| 06:43 |
<marostegui> |
Depool labsdb1010 T86338 |
[production] |
| 06:38 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1086 T86338 T202167 (duration: 00m 51s) |
[production] |
| 06:17 |
<marostegui> |
Deploy schema change on db1086 T86338 T202167 |
[production] |
| 06:16 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1086 T86338 T202167 (duration: 00m 51s) |
[production] |
| 06:11 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Fully repool db1098:3316 db1098:3317 after kernel and mysql upgrade (duration: 00m 54s) |
[production] |
| 00:52 |
<reedy@deploy1001> |
Synchronized php-1.33.0-wmf.8/includes/http/GuzzleHttpRequest.php: T211806 (duration: 00m 51s) |
[production] |
| 00:41 |
<mutante> |
einsteinium - rm /lib/systemd/system/update-etcd-mw-config-lastindex.service ; systemctl reset-failed |
[production] |
| 00:36 |
<tzatziki> |
changing two passwords for compromised accounts |
[production] |
| 00:32 |
<dcausse> |
elastic@codfw created cirrus metastore on psi&omega clusters |
[production] |
| 00:22 |
<dcausse@deploy1001> |
Synchronized php-1.33.0-wmf.8/extensions/MobileFrontend/extension.json: T210390: Reset default mobilefrontend provider (duration: 00m 53s) |
[production] |
| 00:13 |
<dcausse@deploy1001> |
Synchronized wmf-config/CirrusSearch-production.php: T210381: [cirrus] fix temp clusters for codfw (duration: 00m 52s) |
[production] |