2501-2550 of 10000 results (67ms)
2019-06-04 §
07:16 <mobrovac@deploy1001> Started deploy [restbase/deploy@abcb534]: Use only Proton for PDF rendering - T210651 [production]
06:57 <elukey> restart hive metastore on an-coord1001 to apply new GC/heap settings [production]
06:42 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Fully repool db1091 after upgrade (duration: 00m 48s) [production]
06:21 <elukey> restart pdfrender on scb1002 (flapping) [production]
06:04 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1091 after upgrade (duration: 00m 47s) [production]
05:54 <marostegui> Stop MySQL on db2078:m3 - T221533 [production]
05:51 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Slowly repool db1091 after upgrade (duration: 00m 47s) [production]
05:40 <marostegui> Stop MySQL on db1091 for MySQL upgrade T224852 [production]
05:40 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1091 for upgrade (duration: 00m 48s) [production]
05:27 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1097 after upgrade (duration: 00m 46s) [production]
05:19 <marostegui> Stop MySQL on db1097 for upgrade [production]
05:19 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1097 for upgrade (duration: 00m 47s) [production]
04:59 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Remove db1081 from API (duration: 00m 49s) [production]
01:10 <bstorm_> T223406 depooled/repooled labsdb1009 for view updates [production]
00:09 <bstorm_> T223406 repooled labsdb1011 after completing view updates [production]
2019-06-03 §
22:20 <bstorm_> T223406 depooled labsdb1011 [production]
22:08 <bstorm_> T223406 repooled labsdb1010 after completing view updates [production]
21:29 <XioNoX> drop all ICMP frag on all routers - T224186 [production]
19:57 <XioNoX> stop sampling from cr2-eqiad [production]
18:47 <XioNoX> Add RPKI validators to all routers - T220669 [production]
18:35 <hashar> switch most Quibble jobs to node 10 T222406 - ttps://gerrit.wikimedia.org/r/#/c/integration/config/+/514034/ T222406 [production]
18:35 <XioNoX> drop all ICMP frag on cr1/2-eqiad - T224186 [production]
18:17 <XioNoX> add routinator 0.4.0 to APT repo - T220669 [production]
17:16 <onimisionipe@deploy1001> Finished deploy [wdqs/wdqs@9e3035c]: Blazegraph version wmf.4 (duration: 11m 29s) [production]
17:05 <onimisionipe@deploy1001> Started deploy [wdqs/wdqs@9e3035c]: Blazegraph version wmf.4 [production]
16:40 <onimisionipe> started osm-import on maps2004 - T224395 [production]
16:30 <bstorm_> T223406 depooled labsdb1010 for view updates [production]
15:39 <bstorm_> T223406 labsdb1012 updated views for actor table changes [production]
14:45 <akosiaris> deploy kask in sessionstore kubernetes namespace in eqiad, codfw T220401 [production]
14:33 <arturo> T221769 reimaging cloudservices1003 to stretch [production]
14:20 <vgutierrez> upgrading acme-chief to version 0.17 in acme-chief production instances - T220518 [production]
13:53 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:53 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
13:53 <moritzm> draining ganeti1001 for eventual reboot to MDS-enabled Linux kernel [production]
13:44 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings.php: WikimediaEditorTasks: Drop caption edit counter unlock delay to 0 (duration: 00m 49s) [production]
13:38 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Pool db1138 into s4 API (duration: 00m 48s) [production]
13:19 <marostegui> Move db2078:3321 under db2062 T220170 [production]
13:03 <arturo> add prometheus-pdns-rec-exporter v0.7 to stretch-wikimedia (T224877) [production]
12:55 <anomie@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Setting actor migration to write-new/read-new on remaining wikis (T188327) (duration: 00m 48s) [production]
12:24 <arturo> add prometheus-pdns-exporter v0.4 to stretch-wikimedia (T224877) [production]
11:28 <gehel> reboot relforge for microcode + jvm upgrade [production]
11:17 <jijiki> Restarting php7.2-fpm in eqiad in batches of 2 for 513949 [production]
11:15 <Urbanecm> EU SWAT done [production]
11:15 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[:gerrit:513740|Add Wikiprojekti namespace to wgExtraSignatureNamespaces for fiwiki]] (T224215) (duration: 00m 47s) [production]
11:11 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[:gerrit:503680|Add 5 active namespaces for VisualEditor on en.wikiversity]] (T220881) (duration: 00m 48s) [production]
11:06 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[:gerrit:513720|Add "Zerrenda" (list) namespace to VisualEditor on euwiki]] (T224801) (duration: 00m 48s) [production]
10:52 <moritzm> upgrading maps servers to new Java security release [production]
10:47 <moritzm> upgrading WDQS servers to new Java security release [production]
10:42 <vgutierrez> upgrading prometheus-trafficserver-exporter in upload_ats ulsfo instances [production]
10:41 <jdrewniak@deploy1001> Synchronized portals: Wikimedia Portals Update: [[gerrit:513972| Bumping portals to master (T128546)]] (duration: 00m 47s) [production]