401-450 of 10000 results (49ms)
2018-10-11 ยง
18:46 <sbisson@deploy1001> Synchronized php-1.32.0-wmf.24/extensions/PageTriage/: SWAT: [[gerrit:465676|Handle page that are unnominated for deletion]] (duration: 00m 50s) [production]
18:34 <sbisson@deploy1001> Synchronized php-1.32.0-wmf.24/extensions/PageTriage/modules/ext.pageTriage.views.list/ext.pageTriage.listControlNav.js: SWAT: [[gerrit:465677|Default to deleted and others when no type is selected on mode switch]] (duration: 00m 50s) [production]
18:22 <sbisson@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:463319|Remove config for RCFilters variables being removed from Core]] (duration: 00m 49s) [production]
18:14 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Repool db2083 and db2085:3318 (duration: 00m 48s) [production]
18:13 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1101:3318 (duration: 00m 49s) [production]
18:09 <sbisson@deploy1001> Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:466694|Add copyviobot group management to relevant wikis]] (duration: 00m 49s) [production]
17:36 <gehel> repooling wdqs1003, catched up on lag [production]
17:08 <banyek|away> automated binlog purging started on pc2004, pc2005, pc2006 [production]
16:54 <gehel> depooling wdqs1003 to let it catch up on lag [production]
15:38 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1087 (duration: 00m 50s) [production]
15:12 <marostegui> Stop MySQL on db2085:3318 to reclone db1101:3318 - T206743 [production]
15:11 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1101:3318 (duration: 00m 49s) [production]
15:04 <akosiaris> Media storage/Swift Swift set to active/passive [production]
15:01 <akosiaris> Media storage/Swift Swift set to active/active [production]
14:56 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1099:3318 (duration: 00m 48s) [production]
14:52 <jynus> deploying wikidata row fix to db1087 with replication enabled [production]
14:47 <END> (PASS) - Cookbook sre.switchdc.services.02-restore-ttl (exit_code=0) (volans@neodymium) [production]
14:47 <START> - Cookbook sre.switchdc.services.02-restore-ttl (volans@neodymium) [production]
14:36 <END> (PASS) - Cookbook sre.switchdc.services.01-switch-dc (exit_code=0) (volans@neodymium) [production]
14:36 <Switching> services parsoid, restbase, restbase-async, mobileapps, apertium, citoid, cxserver, eventstreams, graphoid, mathoid, proton, pdfrender, recommendation-api, zotero, eventbus, ores, wdqs, wdqs-internal: codfw => eqiad (volans@neodymium) [production]
14:36 <START> - Cookbook sre.switchdc.services.01-switch-dc (volans@neodymium) [production]
14:35 <END> (PASS) - Cookbook sre.switchdc.services.00-reduce-ttl-and-sleep (exit_code=0) (volans@neodymium) [production]
14:30 <banyek@deploy1001> Synchronized wmf-config/db-eqiad.php: T206743: mariadb: Depool db1087 (duration: 00m 49s) [production]
14:30 <START> - Cookbook sre.switchdc.services.00-reduce-ttl-and-sleep (volans@neodymium) [production]
14:28 <banyek> depooling db1087 (T206743) [production]
14:28 <banyek> depooling db1087 [production]
14:15 <elukey> reboot eventlog1002 for kernel upgrades [production]
14:15 <jynus> applying row filling to (most) eqiad s8 dbs, including the mater [production]
14:13 <moritzm> install libxml2 security updates on jessie servers [production]
13:55 <jynus> recovering rows to db1092 [production]
13:26 <jynus> filling in missing rows on dbstore1002 [production]
13:23 <marostegui> Stop MySQL on db2083 to reclone db1116:3318 - T206743 [production]
13:21 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Depool db2083 (duration: 00m 49s) [production]
13:20 <marostegui> Stop MySQL on db1116:3318 to reclone it from db2083 - T206743 [production]
12:43 <elukey> upgrade prometheus-memcached-exporter on mc1* [production]
12:38 <elukey> upgrade prometheus-memcached-exporter on mc2* [production]
12:15 <elukey> upgrade prometheus-memcached-exporter on mc2035 [production]
12:14 <elukey> upload prometheus-memcached-exporter_0.4.1+git20181010.2fa99eb-1 to (jessie|stretch)-wikimedia [production]
12:12 <Amir1> EU SWAT is done [production]
11:30 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:466271|Set some small wikis to read new for change tag backend (T194164)]] (duration: 00m 50s) [production]
11:10 <marostegui> Stop MYSQL on db2085:3318 and db1099:3318 T206743 [production]
11:09 <marostegui> Stop MYSQL on db2088:3318 and db1099:3318 T206743 [production]
11:08 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Depool db2085:3318 and db1099:3318 (duration: 00m 49s) [production]
11:07 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db2085:3318 and db1099:3318 (duration: 00m 49s) [production]
11:07 <banyek> binlog expiration set to 60 days on db2045 [production]
08:30 <banyek> setting up some automated binlog purge mechanism on pc1004,pc1005,pc1006 [production]
08:26 <jynus> setting up replication from pc2005 -> pc1005 and from pc2006 -> pc2006 [production]
08:20 <jynus> setting up replication from pc2004 -> pc1004 [production]
08:04 <banyek> purging binary logs on pc1006 [production]
08:04 <banyek> purging binary logs on pc1005 [production]