651-700 of 10000 results (53ms)
2018-03-06 ยง
15:19 <mobrovac@tin> Synchronized php-1.31.0-wmf.23/includes/jobqueue/JobQueueSecondTestQueue.php: [JobQueueSecondTestQueue] Support read-only mode - T185052 (duration: 00m 58s) [production]
15:09 <vgutierrez> update to pybal 1.15.0 on lvs5003 [production]
15:02 <hashar@tin> Synchronized wmf-config/InitialiseSettings.php: Article counts: Change 'comma' method to 'any' - T188472 (duration: 01m 00s) [production]
14:50 <vgutierrez> update pybal to 1.15.0 on lvs1010 [production]
14:46 <hashar> tin: /srv/mediawiki-staging/php-1.31.0-wmf.23 rebased on tip of https://gerrit.wikimedia.org/r/#/c/416686/ (that revert a merge of master branch) [production]
14:42 <gehel> rebooting maps1* (eqiad) for kernel security update completed [production]
14:36 <ottomata> beginning migration of webrequest text varnishkafka logs from Kafka analytics to Kafka jumbo-eqiad T185136 [production]
14:21 <moritzm> rebooting labweb* for kernel security update [production]
14:13 <moritzm> rebooting sca* for kernel security update [production]
14:07 <gehel> rebooting maps1* (eqiad) for kernel security update [production]
14:07 <moritzm> rebooting pybal-test for kernel security update [production]
14:00 <_joe_> SWAT is suspended for investigation on tin's git status [production]
14:00 <moritzm> rebooting oxygen for kernel security update [production]
13:16 <moritzm> powercycling ms-be1038, stuck after reboot [production]
13:10 <marostegui> Deploy schema change on db1094 - T187089 T185128 T153182 [production]
13:09 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1094 for alter table (duration: 00m 58s) [production]
12:55 <moritzm> rebooting URL downloaders for kernel security update [production]
12:51 <mobrovac@tin> Finished deploy [cpjobqueue/deploy@9b0b947]: refreshLinks: Increase concurrency to 100 - T185052 (duration: 00m 34s) [production]
12:50 <mobrovac@tin> Started deploy [cpjobqueue/deploy@9b0b947]: refreshLinks: Increase concurrency to 100 - T185052 [production]
12:43 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1086 after alter table (duration: 00m 58s) [production]
12:33 <moritzm> rebooting mwlog* for kernel security update [production]
12:04 <moritzm> rebooting graphite hosts in eqiad for kernel security update [production]
11:29 <moritzm> rebooting k8s masters for kernel security update [production]
11:05 <elukey> reboot analytics10[28,35,52] for kernel updates (one at the time, hadoop hdfs journal nodes) [production]
10:46 <moritzm> powercycling ms-be1021, stuck after reboot [production]
10:45 <akosiaris@tin> Synchronized wmf-config/CommonSettings.php: (no justification provided) (duration: 01m 22s) [production]
10:43 <moritzm> rearming keyholder on naos after reboot [production]
10:39 <akosiaris> emergency add a captcha in metawiki contact pages like https://meta.wikimedia.org/wiki/Special:Contact/Stewards to stop bot abuse. phab Task to be filed later on [production]
10:39 <godog> reboot ms-be1013 to try fix disk ordering [production]
10:35 <moritzm> rebooting naos for kernel security update [production]
10:32 <moritzm> rearming keyholder on tin after reboot [production]
10:30 <gehel> kafka poller active on all production wdqs nodes - T188252 [production]
10:28 <moritzm> rebooting tin for kernel security update [production]
10:20 <gehel> reboot completed for maps2* and maps-test* [production]
09:51 <moritzm> rebooting graphite hosts in codfw for kernel security update [production]
09:42 <marostegui> Stop MySQL on db1107 for mariadb and kernel upgrade [production]
09:41 <vgutierrez> pybal_1.15.0_all.deb to apt.wikimedia.org jessie-wikimedia [production]
09:40 <marostegui> Start proxysql on wasat [production]
09:38 <moritzm> rebooting wezen for kernel security update [production]
09:27 <elukey> reboot kafka2001 (eventbus codfw) for kernel updates [production]
09:24 <marostegui> Deploy schema change on db1086 - T187089 T185128 T153182 [production]
09:18 <marostegui> Stop and reboot db1086 for kernel and mariadb upgrade [production]
09:17 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1086 for alter table (duration: 00m 57s) [production]
09:17 <moritzm> rebooting swift backend servers in eqiad for kernel security update [production]
09:17 <moritzm> rebooting wwift backend servers in eqiad for kernel security update [production]
09:13 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1101:3317 after alter table (duration: 00m 57s) [production]
09:05 <gehel> rolling restart of maps* for kernel upgrade [production]
08:50 <elukey> reboot meitnerium (archiva) for kernel updates [production]
08:38 <paravoid> rebooting furud [production]
08:35 <moritzm> rebooting wasat for kernel security update [production]