3651-3700 of 10000 results (56ms)
2018-03-06 ยง
18:22 <godog> puppet-merge Revert: Use hiera3 role/nuyaml backends on >= stretch [production]
17:58 <marostegui> Reload haproxy on dbproxy1004 and dbproxy1009 [production]
17:53 <thcipriani> starting branch cut for 1.31.0-wmf.24 [production]
17:53 <andrewbogott> disabling puppet and apache on labpuppetmatser1001 and 1002 [production]
17:47 <moritzm> rebooting dbmonitor1001 for kernel security update [production]
17:42 <moritzm> rebooting dbmonitor2001 for kernel security update [production]
17:38 <moritzm> rebooting hassaleh for kernel security update [production]
17:34 <vgutierrez> update pybal to 1.15.1 on lvs5003 [production]
17:32 <vgutierrez> update pybal to 1.15.1 on lvs1010 [production]
17:28 <vgutierrez> uploaded pybal_1.15.1_all.deb to apt.wikimedia.org jessie-wikimedia [production]
17:17 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1069 after alter table (duration: 00m 58s) [production]
16:58 <cmjohnson1> powering off rhenium to reset the idrac [production]
16:44 <sbisson@tin> Finished deploy [kartotherian/deploy@255401a]: Testing update-deps2 branch (duration: 05m 47s) [production]
16:38 <sbisson@tin> Started deploy [kartotherian/deploy@255401a]: Testing update-deps2 branch [production]
16:11 <oblivian@tin> Synchronized wmf-config: Fetch data from etcd on all appservers (duration: 01m 01s) [production]
16:01 <marostegui> Deploy schema change on db1069 - T187089 T185128 T153182 [production]
16:01 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1069 for alter table (duration: 00m 57s) [production]
15:54 <jynus> deploying new query killer logic to all wikidata (s8) db replicas T188505 [production]
15:54 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1094 after alter table (duration: 00m 57s) [production]
15:51 <moritzm> installing libvpx security updates [production]
15:50 <oblivian@tin> Synchronized wmf-config: Expose etcd last modified index (duration: 01m 00s) [production]
15:45 <moritzm> rebooting ununpentium for kernel security update [production]
15:39 <oblivian@tin> Finished scap: Deploying Expose the latest modified index seen by EtcdConfig (duration: 09m 49s) [production]
15:29 <oblivian@tin> Started scap: Deploying Expose the latest modified index seen by EtcdConfig [production]
15:28 <moritzm> rebooting bromine for kernel security update [production]
15:19 <mobrovac@tin> Synchronized php-1.31.0-wmf.23/includes/jobqueue/JobQueueSecondTestQueue.php: [JobQueueSecondTestQueue] Support read-only mode - T185052 (duration: 00m 58s) [production]
15:09 <vgutierrez> update to pybal 1.15.0 on lvs5003 [production]
15:02 <hashar@tin> Synchronized wmf-config/InitialiseSettings.php: Article counts: Change 'comma' method to 'any' - T188472 (duration: 01m 00s) [production]
14:50 <vgutierrez> update pybal to 1.15.0 on lvs1010 [production]
14:46 <hashar> tin: /srv/mediawiki-staging/php-1.31.0-wmf.23 rebased on tip of https://gerrit.wikimedia.org/r/#/c/416686/ (that revert a merge of master branch) [production]
14:42 <gehel> rebooting maps1* (eqiad) for kernel security update completed [production]
14:36 <ottomata> beginning migration of webrequest text varnishkafka logs from Kafka analytics to Kafka jumbo-eqiad T185136 [production]
14:21 <moritzm> rebooting labweb* for kernel security update [production]
14:13 <moritzm> rebooting sca* for kernel security update [production]
14:07 <gehel> rebooting maps1* (eqiad) for kernel security update [production]
14:07 <moritzm> rebooting pybal-test for kernel security update [production]
14:00 <_joe_> SWAT is suspended for investigation on tin's git status [production]
14:00 <moritzm> rebooting oxygen for kernel security update [production]
13:16 <moritzm> powercycling ms-be1038, stuck after reboot [production]
13:10 <marostegui> Deploy schema change on db1094 - T187089 T185128 T153182 [production]
13:09 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1094 for alter table (duration: 00m 58s) [production]
12:55 <moritzm> rebooting URL downloaders for kernel security update [production]
12:51 <mobrovac@tin> Finished deploy [cpjobqueue/deploy@9b0b947]: refreshLinks: Increase concurrency to 100 - T185052 (duration: 00m 34s) [production]
12:50 <mobrovac@tin> Started deploy [cpjobqueue/deploy@9b0b947]: refreshLinks: Increase concurrency to 100 - T185052 [production]
12:43 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1086 after alter table (duration: 00m 58s) [production]
12:33 <moritzm> rebooting mwlog* for kernel security update [production]
12:04 <moritzm> rebooting graphite hosts in eqiad for kernel security update [production]
11:29 <moritzm> rebooting k8s masters for kernel security update [production]
11:05 <elukey> reboot analytics10[28,35,52] for kernel updates (one at the time, hadoop hdfs journal nodes) [production]
10:46 <moritzm> powercycling ms-be1021, stuck after reboot [production]