3851-3900 of 10000 results (60ms)
2017-10-09 ยง
17:28 <ottomata> stopping druid services on druid1005 [production]
16:34 <ottomata> stopping druid services on druid1006 [production]
16:34 <ottomata> beginning decom and reinstall process for druid1004-1006 -- T176223 [production]
15:53 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1091 - T174509 (duration: 00m 47s) [production]
13:53 <zeljkof> EU SWAT finished [production]
13:53 <zfilipin@tin> Synchronized php-1.31.0-wmf.2/extensions/Translate/: SWAT: [[gerrit:383079|Revert "[tech-debt] Remove usage of FuzzyLikeThis in favor of simple fuzzy match" (T177727)]] (duration: 00m 57s) [production]
13:27 <zfilipin@tin> Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:382749|Disallow most file types from upload to enwikivoyage (T176647)]] (duration: 00m 47s) [production]
13:26 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:382749|Disallow most file types from upload to enwikivoyage (T176647)]] (duration: 00m 47s) [production]
13:13 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:382463|Fix amwikimedia site name (T176042)]] (duration: 00m 47s) [production]
13:10 <zfilipin@tin> Synchronized wmf-config/throttle.php: SWAT: [[gerrit:383119|New throttle rule (T177737)]] (duration: 00m 47s) [production]
12:47 <ema> restart pybal on eqiad load balancers to pick up bgp-med config change T165584 [production]
12:38 <ema> restart pybal on codfw load balancers to pick up bgp-med config change T165584 [production]
12:31 <ema> restart pybal on ulsfo load balancers to pick up bgp-med config change T165584 [production]
12:26 <ema> restart pybal on esams load balancers to pick up bgp-med config change T165584 [production]
11:59 <joal@tin> Finished deploy [analytics/refinery@c3812c2]: Analytics regular weekly deploy (duration: 10m 24s) [production]
11:49 <joal@tin> Started deploy [analytics/refinery@c3812c2]: Analytics regular weekly deploy [production]
11:42 <hashar> Upgrading Jenkins - T168644 [production]
11:26 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1083 - T174509 (duration: 00m 46s) [production]
11:22 <moritzm> installing apt updates from stretch 9.2 point release [production]
11:22 <marostegui> Optimize ores_classification table on db1083 - T159753 [production]
11:19 <reedy@tin> Synchronized wmf-config/Wikibase-production.php: Actually disable injecting RC everywhere but commonswiki and ruwiki (duration: 00m 46s) [production]
11:11 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1092 - T174509 (duration: 00m 47s) [production]
11:08 <moritzm> installing whois updates from stretch 9.2 point release [production]
11:04 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1090 - T174509 (duration: 00m 46s) [production]
10:54 <moritzm> installing expect updates from stretch 9.2 point release [production]
10:50 <ladsgroup@tin> Synchronized wmf-config/Wikibase-production.php: Disable injecing RC records for commonswiki and ruwiki (T171027) (duration: 00m 47s) [production]
10:38 <ladsgroup@tin> Synchronized php-1.31.0-wmf.2/extensions/Wikidata/extensions/Wikibase/client: Re-instate $wgWBClientSettings[injectRecentChanges] (T171027) (duration: 00m 56s) [production]
10:35 <hoo> Started dumpwikidatajson.sh on snapshot1007 after T169680 disruptions [production]
10:30 <volans> rebooting snapshot1007 for NFS stuck - T169680 [production]
10:21 <marostegui> Drop moodbar_feedback and moodbar_feedback_response from s7 - T153033 [production]
10:21 <volans> rebooting snapshot1006 for NFS stuck - T169680 [production]
10:15 <elukey> rebooting snapshot1001 for NFS stuck - T169680 [production]
10:00 <volans> rebooting snapshot1005 for NFS stuck - T169680 [production]
09:51 <volans> rebooting dataset1001 for NFS stuck - T169680 [production]
09:51 <ema> test setting bgp med on lvs3001/3003 T165584 [production]
09:50 <marostegui> Drop moodbar_feedback and moodbar_feedback_response from s5 - T153033 [production]
09:43 <hashar> restarting Jenkins. Deadlock in SSHSlave plugin that causes memory to leak quite rapidly - T177749 [production]
09:34 <moritzm> installing vim security updates [production]
09:02 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2075 - T170662 (duration: 00m 47s) [production]
08:56 <volans> disabled puppet on 'stat100[5-6]*,snapshot100[1,5-7]*,dataset1001*' to manually recover from nfsd stuck - T169680 [production]
08:52 <marostegui> Drop moodbar_feedback and moodbar_feedback_response from s4 - T153033 [production]
08:51 <marostegui> Optimize pagelinks and templatelinks on db1092 - T174509 [production]
08:51 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1092 - T174509 (duration: 00m 47s) [production]
08:41 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1096 - T174509 (duration: 00m 47s) [production]
08:26 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Restore db1066 on s1 to and move db1072 to s3 instead - T172679 (duration: 00m 47s) [production]
08:12 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Move db1066 from s1 to s3 - T172679 (duration: 01m 25s) [production]
07:33 <marostegui> Drop moodbar_feedback and moodbar_feedback_response from s2 - T153033 [production]
07:16 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Add db2079 to the config - T170662 (duration: 00m 47s) [production]
07:15 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Add db2079 to the config - T170662 (duration: 00m 47s) [production]
07:01 <ema> cp4022 - backend restart, mailbox lag, cache_upload [production]