| 2019-02-19
      
      § | 
    
  | 16:39 | <gtirloni> | depooled labsdb1011 T216481 | [production] | 
            
  | 16:33 | <moritzm> | installing libssh update from stretch point release | [production] | 
            
  | 16:28 | <jforrester@deploy1001> | Synchronized php-1.33.0-wmf.17/includes/specials/pagers/ActiveUsersPager.php: T216200 Hot deploy variable name fix for ActiveUsersPager query (duration: 00m 48s) | [production] | 
            
  | 16:26 | <herron> | enabling elasticsearch on new eqiad hosts logstash101[0-2] | [production] | 
            
  | 16:18 | <gtirloni> | re-pooled labsdb1010 T216481 | [production] | 
            
  | 16:07 | <gehel@cumin1001> | END (FAIL) - Cookbook sre.elasticsearch.rolling-upgrade (exit_code=99) | [production] | 
            
  | 16:04 | <gehel@cumin1001> | START - Cookbook sre.elasticsearch.rolling-upgrade | [production] | 
            
  | 15:47 | <jijiki> | Reimaging thumbor2002 to stretch - T214597 | [production] | 
            
  | 15:38 | <gehel@cumin1001> | END (FAIL) - Cookbook sre.elasticsearch.rolling-upgrade (exit_code=99) | [production] | 
            
  | 15:32 | <hashar> | apt-get upgrade on compiler1001 and compiler1002.puppet-diffs.eqiad.wmflabs | [production] | 
            
  | 15:27 | <gehel@cumin1001> | START - Cookbook sre.elasticsearch.rolling-upgrade | [production] | 
            
  | 15:25 | <hashar> | Started instance compiler1002.puppet-diffs.eqiad.wmflabs via Horizon. It was in shutoff state | T216513 | [production] | 
            
  | 15:10 | <_joe_> | uploading tideways-xhprof_5.0.0~beta3 to reprepro T176916 | [production] | 
            
  | 15:09 | <gtirloni> | depooled labsdb1010 T216481 | [production] | 
            
  | 14:53 | <jynus> | stopping db2089 for hw maintenance T216240 | [production] | 
            
  | 14:41 | <gehel@cumin1001> | END (FAIL) - Cookbook sre.elasticsearch.rolling-upgrade (exit_code=99) | [production] | 
            
  | 14:40 | <gehel@cumin1001> | START - Cookbook sre.elasticsearch.rolling-upgrade | [production] | 
            
  | 14:36 | <gehel@cumin1001> | END (FAIL) - Cookbook sre.elasticsearch.rolling-upgrade (exit_code=99) | [production] | 
            
  | 14:35 | <gehel@cumin1001> | START - Cookbook sre.elasticsearch.rolling-upgrade | [production] | 
            
  | 14:31 | <gehel@cumin1001> | END (FAIL) - Cookbook sre.elasticsearch.rolling-upgrade (exit_code=99) | [production] | 
            
  | 14:30 | <gehel@cumin1001> | START - Cookbook sre.elasticsearch.rolling-upgrade | [production] | 
            
  | 14:29 | <gehel> | rolling upgrade of elasticsearch on relforge - T215931 | [production] | 
            
  | 14:16 | <jynus> | stop db2090 for reboot testing T216240 | [production] | 
            
  | 14:04 | <gtirloni> | running `maintain-views --all-databases --replace-all --clean --debug` on labsdb1010 (T216481) | [production] | 
            
  | 13:44 | <Amir1> | mwscript maintenance/createAndPromote.php --wiki=testwikidatawiki --force --interface-admin Ladsgroup | [production] | 
            
  | 13:43 | <Amir1> | ladsgroup@mwmaint1002:~$ mwscript maintenance/createAndPromote.php --wiki=testwikidatawiki --force --sysop Ladsgroup (T215919) | [production] | 
            
  | 13:31 | <moritzm> | installing rssh update for jessie | [production] | 
            
  | 13:25 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1118 T210713 (duration: 00m 46s) | [production] | 
            
  | 13:23 | <gtirloni> | running `maintain-views --all-databases --replace-all --clean --debug` on labsdb1009 (T216481) | [production] | 
            
  | 12:57 | <zeljkof> | EU SWAT finished | [production] | 
            
  | 12:56 | <zfilipin@deploy1001> | Synchronized wmf-config/throttle.php: SWAT: [[gerrit:489819|Add new throttle rule for Kickstarter Edit-a-thon (T215839)]] (duration: 00m 43s) | [production] | 
            
  | 12:50 | <zfilipin@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:491025|Set $wgArticleCountMethod = any on fiwikinews (T216333)]] (duration: 00m 45s) | [production] | 
            
  | 12:37 | <zfilipin@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:491024|Add namespace Додатак on srwiktionary (T216343)]] (duration: 00m 46s) | [production] | 
            
  | 12:29 | <_joe_> | creating gerrit repo operations/debs/tideways-xhprof T176916 | [production] | 
            
  | 12:28 | <zfilipin@deploy1001> | Synchronized wmf-config/throttle.php: SWAT: [[gerrit:491432|Add new throttle rule for WikiProject Women in red, enwiki (T215295)]] (duration: 00m 47s) | [production] | 
            
  | 12:19 | <zfilipin@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:482261|Modifying configuration about Chinese Wikiversity (T212919)]] (duration: 00m 48s) | [production] | 
            
  | 11:59 | <marostegui> | Deploy schema change on db1118 - T210713 | [production] | 
            
  | 11:59 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1118 T210713 (duration: 00m 46s) | [production] | 
            
  | 11:53 | <jynus@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1064 (duration: 00m 46s) | [production] | 
            
  | 11:49 | <moritzm> | installing ruby-rack security updates | [production] | 
            
  | 11:26 | <gilles@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: T187299 Launch performance perception survey on eswiki (duration: 00m 46s) | [production] | 
            
  | 11:22 | <jynus> | stop and restart db1064 | [production] | 
            
  | 11:12 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1083 T210713 (duration: 00m 46s) | [production] | 
            
  | 11:10 | <jynus@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1064 (duration: 00m 46s) | [production] | 
            
  | 11:05 | <marostegui> | Deploy schema change on dbstore1002 | [production] | 
            
  | 10:25 | <marostegui> | Deploy schema change on db1083 - T210713 | [production] | 
            
  | 10:25 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1083 T210713 (duration: 00m 46s) | [production] | 
            
  | 10:13 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Fully repool db1093 after kernel upgrade (duration: 00m 46s) | [production] | 
            
  | 09:51 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: More traffic to db1093 after kernel upgrade (duration: 00m 46s) | [production] | 
            
  | 09:42 | <mforns@deploy1001> | Finished deploy [analytics/refinery@0d7ec19]: deploying refinery to update EL sanitization whitelist (duration: 07m 49s) | [production] |