| 2019-02-19
      
      § | 
    
  | 14:31 | <gehel@cumin1001> | END (FAIL) - Cookbook sre.elasticsearch.rolling-upgrade (exit_code=99) | [production] | 
            
  | 14:30 | <gehel@cumin1001> | START - Cookbook sre.elasticsearch.rolling-upgrade | [production] | 
            
  | 14:29 | <gehel> | rolling upgrade of elasticsearch on relforge - T215931 | [production] | 
            
  | 14:16 | <jynus> | stop db2090 for reboot testing T216240 | [production] | 
            
  | 14:04 | <gtirloni> | running `maintain-views --all-databases --replace-all --clean --debug` on labsdb1010 (T216481) | [production] | 
            
  | 13:44 | <Amir1> | mwscript maintenance/createAndPromote.php --wiki=testwikidatawiki --force --interface-admin Ladsgroup | [production] | 
            
  | 13:43 | <Amir1> | ladsgroup@mwmaint1002:~$ mwscript maintenance/createAndPromote.php --wiki=testwikidatawiki --force --sysop Ladsgroup (T215919) | [production] | 
            
  | 13:31 | <moritzm> | installing rssh update for jessie | [production] | 
            
  | 13:25 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1118 T210713 (duration: 00m 46s) | [production] | 
            
  | 13:23 | <gtirloni> | running `maintain-views --all-databases --replace-all --clean --debug` on labsdb1009 (T216481) | [production] | 
            
  | 12:57 | <zeljkof> | EU SWAT finished | [production] | 
            
  | 12:56 | <zfilipin@deploy1001> | Synchronized wmf-config/throttle.php: SWAT: [[gerrit:489819|Add new throttle rule for Kickstarter Edit-a-thon (T215839)]] (duration: 00m 43s) | [production] | 
            
  | 12:50 | <zfilipin@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:491025|Set $wgArticleCountMethod = any on fiwikinews (T216333)]] (duration: 00m 45s) | [production] | 
            
  | 12:37 | <zfilipin@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:491024|Add namespace Додатак on srwiktionary (T216343)]] (duration: 00m 46s) | [production] | 
            
  | 12:29 | <_joe_> | creating gerrit repo operations/debs/tideways-xhprof T176916 | [production] | 
            
  | 12:28 | <zfilipin@deploy1001> | Synchronized wmf-config/throttle.php: SWAT: [[gerrit:491432|Add new throttle rule for WikiProject Women in red, enwiki (T215295)]] (duration: 00m 47s) | [production] | 
            
  | 12:19 | <zfilipin@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:482261|Modifying configuration about Chinese Wikiversity (T212919)]] (duration: 00m 48s) | [production] | 
            
  | 11:59 | <marostegui> | Deploy schema change on db1118 - T210713 | [production] | 
            
  | 11:59 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1118 T210713 (duration: 00m 46s) | [production] | 
            
  | 11:53 | <jynus@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1064 (duration: 00m 46s) | [production] | 
            
  | 11:49 | <moritzm> | installing ruby-rack security updates | [production] | 
            
  | 11:26 | <gilles@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: T187299 Launch performance perception survey on eswiki (duration: 00m 46s) | [production] | 
            
  | 11:22 | <jynus> | stop and restart db1064 | [production] | 
            
  | 11:12 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1083 T210713 (duration: 00m 46s) | [production] | 
            
  | 11:10 | <jynus@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1064 (duration: 00m 46s) | [production] | 
            
  | 11:05 | <marostegui> | Deploy schema change on dbstore1002 | [production] | 
            
  | 10:25 | <marostegui> | Deploy schema change on db1083 - T210713 | [production] | 
            
  | 10:25 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1083 T210713 (duration: 00m 46s) | [production] | 
            
  | 10:13 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Fully repool db1093 after kernel upgrade (duration: 00m 46s) | [production] | 
            
  | 09:51 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: More traffic to db1093 after kernel upgrade (duration: 00m 46s) | [production] | 
            
  | 09:42 | <mforns@deploy1001> | Finished deploy [analytics/refinery@0d7ec19]: deploying refinery to update EL sanitization whitelist (duration: 07m 49s) | [production] | 
            
  | 09:34 | <mforns@deploy1001> | Started deploy [analytics/refinery@0d7ec19]: deploying refinery to update EL sanitization whitelist | [production] | 
            
  | 09:29 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1089 T210713 (duration: 00m 45s) | [production] | 
            
  | 09:23 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1093 on API after kernel upgrade (duration: 00m 46s) | [production] | 
            
  | 09:08 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Slowly repool db1093 after kernel upgrade (duration: 00m 46s) | [production] | 
            
  | 08:56 | <_joe_> | experimenting with php-fpm configuration on mwdebug1001 for T176916 | [production] | 
            
  | 08:56 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1093 for kernel upgrade (duration: 00m 45s) | [production] | 
            
  | 08:55 | <hashar> | Cleaning contint1001 / partition | [production] | 
            
  | 08:50 | <marostegui> | Deploy schema change on db1089 - T210713 | [production] | 
            
  | 08:50 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1089 T210713 (duration: 00m 46s) | [production] | 
            
  | 08:05 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1106 T210713 (duration: 00m 49s) | [production] | 
            
  | 07:51 | <marostegui> | Drop ep_* tables on s1 - T174802 | [production] | 
            
  | 07:50 | <moritzm> | installing systemd security updates on stretch | [production] | 
            
  | 07:46 | <marostegui> | Reboot db1106 for kernel upgrade (and remove debug from kernel) T216240 T216273 | [production] | 
            
  | 07:21 | <marostegui> | Drop ep_* tables on s3 - T174802 | [production] | 
            
  | 06:56 | <marostegui> | Deploy schema change on db1106 - this will generate lag on labsdb:s1 T210713 | [production] | 
            
  | 06:56 | <marostegui> | Deploy schema change on db1106 - T210713 | [production] | 
            
  | 06:56 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1106 T210713 (duration: 00m 52s) | [production] | 
            
  | 05:31 | <XioNoX> | delete local pref for peering sessions in ulsfo - T204281 | [production] | 
            
  | 05:17 | <XioNoX> | deleted previously deactivated BGP_community_actions terms - T204281 | [production] |