| 2017-07-12
      
      ยง | 
    
  | 17:21 | <_joe_> | rolling restart of pybal on low-traffic LVS in eqiad,codfw | [production] | 
            
  | 17:19 | <chasemp> | labnet1001:~# service nova-api restart | [production] | 
            
  | 17:15 | <chasemp> | labcontrol1001:~# service rabbitmq-server restart | [production] | 
            
  | 17:13 | <robh@puppetmaster1001> | conftool action : set/pooled=no; selector: name=wdqs2002.codfw.wmnet | [production] | 
            
  | 17:13 | <robh@puppetmaster1001> | conftool action : set/pooled=no; selector: name=wdqs2003.codfw.wmnet | [production] | 
            
  | 17:07 | <moritzm> | upgrading nginx on mwdebug* | [production] | 
            
  | 16:52 | <godog> | roll-restart and upgrade thumbor in eqiad | [production] | 
            
  | 16:47 | <oblivian@puppetmaster1001> | conftool action : set/pooled=true; selector: dnsdisc=recommendation-api | [production] | 
            
  | 16:36 | <oblivian@puppetmaster1001> | conftool action : set/pooled=yes; selector: service=recommendation-api,dc=eqiad | [production] | 
            
  | 16:15 | <oblivian@puppetmaster1001> | conftool action : set/pooled=yes; selector: service=recommendation-api,dc=codfw | [production] | 
            
  | 16:14 | <ema> | downgrade pybal to 1.13.6 on lvs1010 T82747 T154759 (1.13.7 throwing exceptions) | [production] | 
            
  | 16:09 | <godog> | upload thumbor 1.0-1 to install1002 | [production] | 
            
  | 16:06 | <mobrovac@tin> | Finished deploy [recommendation-api/deploy@eb2fef3]: (no justification provided) (duration: 00m 33s) | [production] | 
            
  | 16:06 | <ema> | lvs1006, lvs1010: upgrade pybal to 1.13.7 T82747 T154759 | [production] | 
            
  | 16:05 | <mobrovac@tin> | Started deploy [recommendation-api/deploy@eb2fef3]: (no justification provided) | [production] | 
            
  | 15:57 | <mobrovac@tin> | Finished deploy [recommendation-api/deploy@ed41fc4]: Initial deploy on canary scb2001, take #3 - T165760 (duration: 00m 46s) | [production] | 
            
  | 15:56 | <mobrovac@tin> | Started deploy [recommendation-api/deploy@ed41fc4]: Initial deploy on canary scb2001, take #3 - T165760 | [production] | 
            
  | 15:52 | <mobrovac@tin> | Finished deploy [recommendation-api/deploy@ed41fc4]: Initial deploy on canary scb2001, take #2 - T165760 (duration: 00m 06s) | [production] | 
            
  | 15:52 | <mobrovac@tin> | Started deploy [recommendation-api/deploy@ed41fc4]: Initial deploy on canary scb2001, take #2 - T165760 | [production] | 
            
  | 15:51 | <mobrovac@tin> | Finished deploy [recommendation-api/deploy@ed41fc4]: Initial deploy on canary scb2001 - T165760 (duration: 00m 15s) | [production] | 
            
  | 15:51 | <mobrovac@tin> | Started deploy [recommendation-api/deploy@ed41fc4]: Initial deploy on canary scb2001 - T165760 | [production] | 
            
  | 15:07 | <ema> | lvs2006: upgrade pybal to 1.13.7 T82747 T154759 | [production] | 
            
  | 14:56 | <marostegui> | Run redact_sanitarium on db1069 and db1095 for maiwikimedia - T168788 | [production] | 
            
  | 14:55 | <marostegui> | Run redact_sanitarium on db1069 and db1095 for maiwikimedia - T169510 | [production] | 
            
  | 14:37 | <moritzm> | installing apache security updates on californium / horizon.wikimedia.org | [production] | 
            
  | 14:28 | <addshore@tin> | Synchronized wmf-config/extension-list-labs: [[gerrit:362393|Add Newsletter to extension-list]] PT1/2 (duration: 00m 46s) | [production] | 
            
  | 14:27 | <addshore@tin> | Synchronized wmf-config/extension-list: [[gerrit:362393|Add Newsletter to extension-list]] PT1/2 (duration: 00m 47s) | [production] | 
            
  | 14:17 | <jynus> | restarting labsdb1005 (toolsdb) | [production] | 
            
  | 14:14 | <madhuvishy> | Disable icinga notifications  and event handler checks for labsdb1005 | [production] | 
            
  | 14:07 | <marostegui> | Run redact_sanitarium on db1069 for dinwiki - T169193 | [production] | 
            
  | 13:23 | <marostegui> | Deploy alter table s1 - db1072 - T166204 | [production] | 
            
  | 13:21 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1072 - T166204 (duration: 00m 46s) | [production] | 
            
  | 13:17 | <zeljkof> | EU SWAT finished! | [production] | 
            
  | 13:14 | <zfilipin@tin> | Synchronized wmf-config/Wikibase-production.php: SWAT: [[gerrit:361851|Temporarily set $wgPropertySuggesterClassifyingPropertyIds to [ 31 ]. (T169058)]] (duration: 00m 46s) | [production] | 
            
  | 13:01 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1066 - T166204 (duration: 00m 46s) | [production] | 
            
  | 12:54 | <dereckson@tin> | Synchronized wmf-config/interwiki.php: Interwiki map update (duration: 00m 46s) | [production] | 
            
  | 12:53 | <marostegui> | Deploy alter table s1 - db1095 - T166204 | [production] | 
            
  | 12:26 | <moritzm> | reimage mw1260 (video scaler) to jessie | [production] | 
            
  | 12:20 | <dereckson@tin> | Synchronized wmf-config/InitialiseSettings.php: Logos for mai.wikimedia (T168782) (duration: 00m 46s) | [production] | 
            
  | 12:18 | <dereckson@tin> | Synchronized static/images/project-logos: Logos for mai.wikimedia (T168782) (duration: 00m 46s) | [production] | 
            
  | 12:14 | <godog> | upgrade nginx on thumbor and prometheus machines | [production] | 
            
  | 12:04 | <dereckson@tin> | Synchronized multiversion/MWMultiVersion.php: +mai.wikimedia new subdomain (duration: 00m 46s) | [production] | 
            
  | 12:03 | <dereckson@tin> | Synchronized wmf-config/InitialiseSettings.php: Initial configuration for mai.wikimedia (T168782) (duration: 00m 46s) | [production] | 
            
  | 12:02 | <dereckson@tin> | rebuilt wikiversions.php and synchronized wikiversions files: +maiwiki | [production] | 
            
  | 12:01 | <dereckson@tin> | Synchronized dblists: +maiwikimedia (duration: 00m 46s) | [production] | 
            
  | 11:57 | <Dereckson> | Run add wiki maintenance script for maiwikimedia database / mai.wikimedia.org (T168782) | [production] | 
            
  | 11:52 | <moritzm> | installing apache security updates on mw* | [production] | 
            
  | 11:34 | <Dereckson> | Run add wiki maintenance script for dinwiki database / din.wikipedia.org (T168518) | [production] | 
            
  | 11:28 | <moritzm> | installing spice security updates | [production] | 
            
  | 11:21 | <dereckson@tin> | Synchronized wmf-config/InitialiseSettings.php: Initial configuration for din.wikipedia (thanks Urbanecm) (T168518) (duration: 00m 46s) | [production] |