| 2018-06-04
      
      § | 
    
  | 17:51 | <pnorman@deploy1001> | Started deploy [tilerator/deploy@074d01a] (cleartables): Disable configurations after v3view | [production] | 
            
  | 17:48 | <pnorman@deploy1001> | Finished deploy [tilerator/deploy@074d01a] (cleartables): Disable configurations after v3view (duration: 00m 24s) | [production] | 
            
  | 17:47 | <pnorman@deploy1001> | Started deploy [tilerator/deploy@074d01a] (cleartables): Disable configurations after v3view | [production] | 
            
  | 17:44 | <tgr> | disabled SUL+wikitech 2FA for MarkAHershberger (T196370) | [production] | 
            
  | 17:37 | <pnorman@deploy1001> | Finished deploy [tilerator/deploy@074d01a] (cleartables): Disable configurations after v3view (duration: 00m 26s) | [production] | 
            
  | 17:37 | <pnorman@deploy1001> | Started deploy [tilerator/deploy@074d01a] (cleartables): Disable configurations after v3view | [production] | 
            
  | 17:30 | <gehel@deploy1001> | Finished deploy [wdqs/wdqs@fd534fa]: WDQS: new GUI and blazegraph versions (duration: 08m 25s) | [production] | 
            
  | 17:30 | <pnorman@deploy1001> | Finished deploy [tilerator/deploy@074d01a] (cleartables): Deploy new meddo to test (duration: 02m 54s) | [production] | 
            
  | 17:27 | <pnorman@deploy1001> | Started deploy [tilerator/deploy@074d01a] (cleartables): Deploy new meddo to test | [production] | 
            
  | 17:22 | <gehel@deploy1001> | Started deploy [wdqs/wdqs@fd534fa]: WDQS: new GUI and blazegraph versions | [production] | 
            
  | 17:22 | <pnorman@deploy1001> | Finished deploy [tilerator/deploy@074d01a] (cleartables): Deploy new meddo to test (duration: 03m 24s) | [production] | 
            
  | 17:18 | <pnorman@deploy1001> | Started deploy [tilerator/deploy@074d01a] (cleartables): Deploy new meddo to test | [production] | 
            
  | 15:09 | <_joe_> | performing rolling restart of authdns servers to pick up ip change for the videoscalers | [production] | 
            
  | 15:05 | <herron> | gzipped large rotated log files in analytics1003:/var/log/hive to clear icinga disk space warning | [production] | 
            
  | 14:49 | <_joe_> | restarting low-traffic pybals in eqiad,codfw for adding the videoscaler VIP | [production] | 
            
  | 14:38 | <ppchelko@deploy1001> | Started restart [cpjobqueue/deploy@c6dc83d]: (no justification provided) | [production] | 
            
  | 14:35 | <Amir1> | ladsgroup@terbium:~$ foreachwikiindblist large deleteAutoPatrolLogs.php --sleep 2 --check-old | [production] | 
            
  | 14:34 | <marostegui> | Reload haproxy on dbproxy1010 to repool labsdb1010 - T190704 | [production] | 
            
  | 14:34 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool all sanitariums masters - T190704 (duration: 00m 49s) | [production] | 
            
  | 14:28 | <moritzm> | installing wireshark security updates | [production] | 
            
  | 14:27 | <oblivian@puppetmaster1001> | conftool action : set/pooled=true; selector: dnsdisc=videoscaler,name=eqiad | [production] | 
            
  | 14:21 | <oblivian@puppetmaster1001> | conftool action : set/pooled=inactive; selector: cluster=videoscaler,service=nginx,dc=codfw,name=mw211.* | [production] | 
            
  | 14:21 | <oblivian@puppetmaster1001> | conftool action : set/pooled=yes:weight=10; selector: cluster=videoscaler,service=nginx,dc=codfw | [production] | 
            
  | 14:20 | <akosiaris@puppetmaster1001> | conftool action : set/pooled=yes; selector: dc=.*,service=mathoid,cluster=kubernetes,name=.* | [production] | 
            
  | 14:19 | <oblivian@puppetmaster1001> | conftool action : set/pooled=yes; selector: cluster=videoscaler,service=nginx,dc=eqiad | [production] | 
            
  | 14:10 | <herron> | lithium:~# systemctl restart rsyslog.service | [production] | 
            
  | 14:09 | <marostegui> | Stop replication on all sanitarium masters to move labsdb1010 to another sanitarium host - T190704 | [production] | 
            
  | 14:05 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool all sanitariums masters - T190704 (duration: 00m 49s) | [production] | 
            
  | 14:02 | <moritzm> | installing wireshark security updates | [production] | 
            
  | 14:02 | <zeljkof> | EU SWAT finished | [production] | 
            
  | 13:49 | <zfilipin@deploy1001> | Synchronized static/images/project-logos: SWAT: [[gerrit:436990|Change bewikiquote logo (T196134)]] (duration: 00m 49s) | [production] | 
            
  | 13:44 | <zfilipin@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:436997|Set $wgMetaNamespace to "Вікіцытатнік" on bewikiquote (T196230)]] (duration: 00m 49s) | [production] | 
            
  | 13:39 | <anomie> | Running populateExternallinksIndex60.php on group 2 for T59176. FYI: this will probably take until next Friday to complete. | [production] | 
            
  | 13:34 | <zfilipin@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:436169|Set wgProofreadPagePageSeparator to empty string on zhwikisource (T194875)]] (duration: 00m 49s) | [production] | 
            
  | 13:27 | <zfilipin@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:436168|Set wgProofreadPagePageSeparator to empty string for jawikisource (T195873)]] (duration: 00m 49s) | [production] | 
            
  | 13:16 | <zfilipin@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:436310|Temporarily enable MFMobileMainPageCss in ruwiki (T195905)]] (duration: 00m 50s) | [production] | 
            
  | 13:11 | <zfilipin@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:436524|Assign movefile to autoreviewrs and patrollers on zhwiki (T195247)]] (duration: 00m 52s) | [production] | 
            
  | 12:49 | <gehel> | restart elastic2001 to enable G1 GC - T156137 | [production] | 
            
  | 12:18 | <krinkle@deploy1001> | Finished deploy [performance/navtiming@b229f75]: (no justification provided) (duration: 00m 05s) | [production] | 
            
  | 12:18 | <krinkle@deploy1001> | Started deploy [performance/navtiming@b229f75]: (no justification provided) | [production] | 
            
  | 11:38 | <akosiaris> | rebalance row_A, row_C nodegroups in ganeti01.svc.eqiad.wmnet cluster | [production] | 
            
  | 10:51 | <akosiaris> | reimage ganeti1004, ganeti1008 to stretch | [production] | 
            
  | 10:39 | <_joe_> | rolling restart of apache on the jobrunners to pick the changed privatetmp setting, rotating logs | [production] | 
            
  | 10:14 | <jdrewniak@deploy1001> | Synchronized portals: Wikimedia Portals Update: [[gerrit:437209|Bumping portals to master (T128546)]] (duration: 00m 49s) | [production] | 
            
  | 10:13 | <jdrewniak@deploy1001> | Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:437209|Bumping portals to master (T128546)]] (duration: 00m 51s) | [production] | 
            
  | 09:39 | <marostegui> | Reload haproxy on dbproxy1010 to depool labsdb1010 - https://phabricator.wikimedia.org/T190704 | [production] | 
            
  | 09:34 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1097:3315 after alter table (duration: 00m 49s) | [production] | 
            
  | 09:04 | <addshore> | addshore@terbium:~$ for i in {1..2500}; do echo Lexeme:L$i; done | mwscript purgePage.php --wiki wikidatawiki | [production] | 
            
  | 08:56 | <marostegui> | Deploy schema change on db1097:3315  - T191316 T192926 T89737 T195193 | [production] | 
            
  | 08:56 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1097:3315 for alter table (duration: 00m 49s) | [production] |