| 2018-12-20
      
      § | 
    
  | 10:53 | <banyek> | repooling db1121 after schema change T85757 | [production] | 
            
  | 10:45 | <moritzm> | draining restbase1013 for eventual reboot for kernel security update | [production] | 
            
  | 10:44 | <banyek> | stopping replication on db1121 - T85757 | [production] | 
            
  | 10:40 | <banyek@deploy1001> | Synchronized wmf-config/db-eqiad.php: depool db1121 for schema change - T85757 (duration: 00m 52s) | [production] | 
            
  | 10:35 | <banyek> | depooling db1121 for schema change T85757 | [production] | 
            
  | 10:33 | <banyek> | executing schema change on dbstore1002 - T85757 | [production] | 
            
  | 10:22 | <banyek> | executing schema change on db1102 - T85757 | [production] | 
            
  | 10:20 | <banyek@deploy1001> | Synchronized wmf-config/db-eqiad.php: repool db1081 after schema change - T85757 (duration: 00m 51s) | [production] | 
            
  | 10:19 | <moritzm> | draining restbase1012 for eventual reboot for kernel security update | [production] | 
            
  | 10:15 | <banyek> | repooling db1081 after schema change T85757 | [production] | 
            
  | 10:10 | <banyek@deploy1001> | Synchronized wmf-config/db-eqiad.php: depool db1081 for schema change - T85757 (duration: 00m 51s) | [production] | 
            
  | 10:05 | <banyek> | depooling db1081 for schema change T85757 | [production] | 
            
  | 10:00 | <banyek@deploy1001> | Synchronized wmf-config/db-eqiad.php: repool db1103:3314 after schema change - T85757 (duration: 00m 52s) | [production] | 
            
  | 09:56 | <banyek> | repooling db1103:3314 after schema change T85757 | [production] | 
            
  | 09:49 | <banyek@deploy1001> | Synchronized wmf-config/db-eqiad.php: depool db1103:3314 for schema change - T85757 (duration: 00m 51s) | [production] | 
            
  | 09:46 | <banyek> | depooling db1103:3314 for schema change T85757 | [production] | 
            
  | 09:45 | <banyek@deploy1001> | Synchronized wmf-config/db-eqiad.php: repool db1097:3314 after schema change - T85757 (duration: 00m 51s) | [production] | 
            
  | 09:41 | <legoktm@deploy1001> | Synchronized php-1.33.0-wmf.8/includes/: T199540 (duration: 01m 06s) | [production] | 
            
  | 09:40 | <legoktm@deploy1001> | Synchronized php-1.33.0-wmf.9/includes/: T199540 (duration: 01m 14s) | [production] | 
            
  | 09:39 | <banyek> | repooling db1097:3314 after schema change T85757 | [production] | 
            
  | 09:35 | <gilles@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: T187299 Increase ruwiki navtiming rate + frwiki survey rate (duration: 00m 52s) | [production] | 
            
  | 09:29 | <banyek@deploy1001> | Synchronized wmf-config/db-eqiad.php: depool db1097:3314 for schema change - T85757 (duration: 00m 52s) | [production] | 
            
  | 09:23 | <banyek> | depooling db1097:3314 for schema change T85757 | [production] | 
            
  | 08:05 | <elukey> | roll restart of druid middlemanagers on druid* to pick up new port settings | [production] | 
            
  | 07:17 | <marostegui> | Re-start codfw s4 backup as the previous one failed | [production] | 
            
  | 07:11 | <elukey> | restart pdfrender on scb1002 | [production] | 
            
  | 07:10 | <elukey> | restart rsyslog on lithium - in:imtcp stuck in recvfrom ms-be2047.codfw.wmnet  - T199406 | [production] | 
            
  | 06:35 | <marostegui@deploy1001> | Synchronized wmf-config/db-codfw.php: Repool db2057 T212277 (duration: 00m 57s) | [production] | 
            
  | 01:41 | <mholloway-shell@deploy1001> | Finished deploy [mobileapps/deploy@c7977a7]: Update mobileapps to 42c011e (duration: 04m 08s) | [production] | 
            
  | 01:37 | <mholloway-shell@deploy1001> | Started deploy [mobileapps/deploy@c7977a7]: Update mobileapps to 42c011e | [production] | 
            
  | 01:09 | <eileen_> | civicrm revision changed from 9d727e4708 to b33dcd3c94, config revision is 0f94a475b7 | [production] | 
            
  | 00:09 | <maxsem@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/479911/ (duration: 00m 53s) | [production] | 
            
  
    | 2018-12-19
      
      § | 
    
  | 23:24 | <mutante> | syncing facts from puppetmaster1001 to compiler1001/compiler1002 | [production] | 
            
  | 23:21 | <eileen_> | civicrm revision changed from d5c3d5fd17 to 9d727e4708, config revision is 0f94a475b7 | [production] | 
            
  | 23:05 | <krinkle@deploy1001> | Finished deploy [performance/navtiming@64e3f63]: (no justification provided) (duration: 00m 05s) | [production] | 
            
  | 23:05 | <krinkle@deploy1001> | Started deploy [performance/navtiming@64e3f63]: (no justification provided) | [production] | 
            
  | 22:15 | <mutante> | scb1003: systemctl restart pdfrender | [production] | 
            
  | 20:44 | <hashar> | 1.33.0-wmf.9 on group1 looks fine. | [production] | 
            
  | 20:03 | <hashar@deploy1001> | Synchronized php: group1 wikis to 1.33.0-wmf.9 (duration: 00m 51s) | [production] | 
            
  | 20:02 | <hashar@deploy1001> | rebuilt and synchronized wikiversions files: group1 wikis to 1.33.0-wmf.9 | [production] | 
            
  | 19:33 | <XioNoX> | Revert "Redirect eqsin/ulsfo caches to eqiad"  - T210467 | [production] | 
            
  | 19:32 | <XioNoX> | repool codfw - T210467 | [production] | 
            
  | 19:28 | <XioNoX> | reactive BGP sessions to telia on cr1-codfw - T211715 | [production] | 
            
  | 19:07 | <chasemp> | cp of files to ext drive on labstore1007 | [production] | 
            
  | 18:41 | <marostegui> | Stop MySQL on db2057 | [production] | 
            
  | 18:28 | <XioNoX> | replace `interface-range vlan-private1-b-eqiad member ge-6/0/*` with individual interfaces on asw2-b-eqiad | [production] | 
            
  | 18:09 | <ejegg> | updated fundraising CiviCRM from 8e18485697 to d5c3d5fd17 | [production] | 
            
  | 17:32 | <addshore> | SWAT done | [production] | 
            
  | 17:22 | <addshore@deploy1001> | Synchronized wmf-config: Wikibase: wikidatawiki upsert idGenerator, T194299 (duration: 00m 52s) | [production] | 
            
  | 17:13 | <addshore@deploy1001> | Synchronized wmf-config: Wikibase: testwikidatawiki upsert idGenerator, T194299 (duration: 00m 52s) | [production] |