| 2018-12-20
      
      § | 
    
  | 09:29 | <banyek@deploy1001> | Synchronized wmf-config/db-eqiad.php: depool db1097:3314 for schema change - T85757 (duration: 00m 52s) | [production] | 
            
  | 09:23 | <banyek> | depooling db1097:3314 for schema change T85757 | [production] | 
            
  | 08:05 | <elukey> | roll restart of druid middlemanagers on druid* to pick up new port settings | [production] | 
            
  | 07:17 | <marostegui> | Re-start codfw s4 backup as the previous one failed | [production] | 
            
  | 07:11 | <elukey> | restart pdfrender on scb1002 | [production] | 
            
  | 07:10 | <elukey> | restart rsyslog on lithium - in:imtcp stuck in recvfrom ms-be2047.codfw.wmnet  - T199406 | [production] | 
            
  | 06:35 | <marostegui@deploy1001> | Synchronized wmf-config/db-codfw.php: Repool db2057 T212277 (duration: 00m 57s) | [production] | 
            
  | 01:41 | <mholloway-shell@deploy1001> | Finished deploy [mobileapps/deploy@c7977a7]: Update mobileapps to 42c011e (duration: 04m 08s) | [production] | 
            
  | 01:37 | <mholloway-shell@deploy1001> | Started deploy [mobileapps/deploy@c7977a7]: Update mobileapps to 42c011e | [production] | 
            
  | 01:09 | <eileen_> | civicrm revision changed from 9d727e4708 to b33dcd3c94, config revision is 0f94a475b7 | [production] | 
            
  | 00:09 | <maxsem@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/479911/ (duration: 00m 53s) | [production] | 
            
  
    | 2018-12-19
      
      § | 
    
  | 23:24 | <mutante> | syncing facts from puppetmaster1001 to compiler1001/compiler1002 | [production] | 
            
  | 23:21 | <eileen_> | civicrm revision changed from d5c3d5fd17 to 9d727e4708, config revision is 0f94a475b7 | [production] | 
            
  | 23:05 | <krinkle@deploy1001> | Finished deploy [performance/navtiming@64e3f63]: (no justification provided) (duration: 00m 05s) | [production] | 
            
  | 23:05 | <krinkle@deploy1001> | Started deploy [performance/navtiming@64e3f63]: (no justification provided) | [production] | 
            
  | 22:15 | <mutante> | scb1003: systemctl restart pdfrender | [production] | 
            
  | 20:44 | <hashar> | 1.33.0-wmf.9 on group1 looks fine. | [production] | 
            
  | 20:03 | <hashar@deploy1001> | Synchronized php: group1 wikis to 1.33.0-wmf.9 (duration: 00m 51s) | [production] | 
            
  | 20:02 | <hashar@deploy1001> | rebuilt and synchronized wikiversions files: group1 wikis to 1.33.0-wmf.9 | [production] | 
            
  | 19:33 | <XioNoX> | Revert "Redirect eqsin/ulsfo caches to eqiad"  - T210467 | [production] | 
            
  | 19:32 | <XioNoX> | repool codfw - T210467 | [production] | 
            
  | 19:28 | <XioNoX> | reactive BGP sessions to telia on cr1-codfw - T211715 | [production] | 
            
  | 19:07 | <chasemp> | cp of files to ext drive on labstore1007 | [production] | 
            
  | 18:41 | <marostegui> | Stop MySQL on db2057 | [production] | 
            
  | 18:28 | <XioNoX> | replace `interface-range vlan-private1-b-eqiad member ge-6/0/*` with individual interfaces on asw2-b-eqiad | [production] | 
            
  | 18:09 | <ejegg> | updated fundraising CiviCRM from 8e18485697 to d5c3d5fd17 | [production] | 
            
  | 17:32 | <addshore> | SWAT done | [production] | 
            
  | 17:22 | <addshore@deploy1001> | Synchronized wmf-config: Wikibase: wikidatawiki upsert idGenerator, T194299 (duration: 00m 52s) | [production] | 
            
  | 17:13 | <addshore@deploy1001> | Synchronized wmf-config: Wikibase: testwikidatawiki upsert idGenerator, T194299 (duration: 00m 52s) | [production] | 
            
  | 17:05 | <XioNoX> | remove 2nd port to AS8220 (cf. email to peering@) | [production] | 
            
  | 17:04 | <addshore@deploy1001> | Synchronized wmf-config: Wikibase: prepare to set $wgWBRepoSettings idGenerator, T194299 (duration: 00m 53s) | [production] | 
            
  | 16:59 | <XioNoX> | deactive BGP sessions to telia on cr1-codfw - T211715 | [production] | 
            
  | 16:58 | <fsero> | DNS: updating wmnet to include new registries T212212 | [production] | 
            
  | 16:57 | <hashar@deploy1001> | Synchronized php-1.33.0-wmf.9/extensions/ExtensionDistributor/includes/specials/SpecialBaseDistributor.php: Follow-up f686d348: No need for an <img> tag any more - T212217 (duration: 00m 52s) | [production] | 
            
  | 16:52 | <XioNoX> | codfw row D maintenance finished without issues - T210467 | [production] | 
            
  | 16:39 | <cmjohnson1> | swapping disk in slot 2 on db1072 | [production] | 
            
  | 16:33 | <XioNoX> | shutdown asw-d4-codfw - T210467 | [production] | 
            
  | 16:21 | <anomie@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Setting comment migration to new on group 2 (T166733) (duration: 00m 52s) | [production] | 
            
  | 16:04 | <XioNoX> | Redirect eqsin/ulsfo caches to eqiad - T210467 | [production] | 
            
  | 16:01 | <moritzm> | installing php5 security updates on jessie | [production] | 
            
  | 15:48 | <XioNoX> | depool codfw - T210467 | [production] | 
            
  | 15:39 | <chasemp> | various cp jobs on labstore1007 to ext media | [production] | 
            
  | 15:33 | <chasemp> | labstore1007 mount /dev/sde /mnt/T211327 | [production] | 
            
  | 15:13 | <moritzm> | draining restbase1011 for eventual reboot for kernel security update | [production] | 
            
  | 15:07 | <marostegui> | Drop image_comment_temp from labswiki and labtestwiki - T209591 | [production] | 
            
  | 14:58 | <moritzm> | draining restbase1010 for eventual reboot for kernel security update | [production] | 
            
  | 14:42 | <moritzm> | draining restbase1009 for eventual reboot for kernel security update | [production] | 
            
  | 14:16 | <moritzm> | draining restbase1008 for eventual reboot for kernel security update | [production] | 
            
  | 14:03 | <moritzm> | draining restbase1007 for eventual reboot for kernel security update | [production] | 
            
  | 13:57 | <moritzm> | installing nodejs updates on wtp* | [production] |