| 2018-08-29
      
      ยง | 
    
  | 23:56 | <catrope@deploy1001> | Synchronized php-1.32.0-wmf.18/extensions/Translate/stringmangler/StringMatcher.php: T202058 (duration: 00m 56s) | [production] | 
            
  | 23:55 | <catrope@deploy1001> | Synchronized php-1.32.0-wmf.19/extensions/Translate/stringmangler/StringMatcher.php: T202058 (duration: 00m 59s) | [production] | 
            
  | 19:47 | <bstorm_> | failed tools and cloud vps storage services over to labstore1004 | [production] | 
            
  | 19:24 | <dduvall@deploy1001> | rebuilt and synchronized wikiversions files: group1 to 1.32.0-wmf.19 | [production] | 
            
  | 19:21 | <marxarelli> | Deploying 1.32.0-wmf.19 to group1 | [production] | 
            
  | 18:55 | <mutante> | puppet deploy of new cluster apache site inclusion for fixcopyright.wm, tested on mwdebug100*,mw1269, apache-fast-test (T202819) (gerrit:456194) | [production] | 
            
  | 18:31 | <ottomata> | debdeploy git-fat update for all nodes - T202100 | [production] | 
            
  | 18:10 | <mutante> | puppet re-enabled on mw* via cumin before last log message (cumin expected to log to SAL automatically?) | [production] | 
            
  | 18:08 | <mutante> | new apache config in sites-available for new site fixcopyright.wm is being generated by puppet on cluster, but not enabled yet (T202819) | [production] | 
            
  | 17:51 | <imarlier@deploy1001> | Finished deploy [performance/coal@7457c86]: (no justification provided) (duration: 00m 06s) | [production] | 
            
  | 17:51 | <imarlier@deploy1001> | Started deploy [performance/coal@7457c86]: (no justification provided) | [production] | 
            
  | 17:51 | <mutante> | disabling puppet on mw hosts as a precaution before deploying apache change | [production] | 
            
  | 16:49 | <marostegui> | Force RAID controller to WB policy T202051 | [production] | 
            
  | 16:21 | <rxy> | tgr@deploy1001 Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:456103|Wikidata: Use new item ID formatter for Q1-Q10000 (T201834)]] (duration: 00m 56s)  (by logmsgbot) | [production] | 
            
  | 16:21 | <rxy> | T202323 labstore1005 reboot (by arturo) | [production] | 
            
  | 16:02 | <arturo> | T202323 failover drbd primary from labstore1005 to labstore1004 | [production] | 
            
  | 15:53 | <arturo> | T202323 labstore1004 now running latest kernel | [production] | 
            
  | 15:51 | <marlier> | deploy coal | [production] | 
            
  | 15:51 | <imarlier@deploy1001> | Finished deploy [performance/coal@5d995a3]: (no justification provided) (duration: 00m 06s) | [production] | 
            
  | 15:51 | <imarlier@deploy1001> | Started deploy [performance/coal@5d995a3]: (no justification provided) | [production] | 
            
  | 15:48 | <elukey> | roll restart aqs on aqs100[4-9] to pick up the new druid config settings | [production] | 
            
  | 15:47 | <arturo> | T202323 labstore1004 reboot | [production] | 
            
  | 15:37 | <joal@deploy1001> | Finished deploy [analytics/aqs/deploy@c33f6e5]: Update wikistats2 endpoints to use user_text and page_title (duration: 11m 38s) | [production] | 
            
  | 15:26 | <joal@deploy1001> | Started deploy [analytics/aqs/deploy@c33f6e5]: Update wikistats2 endpoints to use user_text and page_title | [production] | 
            
  | 15:00 | <arturo> | T202323 starting operations | [production] | 
            
  | 14:33 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1091 (duration: 00m 58s) | [production] | 
            
  | 13:45 | <gehel> | restart relforge for plugin upgrade, data dir migration and kernel upgrade | [production] | 
            
  | 13:41 | <gehel@puppetmaster1001> | conftool action : set/pooled=inactive; selector: dc=eqiad,cluster=wdqs,name=wdqs2001.codfw.wmnet | [production] | 
            
  | 13:39 | <gehel> | shutting down wdqs2001 for new SSD and reimaging - T202777 | [production] | 
            
  | 13:11 | <kartik@deploy1001> | Finished deploy [cxserver/deploy@c3385eb]: Update cxserver to afe0d1f (T202970) (duration: 03m 46s) | [production] | 
            
  | 13:07 | <kartik@deploy1001> | Started deploy [cxserver/deploy@c3385eb]: Update cxserver to afe0d1f (T202970) | [production] | 
            
  | 11:53 | <hashar> | European SWAT completed (2) | [production] | 
            
  | 11:51 | <hashar@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: yphc.ir to the wgCopyUploadsDomains whitelist - T201237 (duration: 00m 56s) | [production] | 
            
  | 11:46 | <hashar@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Use HD logos for various Wikibooks - T177506 (duration: 00m 56s) | [production] | 
            
  | 11:42 | <hashar@deploy1001> | Synchronized static/images/project-logos: Upload HD logos for various wikibooks - T177506 (duration: 00m 55s) | [production] | 
            
  | 11:37 | <hashar> | European SWAT completed. | [production] | 
            
  | 11:37 | <hashar> | deploy1001: "mwscript updateCollation.php --wiki=azwiki --previous-collation=uppercase" completed  | T201770 | [production] | 
            
  | 11:35 | <hashar@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Use new logos for advisorywiki - T202844 (duration: 00m 57s) | [production] | 
            
  | 11:33 | <hashar@deploy1001> | Synchronized static/images/project-logos: Upload new logos for advisorswiki - T202844 (duration: 00m 55s) | [production] | 
            
  | 11:30 | <hashar> | last sync did not synchronized due to ssh / keyholder isses | [production] | 
            
  | 11:30 | <hashar@deploy1001> | Synchronized static/images/project-logos: Upload new logos for advisorswiki - T202844 (duration: 00m 37s) | [production] | 
            
  | 11:30 | <moritzm> | rearmed keyholder on sarin | [production] | 
            
  | 11:25 | <hashar@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Allow subpages in main namespace in zhwikiversity - T202007 (duration: 00m 56s) | [production] | 
            
  | 11:20 | <hashar@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Translation of scnwiktionary sitename was removed, add it back - T202926 (duration: 00m 56s) | [production] | 
            
  | 11:13 | <hashar@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Allow sysops to remove flood flag - T202599 (duration: 00m 56s) | [production] | 
            
  | 11:06 | <hashar> | mwscript updateCollation.php --wiki=azwiki --previous-collation=uppercase # T201770 | [production] | 
            
  | 11:06 | <hashar@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Set $wgCategoryCollation = uca-az on azwiki - T201770 (duration: 00m 56s) | [production] | 
            
  | 10:41 | <elukey@deploy1001> | Finished deploy [analytics/refinery@1c6423f]: (no justification provided) (duration: 02m 56s) | [production] | 
            
  | 10:38 | <elukey@deploy1001> | Started deploy [analytics/refinery@1c6423f]: (no justification provided) | [production] | 
            
  | 10:30 | <joal@deploy1001> | Finished deploy [analytics/refinery@1c6423f]: Fix over yesterday weekly deploy of analytics Hadoop jobs - try 2 (duration: 08m 28s) | [production] |