| 2018-12-11
      
      § | 
    
  | 14:13 | <mobrovac@deploy1001> | Finished deploy [restbase/deploy@44e0955]: Bring restbase201[3-8] up to date (duration: 00m 38s) | [production] | 
            
  | 14:13 | <mobrovac@deploy1001> | Started deploy [restbase/deploy@44e0955]: Bring restbase201[3-8] up to date | [production] | 
            
  | 14:10 | <mobrovac@deploy1001> | Finished deploy [restbase/deploy@44e0955]: Bring restbase201[3-8] up to date - T211416 (duration: 01m 53s) | [production] | 
            
  | 14:08 | <mobrovac@deploy1001> | Started deploy [restbase/deploy@44e0955]: Bring restbase201[3-8] up to date - T211416 | [production] | 
            
  | 13:48 | <vgutierrez> | Use certcentral TLS managed certificate in lists.wikimedia.org - T207050 | [production] | 
            
  | 13:06 | <zeljkof> | EU SWAT finished | [production] | 
            
  | 13:02 | <zfilipin@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:478712|HD Logos: Add fr and fy wikibooks and fr wiiknews variants to InitaliseSettings.php (T150618)]] (duration: 00m 46s) | [production] | 
            
  | 12:52 | <zfilipin@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:478036|Update settings to include new HD logos (T150618)]] (duration: 00m 47s) | [production] | 
            
  | 12:50 | <hoo@deploy1001> | Finished deploy [wdqs/wdqs@f914415]: Fix WDQS UI embeds (T211629) (duration: 10m 31s) | [production] | 
            
  | 12:39 | <hoo@deploy1001> | Started deploy [wdqs/wdqs@f914415]: Fix WDQS UI embeds (T211629) | [production] | 
            
  | 12:38 | <bblack> | Authdns CI/config refactoring done, all is well, resume normal DNS ops! | [production] | 
            
  | 12:37 | <elukey> | updated nodejs nodejs-legacy on aqs1004 (security upgrades) | [production] | 
            
  | 12:36 | <zfilipin@deploy1001> | Synchronized static/images/project-logos/: SWAT: [[gerrit:478709|HD Logos: Add 1.5x and 2x variants of fr and fy wikibooks and fr wikinews (T150618)]] (duration: 00m 46s) | [production] | 
            
  | 12:16 | <zfilipin@deploy1001> | Synchronized static/images/project-logos/: SWAT: [[gerrit:478034|Add HD logos for 3 projects (T150618)]] (duration: 00m 47s) | [production] | 
            
  | 12:12 | <marostegui> | Repool labsdb1011 - T86338 | [production] | 
            
  | 11:59 | <onimisionipe@deploy1001> | Finished deploy [wdqs/wdqs@dcde39f]: GUI update (duration: 01m 05s) | [production] | 
            
  | 11:58 | <onimisionipe@deploy1001> | Started deploy [wdqs/wdqs@dcde39f]: GUI update | [production] | 
            
  | 11:39 | <bblack> | puppet disabled on authdnses for attempting https://gerrit.wikimedia.org/r/q/topic:%22authdns-ci%22 | [production] | 
            
  | 11:23 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1087 T86338 T202167 (duration: 00m 46s) | [production] | 
            
  | 11:10 | <marostegui> | Depool labsdb1011 - T86338 | [production] | 
            
  | 11:06 | <marostegui> | Repool labsdb1010 - T86338 | [production] | 
            
  | 11:03 | <volans> | restarted pdfrender on scb1003 [last time, we need an automatic restart] | [production] | 
            
  | 10:47 | <fsero> | pooling mw1272 | [production] | 
            
  | 10:42 | <fsero> | scap pull mw1272 | [production] | 
            
  | 09:30 | <ema> | mw1272 down for the past 12h. Nothing in console, power-cycling | [production] | 
            
  | 09:08 | <marostegui> | Deploy schema change on db1087 with replication (this will generate lag on labsdb:s8) T202167 T86338 | [production] | 
            
  | 09:08 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1087 T86338 T202167 (duration: 00m 46s) | [production] | 
            
  | 09:04 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1092 T86338 T202167 (duration: 00m 46s) | [production] | 
            
  | 09:01 | <marostegui> | Depool labsdb1010 - T86338 | [production] | 
            
  | 08:15 | <marostegui> | Deploy schema change on db1092 T202167 T86338 | [production] | 
            
  | 08:15 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1092 T86338 T202167 (duration: 00m 46s) | [production] | 
            
  | 08:10 | <godog> | decommissioning cassandra-b, restbase2005 -- T210843 | [production] | 
            
  | 07:56 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1104 T86338 T202167 (duration: 00m 46s) | [production] | 
            
  | 07:32 | <oblivian@deploy1001> | Synchronized wmf-config/PhpAutoPrepend.php: Hotfix for logging on php7 (2/2) (duration: 02m 51s) | [production] | 
            
  | 07:29 | <oblivian@puppetmaster1001> | conftool action : set/pooled=inactive; selector: name=mw1272.* | [production] | 
            
  | 07:28 | <oblivian@deploy1001> | Synchronized wmf-config/php7.php: Hotfix for logging on php7 (1/2) (duration: 02m 50s) | [production] | 
            
  | 07:06 | <marostegui> | Deploy schema change on db1104 T202167 T86338 | [production] | 
            
  | 07:06 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1104 T86338 T202167 (duration: 02m 51s) | [production] | 
            
  | 06:59 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1109 T86338 T202167 (duration: 02m 52s) | [production] | 
            
  | 06:45 | <marostegui> | Rename flaggedrevs tables on srwikinews on db1078 - T209761 | [production] | 
            
  | 06:13 | <marostegui> | Deploy schema change on db1109 T202167 T86338 | [production] | 
            
  | 06:12 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1109 T86338 T202167 (duration: 02m 55s) | [production] | 
            
  | 05:57 | <marostegui> | Deploy schema change on s4 primary master (db1068) T202167 T86338 | [production] | 
            
  | 01:03 | <catrope@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Configure localized logos for nywiki (T211570) (duration: 01m 36s) | [production] | 
            
  | 01:01 | <catrope@deploy1001> | Synchronized static/images/project-logos/: Add localised logos for nywiki (T211570) (duration: 01m 00s) | [production] | 
            
  | 00:52 | <catrope@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Use new HD logos for zhwiktionary, zhwikivoyage, zhwikinews (T150618) (duration: 01m 16s) | [production] | 
            
  | 00:50 | <RoanKattouw> | mw1272 is down (does not respond to ping), but scap still tries to deploy to it | [production] | 
            
  | 00:50 | <catrope@deploy1001> | Synchronized static/images/project-logos/: Add HD logos for zhwikinews, zhwikivoyage, zhwiktionary (T150618) (duration: 02m 30s) | [production] | 
            
  | 00:15 | <mutante> | icinga2001 - killed all nagios processes, restarted nsca service, something is different from icinga1001, service failed when trying to restart (T211641) | [production] |