| 2018-12-12
      
      ยง | 
    
  | 15:24 | <godog> | poweroff ms-be2044 for hardware inspection - T209921 | [production] | 
            
  | 15:22 | <ladsgroup@deploy1001> | Synchronized php-1.33.0-wmf.8/includes/api/ApiBase.php: T211769 (duration: 00m 52s) | [production] | 
            
  | 15:21 | <urandom> | decommissioning cassandra-c, restbase2006 -- T210843 | [production] | 
            
  | 15:20 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Slowly repool db1098:3316 db1098:3317 after kernel and mysql upgrade (duration: 00m 53s) | [production] | 
            
  | 14:43 | <banyek> | renaming tables on db1122 ptwiki: flagged* -> T211544_flagged* - T211544 | [production] | 
            
  | 14:29 | <zfilipin@deploy1001> | rebuilt and synchronized wikiversions files: Revert "group1 wikis to 1.33.0-wmf.8" | [production] | 
            
  | 14:18 | <moritzm> | restart uwsgi-netbox on netmon2001 | [production] | 
            
  | 14:16 | <zfilipin@deploy1001> | Synchronized php: group1 wikis to 1.33.0-wmf.8 (duration: 00m 51s) | [production] | 
            
  | 14:14 | <zfilipin@deploy1001> | rebuilt and synchronized wikiversions files: group1 wikis to 1.33.0-wmf.8 | [production] | 
            
  | 14:07 | <mobrovac@deploy1001> | Started restart [restbase/deploy@5946231]: Restart RB to pick up the new seeds in codfw - T211416 | [production] | 
            
  | 14:04 | <marostegui> | Stopy MySQL on db1098:3316 and db1098:3317 for kernel and mysql upgrade | [production] | 
            
  | 13:28 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1098:3316 db1098:3317 for kernel and mysql upgrade (duration: 00m 52s) | [production] | 
            
  | 13:26 | <moritzm> | installing PHP security updates | [production] | 
            
  | 12:52 | <zeljkof> | EU SWAT finished | [production] | 
            
  | 12:49 | <zfilipin@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:477979|Add NS_PROJECT localised name for tt.wiktionary (T211312)]] (duration: 00m 52s) | [production] | 
            
  | 12:41 | <zfilipin@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:471345|Add new namespace aliases for zhwikiversity (T207544)]] (duration: 00m 52s) | [production] | 
            
  | 12:35 | <arturo> | T205969 icinga downtime load-avg check for labstore1007 until January (1 month) | [production] | 
            
  | 12:32 | <zfilipin@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:478896|Enable extension SandboxLink for nowiki (T210325)]] (duration: 00m 52s) | [production] | 
            
  | 12:27 | <zfilipin@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:478891|Use HD logos for cawikimedia in IS.php (T198507)]] (duration: 00m 52s) | [production] | 
            
  | 12:17 | <zfilipin@deploy1001> | Synchronized static/images/project-logos/: SWAT: [[gerrit:478890|Upload new logos for cawikimedia (T198507)]] (duration: 00m 52s) | [production] | 
            
  | 12:03 | <hoo@deploy1001> | Synchronized wmf-config/Wikibase.php: Display Kartographer mapframes for geocoordinate statements (T184933) (duration: 00m 52s) | [production] | 
            
  | 11:30 | <volans> | re-enabled puppet on icinga[12]001, re-activated crontab to sync files on 2001 and manually run it + run puppet | [production] | 
            
  | 11:14 | <volans> | restarting icinga with dropped downtimes from last night (start_date > 1544489652) | [production] | 
            
  | 11:03 | <volans> | restarting Icinga with debug log on icinga1001 | [production] | 
            
  | 10:51 | <mobrovac@deploy1001> | Finished deploy [restbase/deploy@44e0955]: Bring restbase201[3-8] up to date, try #2b - T211416 (duration: 10m 11s) | [production] | 
            
  | 10:41 | <mobrovac@deploy1001> | Started deploy [restbase/deploy@44e0955]: Bring restbase201[3-8] up to date, try #2b - T211416 | [production] | 
            
  | 10:40 | <mobrovac@deploy1001> | Finished deploy [restbase/deploy@44e0955]: Bring restbase201[3-8] up to date, try #2 - T211416 (duration: 00m 15s) | [production] | 
            
  | 10:40 | <mobrovac@deploy1001> | Started deploy [restbase/deploy@44e0955]: Bring restbase201[3-8] up to date, try #2 - T211416 | [production] | 
            
  | 10:26 | <volans> | Icinga is having issue restarting properly, investigation ongoing | [production] | 
            
  | 10:08 | <banyek> | executing schema change on db1070 (s5 master) - T85757 | [production] | 
            
  | 09:40 | <banyek> | repooling labsdb1010 - T210693 | [production] | 
            
  | 09:34 | <banyek@deploy1001> | Synchronized wmf-config/db-eqiad.php: T85757: repool db1082 (duration: 00m 52s) | [production] | 
            
  | 09:29 | <banyek> | repooling db1082 - T85757 | [production] | 
            
  | 09:25 | <banyek> | restarting replication on db1082 after schema change - T85757 | [production] | 
            
  | 09:25 | <banyek> | fixing triggers on db1124:3315- T85757 | [production] | 
            
  | 09:22 | <banyek> | executing schema change with replication on db1082 - T85757 | [production] | 
            
  | 09:20 | <banyek> | stopping replication on db1082 for schema change - T85757 | [production] | 
            
  | 09:15 | <moritzm> | installing pixman security updates on trusty (Debian already fixed) | [production] | 
            
  | 08:48 | <banyek@deploy1001> | Synchronized wmf-config/db-eqiad.php: T85757: depool db1082 (duration: 00m 51s) | [production] | 
            
  | 08:38 | <banyek> | depooling db1082 for schema change - T85757 | [production] | 
            
  | 08:37 | <marostegui> | Remove old backup directory from db1116 - T206743 | [production] | 
            
  | 08:18 | <godog> | decommissioning cassandra-b, restbase2006 -- T210843 | [production] | 
            
  | 08:03 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Fully repool db1088 (duration: 00m 51s) | [production] | 
            
  | 07:49 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Increase traffic for db1088 (duration: 00m 52s) | [production] | 
            
  | 07:38 | <marostegui> | Deploy schema change on db2040 (s7 codfw master), this will generate lag on codfw T86338 T202167 | [production] | 
            
  | 07:35 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Increase traffic for db1088 (duration: 00m 51s) | [production] | 
            
  | 07:09 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Increase traffic for db1088 (duration: 00m 51s) | [production] | 
            
  | 06:55 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Increase traffic for db1088 (duration: 00m 52s) | [production] | 
            
  | 06:44 | <marostegui> | Stop MySQL on db1088 for mysql and kernel upgrade | [production] | 
            
  | 06:44 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1088 for mysql upgrade (duration: 01m 07s) | [production] |