| 2020-10-22
      
      § | 
    
  | 13:01 | <moritzm> | pooling ldap-replica2004 T264388 | [production] | 
            
  | 12:24 | <otto@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: wgEventStreams: Enable canary events for 3 eventgate-analytics bound streams - T251609 (duration: 01m 05s) | [production] | 
            
  | 12:10 | <urbanecm@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: 52ad2d4df1164dced684231c12aa64bd028b8ac9: Do not log logins at loginwiki via CU (T253802) (duration: 01m 06s) | [production] | 
            
  | 12:03 | <Urbanecm> | [urbanecm@deploy1001 /srv/mediawiki-staging (master * u=)]$ sudo /usr/local/sbin/fix-staging-perms | [production] | 
            
  | 11:59 | <Lucas_WMDE> | EU backport&config window done | [production] | 
            
  | 11:58 | <lucaswerkmeister-wmde@deploy1001> | Synchronized wmf-config/Wikibase.php: Config: [[gerrit:635762|Enable propagatePageDeletion on Test Wikidata]], 2/2 (duration: 01m 04s) | [production] | 
            
  | 11:57 | <lucaswerkmeister-wmde@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:635762|Enable propagatePageDeletion on Test Wikidata]], 1/2 (duration: 01m 02s) | [production] | 
            
  | 11:54 | <Urbanecm> | Start of `mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log` in a tmux session updateVarDumps at mwmaint2001 (wiki=huwiki; T246539) | [production] | 
            
  | 11:39 | <moritzm> | restarting nginx on acmechief*, debmonitor*, schema*, puppetdb* to pick up freetype update | [production] | 
            
  | 11:38 | <marostegui> | Compare s1-s8 tables - T261914 | [production] | 
            
  | 11:33 | <aborrero@cumin2001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 11:31 | <lucaswerkmeister-wmde@deploy1001> | Synchronized wmf-config/InterwikiSortOrders.php: Config: [[gerrit:635813|Add ary, avk, awa, lld, shy and smn to InterwikiSortOrders.php]] (duration: 01m 08s) | [production] | 
            
  | 11:31 | <aborrero@cumin2001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 11:25 | <moritzm> | restarting apache and smokeping* on netmon* to pick up freetype update | [production] | 
            
  | 11:21 | <moritzm> | correction: installing freetype security updates for buster (stretch TBD) | [production] | 
            
  | 10:43 | <moritzm> | installing freetype security updates for stretch/buster | [production] | 
            
  | 10:33 | <volans@cumin1001> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 10:27 | <volans@cumin1001> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 09:38 | <arturo> | merging https://gerrit.wikimedia.org/r/c/operations/puppet/+/634050 change to network data yaml | [production] | 
            
  | 08:31 | <kormat> | enabling replication from eqiad to codfw T261914 | [production] | 
            
  | 08:23 | <filippo@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 08:23 | <filippo@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 07:52 | <godog> | swift codfw-prod: bump object weight for ms-be2057 - T261633 | [production] | 
            
  | 03:37 | <eileen> | civicrm revision changed from 4dce7bf535 to bb7c08bf6d, config revision is 9a522d03dd | [production] | 
            
  | 03:13 | <eileen> | civicrm revision changed from 3c3dcf80ae to 4dce7bf535, config revision is 9a522d03dd | [production] | 
            
  | 01:12 | <ryankemper@deploy1001> | Finished deploy [wdqs/wdqs@870829c]: 0.3.52 (duration: 09m 07s) | [production] | 
            
  | 01:04 | <ryankemper> | Tests passing on canary `wdqs1003`, proceeding with wdqs deploy for rest of fleet | [production] | 
            
  | 01:03 | <ryankemper@deploy1001> | Started deploy [wdqs/wdqs@870829c]: 0.3.52 | [production] | 
            
  
    | 2020-10-21
      
      § | 
    
  | 23:16 | <catrope@deploy1001> | Synchronized php-1.36.0-wmf.14/extensions/GrowthExperiments/: T266033 (duration: 01m 05s) | [production] | 
            
  | 23:14 | <catrope@deploy1001> | Synchronized php-1.36.0-wmf.13/extensions/GrowthExperiments/: T265751 T265754 (duration: 01m 08s) | [production] | 
            
  | 21:38 | <mutante> | testreduce1001 assigned 2 more GBs of RAM - rebooting (T257940, T257906) | [production] | 
            
  | 19:44 | <Amir1> | end of foreachwikiindblist wikidataclient extensions/Wikibase/lib/maintenance/populateSitesTable.php --force-protocol https (T264963) | [production] | 
            
  | 19:15 | <Amir1> | start of foreachwikiindblist wikidataclient extensions/Wikibase/lib/maintenance/populateSitesTable.php --force-protocol https (T264963) | [production] | 
            
  | 18:13 | <Urbanecm> | Morning B&C window done | [production] | 
            
  | 18:12 | <urbanecm@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: 45312d359442d274e83deb7be80f86e12fb9e864: [WikibaseMediaInfo] Fix concept chips array nesting structure (T256431) (duration: 01m 05s) | [production] | 
            
  | 18:12 | <mepps> | updated payments-wiki-staging from db03677b2d to 5fdd29bc16 | [production] | 
            
  | 18:09 | <urbanecm@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: d94e33ff39b300c74fcaf08d1746c089fb1af783: cirrus: Hardcode more_like to codfw cirrus cluster (duration: 01m 05s) | [production] | 
            
  | 17:56 | <XioNoX> | configure FB PNI in eqdfw | [production] | 
            
  | 17:43 | <ppchelko@deploy1001> | Synchronized php-1.36.0-wmf.14/skins/WikimediaApiPortal: Backport gerrit:635329, T266021 (duration: 01m 06s) | [production] | 
            
  | 17:34 | <ppchelko@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Switch ParserCache to JSON on testwiki gerrit:635382 (duration: 01m 05s) | [production] | 
            
  | 17:24 | <ppchelko@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Enable ParserCache logger for warn+, gerrit:635071 (duration: 01m 08s) | [production] | 
            
  | 17:21 | <ppchelko@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Enable ParserCache logger for warn+, gerrit:635071 (duration: 01m 06s) | [production] | 
            
  | 17:13 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 17:13 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 16:58 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 16:57 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 16:57 | <mutante> | scandium - disabling puppet so that Parsoid team can make some tests on testreduce1001 today | [production] | 
            
  | 16:46 | <effie> | restart php-fpm and pool mw2252 and mw2328 | [production] | 
            
  | 15:58 | <Lucas_WMDE> | Deployed patch for T260349 | [production] | 
            
  | 15:34 | <ppchelko@deploy1001> | helmfile [codfw] Ran 'sync' command on namespace 'api-gateway' for release 'production' . | [production] |