| 2021-11-15
      
      ยง | 
    
  | 21:32 | <bblack> | dns6001 - reboot for another round of bios fixups | [production] | 
            
  | 21:21 | <legoktm> | uploaded php7.4_7.4.25-1+wmf2+buster1_amd64.changes to apt.wm.o with patch for T293568 | [production] | 
            
  | 21:19 | <mutante> | removing mediawiki font packages from remaining regular appservers globally (T294378) | [production] | 
            
  | 20:49 | <mutante> | retiring https://scholarships.wikimedia.org - removing from ATS (T243037) | [production] | 
            
  | 20:49 | <mmandere@cumin1001> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp6001.drmrs.wmnet with OS buster | [production] | 
            
  | 20:09 | <Amir1> | revoked all grants from wikiadmin and gave back an explicit list on clouddb1013:3311 (T249683) | [production] | 
            
  | 20:08 | <Amir1> | revoked all grants from wikiadmin and gave back an explicit list on clouddb1021:3311 (T249683) | [production] | 
            
  | 20:07 | <mmandere@cumin1001> | START - Cookbook sre.hosts.reimage for host cp6001.drmrs.wmnet with OS buster | [production] | 
            
  | 20:03 | <Amir1> | revoked all grants from wikiadmin and gave back an explicit list on db1102:3312 (T249683) | [production] | 
            
  | 19:57 | <mmandere@cumin1001> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cp6001.drmrs.wmnet with OS buster | [production] | 
            
  | 19:49 | <mwdebug-deploy@deploy1002> | helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 19:46 | <Amir1> | revoked all grants from wikiadmins and gave back explicit list on db2101:3315 (T249683) | [production] | 
            
  | 19:46 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 19:45 | <urbanecm> | UTC evening B&C window done | [production] | 
            
  | 19:37 | <urbanecm@deploy1002> | Synchronized wmf-config/InitialiseSettings.php: 898ebb1e8400a759ffc5553794f6a7200c97bf49: Enable talk for mobile users on enwiki (T293946) (duration: 00m 57s) | [production] | 
            
  | 19:35 | <mwdebug-deploy@deploy1002> | helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 19:31 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 19:31 | <mmandere@cumin1001> | START - Cookbook sre.hosts.reimage for host cp6001.drmrs.wmnet with OS buster | [production] | 
            
  | 19:30 | <urbanecm@deploy1002> | Synchronized wmf-config/InitialiseSettings.php: cdac608e84250207efeac9ea489a7e5be908ec70: Change votewiki language back to English (T292685) (duration: 00m 56s) | [production] | 
            
  | 19:06 | <mutante> | removing font packages from MW API appservers  T294378 | [production] | 
            
  | 18:58 | <mmandere@cumin1001> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cp6001.drmrs.wmnet with OS buster | [production] | 
            
  | 18:52 | <volans@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 40 days, 0:00:00 on ps1-d1-codfw with reason: Testing new PDU devices T265435 | [production] | 
            
  | 18:52 | <volans@cumin2002> | START - Cookbook sre.hosts.downtime for 40 days, 0:00:00 on ps1-d1-codfw with reason: Testing new PDU devices T265435 | [production] | 
            
  | 18:41 | <mwdebug-deploy@deploy1002> | helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 18:37 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 18:32 | <mmandere@cumin1001> | START - Cookbook sre.hosts.reimage for host cp6001.drmrs.wmnet with OS buster | [production] | 
            
  | 18:31 | <urbanecm@deploy1002> | Synchronized wmf-config/InitialiseSettings.php: 1be2d3941530bbed54632dafb0b804d0ddf41299: Growth IP research survey: Fix platforms (T294568) (duration: 00m 55s) | [production] | 
            
  | 18:27 | <mwdebug-deploy@deploy1002> | helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 18:23 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 18:21 | <urbanecm@deploy1002> | Synchronized wmf-config/InitialiseSettings.php: d15948e6da61af2d1db271cb0c9d8bd9a5395d75: foundationwiki: Restrict editing in more namespaces (T294900) (duration: 00m 56s) | [production] | 
            
  | 18:19 | <aokoth@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on gitlab2001.wikimedia.org with reason: upgrade gitlab2001 to new version https://phabricator.wikimedia.org/T294580 | [production] | 
            
  | 18:19 | <aokoth@cumin1001> | START - Cookbook sre.hosts.downtime for 1:00:00 on gitlab2001.wikimedia.org with reason: upgrade gitlab2001 to new version https://phabricator.wikimedia.org/T294580 | [production] | 
            
  | 18:08 | <mwdebug-deploy@deploy1002> | helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 18:07 | <arnoldokoth> | upgrading gitlab version on gitlab2001 (T294580) | [production] | 
            
  | 18:04 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 18:00 | <urbanecm@deploy1002> | Synchronized wmf-config/InitialiseSettings.php: 00650753d77d7a526b6751669bf3548cf81fb02a: foundationwiki: Revoke edit from * (T294900) (duration: 00m 56s) | [production] | 
            
  | 16:35 | <cmjohnson@cumin1001> | END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host an-test-coord1002.eqiad.wmnet with OS bullseye | [production] | 
            
  | 16:34 | <cmjohnson@cumin1001> | START - Cookbook sre.hosts.reimage for host an-test-coord1002.eqiad.wmnet with OS bullseye | [production] | 
            
  | 16:34 | <urbanecm> | [urbanecm@mwmaint1002 ~]$ mwscript extensions/CentralAuth/maintenance/createLocalAccount.php --wiki=enwiki 'MU test T244635 1' | [production] | 
            
  | 16:06 | <cmjohnson@cumin1001> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 16:01 | <cmjohnson@cumin1001> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 15:53 | <mwdebug-deploy@deploy1002> | helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 15:49 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 15:46 | <ladsgroup@deploy1002> | Synchronized php-1.38.0-wmf.7/includes/media/DjVuHandler.php: Backport: [[gerrit:738932|media: Avoid logspam in case of lack of 'data' in metadata]] (duration: 00m 55s) | [production] | 
            
  | 15:29 | <mwdebug-deploy@deploy1002> | helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 15:29 | <urbanecm@deploy1002> | Synchronized wmf-config/InitialiseSettings.php: 734f3b0094799007e38dea1d152f0afeb3134e1b: uzwiki: Enable Growth features in dark mode (T294245; 3/3) (duration: 00m 55s) | [production] | 
            
  | 15:28 | <urbanecm@deploy1002> | Synchronized wmf-config/config/uzwiki.yaml: 734f3b0094799007e38dea1d152f0afeb3134e1b: uzwiki: Enable Growth features in dark mode (T294245; 2/3) (duration: 00m 55s) | [production] | 
            
  | 15:26 | <urbanecm@deploy1002> | Synchronized dblists/growthexperiments.dblist: 734f3b0094799007e38dea1d152f0afeb3134e1b: uzwiki: Enable Growth features in dark mode (T294245; 1/3) (duration: 00m 55s) | [production] | 
            
  | 15:26 | <urbanecm> | mwscript extensions/GrowthExperiments/maintenance/initWikiConfig.php --wiki=uzwiki --phab=T294245 # T294245 | [production] | 
            
  | 15:25 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] |