| 2021-08-04
      
      § | 
    
  | 11:53 | <reedy@deploy1002> | Synchronized docroot/mediawiki.org/xml/index.html: T288040 (duration: 01m 08s) | [production] | 
            
  | 11:46 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 11:43 | <moritzm> | installing testvm2001 T286206 | [production] | 
            
  | 11:36 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Repool db1170:3317 and db1101:3317 T286888!', diff saved to https://phabricator.wikimedia.org/P16957 and previous config saved to /var/cache/conftool/dbconfig/20210804-113623-marostegui.json | [production] | 
            
  | 11:24 | <phuedx@deploy1002> | Synchronized php-1.37.0-wmf.17/extensions/SecurePoll: Backport: [[gerrit:709974|Use real transactions when creating an election]] (duration: 01m 08s) | [production] | 
            
  | 11:21 | <phuedx@deploy1002> | Synchronized php-1.37.0-wmf.16/extensions/SecurePoll: Backport: [[gerrit:709973|Use real transactions when creating an election]] (duration: 01m 19s) | [production] | 
            
  | 10:53 | <jayme> | running puppet on eqiad appservers | [production] | 
            
  | 10:48 | <jayme> | switch most eqiad appservers to appserver_dragonly role for testing - T286054 | [production] | 
            
  | 10:29 | <jayme> | importing dragonfly 1.0.6-1 (downgrade from 1.0.6-2) to buster-wikimedia and stretch-wikimedia - T286054 | [production] | 
            
  | 10:17 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool db1101:3317 T286888', diff saved to https://phabricator.wikimedia.org/P16955 and previous config saved to /var/cache/conftool/dbconfig/20210804-101719-marostegui.json | [production] | 
            
  | 09:10 | <jmm@cumin2002> | END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host testvm2001.codfw.wmnet | [production] | 
            
  | 09:10 | <volans> | uploaded python3-wmflib_0.0.9 to apt.wikimedia.org buster-wikimedia,bullseye-wikimedia | [production] | 
            
  | 08:55 | <legoktm@cumin1001> | conftool action : set/pooled=true; selector: name=codfw,dnsdisc=shellbox-constraints | [production] | 
            
  | 08:51 | <jmm@cumin2002> | START - Cookbook sre.ganeti.makevm for new host testvm2001.codfw.wmnet | [production] | 
            
  | 08:41 | <godog> | pool prometheus1003 (and depool prometheus1004 for testing 1003 only) - T222113 | [production] | 
            
  | 08:27 | <legoktm> | restarting pybal on lvs2009 to add shellbox-constraints service | [production] | 
            
  | 08:24 | <legoktm> | restarting pybal on lvs1015 to add shellbox-constraints service | [production] | 
            
  | 08:22 | <legoktm> | restarting pybal on lvs2010 to add shellbox-constraints service | [production] | 
            
  | 08:18 | <legoktm> | restarting pybal on lvs1016 to add shellbox-constraints service | [production] | 
            
  | 08:00 | <godog> | upgrade prometheus1003 - T222113 | [production] | 
            
  | 06:53 | <moritzm> | installing testvm2002 T286206 | [production] | 
            
  | 06:45 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Repool db1174 and db1127 T286763', diff saved to https://phabricator.wikimedia.org/P16954 and previous config saved to /var/cache/conftool/dbconfig/20210804-064548-marostegui.json | [production] | 
            
  | 06:03 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Repool db1170:3312, db1105:3312, db1105:3311 T286888', diff saved to https://phabricator.wikimedia.org/P16953 and previous config saved to /var/cache/conftool/dbconfig/20210804-060347-marostegui.json | [production] | 
            
  | 05:35 | <joe> | docker image prune on releases1002, T288024 | [production] | 
            
  | 05:07 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool db1105:3311', diff saved to https://phabricator.wikimedia.org/P16952 and previous config saved to /var/cache/conftool/dbconfig/20210804-050751-marostegui.json | [production] | 
            
  | 04:54 | <TimStarling> | on mwmaint2002: running bv2021/populateEditCounts.php on all wikis with one thread per section s1-s8 | [production] | 
            
  | 04:45 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool db1105:3312 to clone db1170:3312 T286888', diff saved to https://phabricator.wikimedia.org/P16950 and previous config saved to /var/cache/conftool/dbconfig/20210804-044507-marostegui.json | [production] | 
            
  | 04:34 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool db1174 to clone db1127 T286763', diff saved to https://phabricator.wikimedia.org/P16948 and previous config saved to /var/cache/conftool/dbconfig/20210804-043438-marostegui.json | [production] | 
            
  | 04:10 | <TimStarling> | on mwmaint2002: creating bv2021_edits table on all wikis | [production] | 
            
  | 03:58 | <tstarling@deploy1002> | Synchronized php-1.37.0-wmf.17/extensions/SecurePoll: for bv2021/populateEditCount.php (duration: 01m 06s) | [production] | 
            
  | 03:56 | <mwdebug-deploy@deploy1002> | helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 03:56 | <tstarling@deploy1002> | Synchronized php-1.37.0-wmf.16/extensions/SecurePoll: for bv2021/populateEditCount.php (duration: 01m 18s) | [production] | 
            
  | 03:50 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 03:34 | <mwdebug-deploy@deploy1002> | helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 03:27 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  
    | 2021-08-03
      
      § | 
    
  | 23:34 | <mwdebug-deploy@deploy1002> | helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 23:28 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 23:17 | <ebernhardson@deploy1002> | Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:709770|Re-enable commonswiki sister search (T277225)]] (duration: 01m 07s) | [production] | 
            
  | 22:57 | <mwdebug-deploy@deploy1002> | helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 22:50 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 22:37 | <dduvall> | re-rolled 1.37.0-wmf.17 to group0 following rollback and subsequent fixes for T287988 (T281158) | [production] | 
            
  | 22:28 | <dduvall@deploy1002> | rebuilt and synchronized wikiversions files: group0 wikis to 1.37.0-wmf.17 | [production] | 
            
  | 22:20 | <urbanecm@deploy1002> | Synchronized php-1.37.0-wmf.16/autoload.php: 7d286dc0feaef354943a70ee18014d55cbb2aefa: Add (MySQL/DB)PrimaryPos as an alias to (MySQL/DB)MasterPos (T287988; 3/3) (duration: 01m 07s) | [production] | 
            
  | 22:18 | <urbanecm@deploy1002> | Synchronized php-1.37.0-wmf.16/includes/libs/rdbms/database/position/MySQLMasterPos.php: 7d286dc0feaef354943a70ee18014d55cbb2aefa: Add (MySQL/DB)PrimaryPos as an alias to (MySQL/DB)MasterPos (T287988; 2/3) (duration: 01m 07s) | [production] | 
            
  | 22:15 | <urbanecm@deploy1002> | Synchronized php-1.37.0-wmf.16/includes/libs/rdbms/database/position/DBMasterPos.php: 7d286dc0feaef354943a70ee18014d55cbb2aefa: Add (MySQL/DB)PrimaryPos as an alias to (MySQL/DB)MasterPos (T287988; 1/3) (duration: 01m 07s) | [production] | 
            
  | 21:51 | <ebernhardson@deploy1002> | Finished deploy [wikimedia/discovery/analytics@2d533ba]: enable glent version marker in final output (duration: 45m 00s) | [production] | 
            
  | 21:43 | <mwdebug-deploy@deploy1002> | helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 21:37 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 21:10 | <mwdebug-deploy@deploy1002> | helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 21:06 | <ebernhardson@deploy1002> | Started deploy [wikimedia/discovery/analytics@2d533ba]: enable glent version marker in final output | [production] |