| 2021-08-04
      
      ยง | 
    
  | 14:28 | <godog> | upgrade prometheus on prometheus4001 - T222113 | [production] | 
            
  | 14:19 | <moritzm> | imported gitlab-ce 13.12.9 to thirdparty/gitlab  T287671 | [production] | 
            
  | 14:18 | <mwdebug-deploy@deploy1002> | helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 14:17 | <godog> | depool prometheus2004 and pool prometheus2003 - T222113 | [production] | 
            
  | 14:13 | <kormat@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on 18 hosts with reason: Firmware upgrade on db1104 (s8 primary) T286226 | [production] | 
            
  | 14:13 | <kormat@cumin1001> | START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on 18 hosts with reason: Firmware upgrade on db1104 (s8 primary) T286226 | [production] | 
            
  | 14:12 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 14:02 | <dcausse@deploy1002> | helmfile [staging] Ran 'sync' command on namespace 'rdf-streaming-updater' for release 'main' . | [production] | 
            
  | 13:55 | <mwdebug-deploy@deploy1002> | helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 13:50 | <urbanecm@deploy1002> | Synchronized wmf-config/InitialiseSettings.php: 5d7255c1127f951da59b9b48749fe9cf59e11930: jvwikisource: Add author namespace (T286241) (duration: 01m 06s) | [production] | 
            
  | 13:49 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 13:32 | <mwdebug-deploy@deploy1002> | helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 13:21 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 13:19 | <urbanecm> | jvwikisource was created (T286241) | [production] | 
            
  | 13:19 | <urbanecm@deploy1002> | Synchronized wmf-config/interwiki.php: Update interwiki cache (duration: 03m 11s) | [production] | 
            
  | 13:18 | <volans> | upgraded python3-wmflib to v0.0.9 fleet wide | [production] | 
            
  | 13:15 | <urbanecm@deploy1002> | Synchronized wmf-config/InitialiseSettings.php: Creating jvwikisource (T286241) (duration: 01m 06s) | [production] | 
            
  | 13:14 | <urbanecm@deploy1002> | Synchronized wmf-config/logos.php: Creating jvwikisource (T286241) (duration: 01m 06s) | [production] | 
            
  | 13:10 | <urbanecm@deploy1002> | Synchronized static/images/project-logos/: Creating jvwikisource (T286241) (duration: 01m 07s) | [production] | 
            
  | 13:09 | <urbanecm@deploy1002> | rebuilt and synchronized wikiversions files: Creating jvwikisource (T286241) | [production] | 
            
  | 13:08 | <urbanecm@deploy1002> | Synchronized dblists: Creating jvwikisource (T286241) (duration: 01m 07s) | [production] | 
            
  | 13:07 | <urbanecm@deploy1002> | Synchronized wmf-config/db-codfw.php: Creating jvwikisource (T286241) (duration: 01m 07s) | [production] | 
            
  | 13:05 | <urbanecm@deploy1002> | Synchronized wmf-config/db-eqiad.php: Creating jvwikisource (T286241) (duration: 01m 08s) | [production] | 
            
  | 12:23 | <godog> | depool prometheus2004 for upgrade - T222113 | [production] | 
            
  | 12:19 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 12:07 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Repool db1129', diff saved to https://phabricator.wikimedia.org/P16958 and previous config saved to /var/cache/conftool/dbconfig/20210804-120725-marostegui.json | [production] | 
            
  | 12:03 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 11:53 | <reedy@deploy1002> | Synchronized docroot/mediawiki.org/xml/index.html: T288040 (duration: 01m 08s) | [production] | 
            
  | 11:46 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 11:43 | <moritzm> | installing testvm2001 T286206 | [production] | 
            
  | 11:36 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Repool db1170:3317 and db1101:3317 T286888!', diff saved to https://phabricator.wikimedia.org/P16957 and previous config saved to /var/cache/conftool/dbconfig/20210804-113623-marostegui.json | [production] | 
            
  | 11:24 | <phuedx@deploy1002> | Synchronized php-1.37.0-wmf.17/extensions/SecurePoll: Backport: [[gerrit:709974|Use real transactions when creating an election]] (duration: 01m 08s) | [production] | 
            
  | 11:21 | <phuedx@deploy1002> | Synchronized php-1.37.0-wmf.16/extensions/SecurePoll: Backport: [[gerrit:709973|Use real transactions when creating an election]] (duration: 01m 19s) | [production] | 
            
  | 10:53 | <jayme> | running puppet on eqiad appservers | [production] | 
            
  | 10:48 | <jayme> | switch most eqiad appservers to appserver_dragonly role for testing - T286054 | [production] | 
            
  | 10:29 | <jayme> | importing dragonfly 1.0.6-1 (downgrade from 1.0.6-2) to buster-wikimedia and stretch-wikimedia - T286054 | [production] | 
            
  | 10:17 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool db1101:3317 T286888', diff saved to https://phabricator.wikimedia.org/P16955 and previous config saved to /var/cache/conftool/dbconfig/20210804-101719-marostegui.json | [production] | 
            
  | 09:10 | <jmm@cumin2002> | END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host testvm2001.codfw.wmnet | [production] | 
            
  | 09:10 | <volans> | uploaded python3-wmflib_0.0.9 to apt.wikimedia.org buster-wikimedia,bullseye-wikimedia | [production] | 
            
  | 08:55 | <legoktm@cumin1001> | conftool action : set/pooled=true; selector: name=codfw,dnsdisc=shellbox-constraints | [production] | 
            
  | 08:51 | <jmm@cumin2002> | START - Cookbook sre.ganeti.makevm for new host testvm2001.codfw.wmnet | [production] | 
            
  | 08:41 | <godog> | pool prometheus1003 (and depool prometheus1004 for testing 1003 only) - T222113 | [production] | 
            
  | 08:27 | <legoktm> | restarting pybal on lvs2009 to add shellbox-constraints service | [production] | 
            
  | 08:24 | <legoktm> | restarting pybal on lvs1015 to add shellbox-constraints service | [production] | 
            
  | 08:22 | <legoktm> | restarting pybal on lvs2010 to add shellbox-constraints service | [production] | 
            
  | 08:18 | <legoktm> | restarting pybal on lvs1016 to add shellbox-constraints service | [production] | 
            
  | 08:00 | <godog> | upgrade prometheus1003 - T222113 | [production] | 
            
  | 06:53 | <moritzm> | installing testvm2002 T286206 | [production] | 
            
  | 06:45 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Repool db1174 and db1127 T286763', diff saved to https://phabricator.wikimedia.org/P16954 and previous config saved to /var/cache/conftool/dbconfig/20210804-064548-marostegui.json | [production] | 
            
  | 06:03 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Repool db1170:3312, db1105:3312, db1105:3311 T286888', diff saved to https://phabricator.wikimedia.org/P16953 and previous config saved to /var/cache/conftool/dbconfig/20210804-060347-marostegui.json | [production] |