| 2020-08-17
      
      § | 
    
  | 15:04 | <ppchelko@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'changeprop' for release 'staging' . | [production] | 
            
  | 14:57 | <otto@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: wgEventLoggingSchemas - schema revision version bump for erroring schemas - all wikis (take 2) - T254606 (duration: 00m 53s) | [production] | 
            
  | 14:57 | <oblivian@cumin1001> | END (FAIL) - Cookbook sre.hosts.reboot-cluster (exit_code=99) | [production] | 
            
  | 14:57 | <oblivian@cumin1001> | START - Cookbook sre.hosts.reboot-cluster | [production] | 
            
  | 14:44 | <otto@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: wgEventLoggingSchemas - schema revision version bump for erroring schemas - all wikis - T254606 (duration: 00m 55s) | [production] | 
            
  | 14:35 | <otto@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: wgEventLoggingSchemas - schema revision version bump for erroring schemas - group0 - T254606 (duration: 00m 56s) | [production] | 
            
  | 14:14 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Slowly repool db1088 after upgrading its mysql package', diff saved to https://phabricator.wikimedia.org/P12277 and previous config saved to /var/cache/conftool/dbconfig/20200817-141449-marostegui.json | [production] | 
            
  | 14:09 | <marostegui> | Sanitize thankyouwiki on db1124:3315, db2094:3315 - T260551 | [production] | 
            
  | 14:03 | <marostegui> | Sanitize lldwiki on db1124:3315 and db2094:3315 T259436 | [production] | 
            
  | 14:02 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Slowly repool db1088 after upgrading its mysql package', diff saved to https://phabricator.wikimedia.org/P12276 and previous config saved to /var/cache/conftool/dbconfig/20200817-140229-marostegui.json | [production] | 
            
  | 13:58 | <Amir1> | start of foreachwikiindblist wikidataclient extensions/Wikibase/lib/maintenance/populateSitesTable.php --force-protocol https (T259432) | [production] | 
            
  | 13:54 | <Urbanecm> | Creating thankyouwiki and lldwiki is done | [production] | 
            
  | 13:54 | <urbanecm@deploy1001> | Synchronized wmf-config/interwiki.php: Update interwiki cache (duration: 01m 52s) | [production] | 
            
  | 13:54 | <Urbanecm> | Create account Pcoombe (WMF) at thankyouwiki, email set to pcoombe@wikimedia.org (T259002) | [production] | 
            
  | 13:52 | <urbanecm@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Creating thankyouwiki (T259002) (duration: 00m 55s) | [production] | 
            
  | 13:51 | <urbanecm@deploy1001> | Synchronized static/images/project-logos/: Creating thankyouwiki (T259002) (duration: 00m 55s) | [production] | 
            
  | 13:49 | <urbanecm@deploy1001> | rebuilt and synchronized wikiversions files: Creating thankyouwiki (T259002) | [production] | 
            
  | 13:48 | <urbanecm@deploy1001> | Synchronized dblists: Creating thankyouwiki (T259002) (duration: 00m 55s) | [production] | 
            
  | 13:47 | <marostegui> | Deploy MCR change on db1104 | [production] | 
            
  | 13:47 | <urbanecm@deploy1001> | Synchronized wmf-config/db-codfw.php: Creating thankyouwiki (T259002) (duration: 00m 56s) | [production] | 
            
  | 13:47 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool db1104 for MCR change', diff saved to https://phabricator.wikimedia.org/P12275 and previous config saved to /var/cache/conftool/dbconfig/20200817-134701-marostegui.json | [production] | 
            
  | 13:46 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Fully repool db1099:3318', diff saved to https://phabricator.wikimedia.org/P12274 and previous config saved to /var/cache/conftool/dbconfig/20200817-134619-marostegui.json | [production] | 
            
  | 13:46 | <urbanecm@deploy1001> | Synchronized wmf-config/db-eqiad.php: Creating thankyouwiki (T259002) (duration: 00m 55s) | [production] | 
            
  | 13:46 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Slowly repool db1088 after upgrading its mysql package', diff saved to https://phabricator.wikimedia.org/P12273 and previous config saved to /var/cache/conftool/dbconfig/20200817-134604-marostegui.json | [production] | 
            
  | 13:41 | <jayme> | imported td-agent-bit_1.5.3-0 to buster-wikimedia - T260536 | [production] | 
            
  | 13:40 | <jayme> | imported !log imported to buster-wikimedia | [production] | 
            
  | 13:39 | <marostegui> | Upgrade db1088 (s6) to a newer mysql version (10.4.14) | [production] | 
            
  | 13:39 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool db1088 for mysql upgrade', diff saved to https://phabricator.wikimedia.org/P12272 and previous config saved to /var/cache/conftool/dbconfig/20200817-133905-marostegui.json | [production] | 
            
  | 13:34 | <jbond42> | deploy json-c security update to buster | [production] | 
            
  | 13:33 | <marostegui> | Restart mysql on db2102 (testing new package) | [production] | 
            
  | 13:30 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Slowly repool db1099:3318', diff saved to https://phabricator.wikimedia.org/P12271 and previous config saved to /var/cache/conftool/dbconfig/20200817-133043-marostegui.json | [production] | 
            
  | 13:29 | <urbanecm@deploy1001> | Synchronized langlist: Creating lldwiki (T259432) (duration: 00m 54s) | [production] | 
            
  | 13:28 | <urbanecm@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Creating lldwiki (T259432) (duration: 00m 55s) | [production] | 
            
  | 13:27 | <urbanecm@deploy1001> | sync-file aborted: Creating lldwiki (T259432)¨ (duration: 00m 00s) | [production] | 
            
  | 13:26 | <urbanecm@deploy1001> | Synchronized static/images/project-logos/: Creating lldwiki (T259432) (duration: 00m 53s) | [production] | 
            
  | 13:25 | <urbanecm@deploy1001> | rebuilt and synchronized wikiversions files: Creating lldwiki (T259432) | [production] | 
            
  | 13:23 | <urbanecm@deploy1001> | Synchronized dblists: Creating lldwiki (T259432) (duration: 00m 56s) | [production] | 
            
  | 13:22 | <urbanecm@deploy1001> | Synchronized wmf-config/db-codfw.php: Creating lldwiki (T259432) (duration: 00m 56s) | [production] | 
            
  | 13:20 | <urbanecm@deploy1001> | Synchronized wmf-config/db-eqiad.php: Creating lldwiki (T259432) (duration: 00m 55s) | [production] | 
            
  | 13:13 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Slowly repool db1099:3318', diff saved to https://phabricator.wikimedia.org/P12270 and previous config saved to /var/cache/conftool/dbconfig/20200817-131307-marostegui.json | [production] | 
            
  | 13:10 | <oblivian@cumin1001> | END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) | [production] | 
            
  | 13:10 | <oblivian@cumin1001> | END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) | [production] | 
            
  | 13:09 | <oblivian@cumin1001> | END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) | [production] | 
            
  | 13:01 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Slowly repool db1099:3318', diff saved to https://phabricator.wikimedia.org/P12269 and previous config saved to /var/cache/conftool/dbconfig/20200817-130127-marostegui.json | [production] | 
            
  | 12:58 | <oblivian@cumin1001> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) | [production] | 
            
  | 12:53 | <oblivian@cumin1001> | START - Cookbook sre.hosts.reboot-single | [production] | 
            
  | 12:53 | <oblivian@cumin1001> | START - Cookbook sre.hosts.reboot-single | [production] | 
            
  | 12:53 | <oblivian@cumin1001> | START - Cookbook sre.hosts.reboot-single | [production] | 
            
  | 12:52 | <oblivian@cumin1001> | START - Cookbook sre.hosts.reboot-single | [production] | 
            
  | 12:44 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depoool db1089 for MCR change', diff saved to https://phabricator.wikimedia.org/P12268 and previous config saved to /var/cache/conftool/dbconfig/20200817-124458-marostegui.json | [production] |