| 2024-10-03
      
      ยง | 
    
  | 12:13 | <elukey@cumin1002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host logging-hd2004.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART | [production] | 
            
  | 12:09 | <elukey@cumin1002> | START - Cookbook sre.hosts.provision for host logging-hd2004.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART | [production] | 
            
  | 12:05 | <urbanecm@deploy2002> | Started scap sync-world: Backport for [[gerrit:1077673|ReassignMenteesJob: Do not schedule follow-up jobs when first job fails (T376124)]] | [production] | 
            
  | 12:05 | <elukey@cumin1002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host logging-hd2005.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART | [production] | 
            
  | 12:02 | <elukey@cumin1002> | START - Cookbook sre.hosts.provision for host logging-hd2005.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART | [production] | 
            
  | 11:15 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Depooling db1178 (T367856)', diff saved to https://phabricator.wikimedia.org/P69458 and previous config saved to /var/cache/conftool/dbconfig/20241003-111544-ladsgroup.json | [production] | 
            
  | 11:15 | <ladsgroup@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 12:00:00 on db1178.eqiad.wmnet with reason: Maintenance | [production] | 
            
  | 11:15 | <ladsgroup@cumin1002> | START - Cookbook sre.hosts.downtime for 2 days, 12:00:00 on db1178.eqiad.wmnet with reason: Maintenance | [production] | 
            
  | 11:15 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1177 (T367856)', diff saved to https://phabricator.wikimedia.org/P69457 and previous config saved to /var/cache/conftool/dbconfig/20241003-111522-ladsgroup.json | [production] | 
            
  | 11:00 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1177', diff saved to https://phabricator.wikimedia.org/P69456 and previous config saved to /var/cache/conftool/dbconfig/20241003-110015-ladsgroup.json | [production] | 
            
  | 10:45 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1177', diff saved to https://phabricator.wikimedia.org/P69454 and previous config saved to /var/cache/conftool/dbconfig/20241003-104508-ladsgroup.json | [production] | 
            
  | 10:30 | <ladsgroup@cumin1002> | dbctl commit (dc=all): 'Repooling after maintenance db1177 (T367856)', diff saved to https://phabricator.wikimedia.org/P69453 and previous config saved to /var/cache/conftool/dbconfig/20241003-103001-ladsgroup.json | [production] | 
            
  | 10:29 | <urbanecm@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1077658|Backport ReassignMenteesJob-related changes (T376124)]] (duration: 06m 54s) | [production] | 
            
  | 10:29 | <elukey@cumin2002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 10:25 | <elukey@cumin2002> | START - Cookbook sre.hosts.provision for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 10:22 | <urbanecm@deploy2002> | Started scap sync-world: Backport for [[gerrit:1077658|Backport ReassignMenteesJob-related changes (T376124)]] | [production] | 
            
  | 10:11 | <elukey@cumin2002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 10:08 | <elukey@cumin2002> | START - Cookbook sre.hosts.provision for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 10:06 | <elukey@cumin2002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 10:06 | <elukey@cumin2002> | START - Cookbook sre.hosts.provision for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 10:04 | <slyngshede@cumin1002> | END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM irc1004.wikimedia.org | [production] | 
            
  | 10:00 | <kcvelaga@deploy2002> | Finished deploy [airflow-dags/analytics_product@b715af7]: T375153 (duration: 02m 44s) | [production] | 
            
  | 10:00 | <slyngshede@cumin1002> | START - Cookbook sre.ganeti.reboot-vm for VM irc1004.wikimedia.org | [production] | 
            
  | 09:58 | <kcvelaga@deploy2002> | Started deploy [airflow-dags/analytics_product@b715af7]: T375153 | [production] | 
            
  | 09:42 | <dcausse@deploy2002> | helmfile [eqiad] DONE helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 09:41 | <dcausse@deploy2002> | helmfile [eqiad] START helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 09:38 | <dcausse@deploy2002> | helmfile [codfw] DONE helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 09:38 | <dcausse@deploy2002> | helmfile [codfw] START helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 09:35 | <dcausse@deploy2002> | helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 09:35 | <dcausse@deploy2002> | helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply | [production] | 
            
  | 08:36 | <hashar@deploy2002> | rebuilt and synchronized wikiversions files: group2 to 1.43.0-wmf.25  refs T375656 | [production] | 
            
  | 08:25 | <hashar@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1077505|Deprecate ParserOutput::setLanguageLinks(null) (T376323)]] (duration: 07m 07s) | [production] | 
            
  | 08:20 | <hashar@deploy2002> | hashar, cscott: Continuing with sync | [production] | 
            
  | 08:20 | <hashar@deploy2002> | hashar, cscott: Backport for [[gerrit:1077505|Deprecate ParserOutput::setLanguageLinks(null) (T376323)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 08:18 | <hashar@deploy2002> | Started scap sync-world: Backport for [[gerrit:1077505|Deprecate ParserOutput::setLanguageLinks(null) (T376323)]] | [production] | 
            
  | 08:14 | <hashar@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1077487|bjnwiki: Update logo (T375055)]], [[gerrit:1077488|bjnwiktionary: Add logo (T374898)]] (duration: 08m 37s) | [production] | 
            
  | 08:09 | <hashar@deploy2002> | hashar, hamishz: Continuing with sync | [production] | 
            
  | 08:07 | <hashar@deploy2002> | hashar, hamishz: Backport for [[gerrit:1077487|bjnwiki: Update logo (T375055)]], [[gerrit:1077488|bjnwiktionary: Add logo (T374898)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 08:05 | <hashar@deploy2002> | Started scap sync-world: Backport for [[gerrit:1077487|bjnwiki: Update logo (T375055)]], [[gerrit:1077488|bjnwiktionary: Add logo (T374898)]] | [production] | 
            
  | 08:03 | <hashar> | Ran `mwscript resetAuthenticationThrottle.php --signup --ip 14.139.82.6`  for `metawiki`, `mediawikiwiki` and `wikidatawiki` # T375794 | [production] | 
            
  | 07:59 | <hashar@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1077502|throttle.php: Remove expired throttle]], [[gerrit:1077619|IP limit exemption for WTS 2024 (T375794)]] (duration: 08m 41s) | [production] | 
            
  | 07:54 | <hashar@deploy2002> | anzx, hamishz, hashar: Continuing with sync | [production] | 
            
  | 07:53 | <hashar@deploy2002> | anzx, hamishz, hashar: Backport for [[gerrit:1077502|throttle.php: Remove expired throttle]], [[gerrit:1077619|IP limit exemption for WTS 2024 (T375794)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 07:50 | <hashar@deploy2002> | Started scap sync-world: Backport for [[gerrit:1077502|throttle.php: Remove expired throttle]], [[gerrit:1077619|IP limit exemption for WTS 2024 (T375794)]] | [production] | 
            
  | 07:16 | <kartik@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1076559|Section Translation: Add mos, kde and rsk Wikipedias (T375017 T374815 T374644)]] (duration: 10m 39s) | [production] | 
            
  | 07:12 | <kartik@deploy2002> | kartik: Continuing with sync | [production] | 
            
  | 07:08 | <kartik@deploy2002> | kartik: Backport for [[gerrit:1076559|Section Translation: Add mos, kde and rsk Wikipedias (T375017 T374815 T374644)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 07:06 | <kartik@deploy2002> | Started scap sync-world: Backport for [[gerrit:1076559|Section Translation: Add mos, kde and rsk Wikipedias (T375017 T374815 T374644)]] | [production] | 
            
  | 06:51 | <brouberol@deploy2002> | helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply | [production] | 
            
  | 06:50 | <brouberol@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply | [production] |