601-650 of 10000 results (101ms)
2024-10-03 ยง
12:13 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host logging-hd2004.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
12:09 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host logging-hd2004.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
12:05 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1077673|ReassignMenteesJob: Do not schedule follow-up jobs when first job fails (T376124)]] [production]
12:05 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host logging-hd2005.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
12:02 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host logging-hd2005.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
11:15 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db1178 (T367856)', diff saved to https://phabricator.wikimedia.org/P69458 and previous config saved to /var/cache/conftool/dbconfig/20241003-111544-ladsgroup.json [production]
11:15 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 12:00:00 on db1178.eqiad.wmnet with reason: Maintenance [production]
11:15 <ladsgroup@cumin1002> START - Cookbook sre.hosts.downtime for 2 days, 12:00:00 on db1178.eqiad.wmnet with reason: Maintenance [production]
11:15 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1177 (T367856)', diff saved to https://phabricator.wikimedia.org/P69457 and previous config saved to /var/cache/conftool/dbconfig/20241003-111522-ladsgroup.json [production]
11:00 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1177', diff saved to https://phabricator.wikimedia.org/P69456 and previous config saved to /var/cache/conftool/dbconfig/20241003-110015-ladsgroup.json [production]
10:45 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1177', diff saved to https://phabricator.wikimedia.org/P69454 and previous config saved to /var/cache/conftool/dbconfig/20241003-104508-ladsgroup.json [production]
10:30 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1177 (T367856)', diff saved to https://phabricator.wikimedia.org/P69453 and previous config saved to /var/cache/conftool/dbconfig/20241003-103001-ladsgroup.json [production]
10:29 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1077658|Backport ReassignMenteesJob-related changes (T376124)]] (duration: 06m 54s) [production]
10:29 <elukey@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
10:25 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
10:22 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1077658|Backport ReassignMenteesJob-related changes (T376124)]] [production]
10:11 <elukey@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
10:08 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
10:06 <elukey@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
10:06 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
10:04 <slyngshede@cumin1002> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM irc1004.wikimedia.org [production]
10:00 <kcvelaga@deploy2002> Finished deploy [airflow-dags/analytics_product@b715af7]: T375153 (duration: 02m 44s) [production]
10:00 <slyngshede@cumin1002> START - Cookbook sre.ganeti.reboot-vm for VM irc1004.wikimedia.org [production]
09:58 <kcvelaga@deploy2002> Started deploy [airflow-dags/analytics_product@b715af7]: T375153 [production]
09:42 <dcausse@deploy2002> helmfile [eqiad] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
09:41 <dcausse@deploy2002> helmfile [eqiad] START helmfile.d/services/rdf-streaming-updater: apply [production]
09:38 <dcausse@deploy2002> helmfile [codfw] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
09:38 <dcausse@deploy2002> helmfile [codfw] START helmfile.d/services/rdf-streaming-updater: apply [production]
09:35 <dcausse@deploy2002> helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
09:35 <dcausse@deploy2002> helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply [production]
08:36 <hashar@deploy2002> rebuilt and synchronized wikiversions files: group2 to 1.43.0-wmf.25 refs T375656 [production]
08:25 <hashar@deploy2002> Finished scap sync-world: Backport for [[gerrit:1077505|Deprecate ParserOutput::setLanguageLinks(null) (T376323)]] (duration: 07m 07s) [production]
08:20 <hashar@deploy2002> hashar, cscott: Continuing with sync [production]
08:20 <hashar@deploy2002> hashar, cscott: Backport for [[gerrit:1077505|Deprecate ParserOutput::setLanguageLinks(null) (T376323)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
08:18 <hashar@deploy2002> Started scap sync-world: Backport for [[gerrit:1077505|Deprecate ParserOutput::setLanguageLinks(null) (T376323)]] [production]
08:14 <hashar@deploy2002> Finished scap sync-world: Backport for [[gerrit:1077487|bjnwiki: Update logo (T375055)]], [[gerrit:1077488|bjnwiktionary: Add logo (T374898)]] (duration: 08m 37s) [production]
08:09 <hashar@deploy2002> hashar, hamishz: Continuing with sync [production]
08:07 <hashar@deploy2002> hashar, hamishz: Backport for [[gerrit:1077487|bjnwiki: Update logo (T375055)]], [[gerrit:1077488|bjnwiktionary: Add logo (T374898)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
08:05 <hashar@deploy2002> Started scap sync-world: Backport for [[gerrit:1077487|bjnwiki: Update logo (T375055)]], [[gerrit:1077488|bjnwiktionary: Add logo (T374898)]] [production]
08:03 <hashar> Ran `mwscript resetAuthenticationThrottle.php --signup --ip 14.139.82.6` for `metawiki`, `mediawikiwiki` and `wikidatawiki` # T375794 [production]
07:59 <hashar@deploy2002> Finished scap sync-world: Backport for [[gerrit:1077502|throttle.php: Remove expired throttle]], [[gerrit:1077619|IP limit exemption for WTS 2024 (T375794)]] (duration: 08m 41s) [production]
07:54 <hashar@deploy2002> anzx, hamishz, hashar: Continuing with sync [production]
07:53 <hashar@deploy2002> anzx, hamishz, hashar: Backport for [[gerrit:1077502|throttle.php: Remove expired throttle]], [[gerrit:1077619|IP limit exemption for WTS 2024 (T375794)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
07:50 <hashar@deploy2002> Started scap sync-world: Backport for [[gerrit:1077502|throttle.php: Remove expired throttle]], [[gerrit:1077619|IP limit exemption for WTS 2024 (T375794)]] [production]
07:16 <kartik@deploy2002> Finished scap sync-world: Backport for [[gerrit:1076559|Section Translation: Add mos, kde and rsk Wikipedias (T375017 T374815 T374644)]] (duration: 10m 39s) [production]
07:12 <kartik@deploy2002> kartik: Continuing with sync [production]
07:08 <kartik@deploy2002> kartik: Backport for [[gerrit:1076559|Section Translation: Add mos, kde and rsk Wikipedias (T375017 T374815 T374644)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
07:06 <kartik@deploy2002> Started scap sync-world: Backport for [[gerrit:1076559|Section Translation: Add mos, kde and rsk Wikipedias (T375017 T374815 T374644)]] [production]
06:51 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
06:50 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]