|
2024-01-05
§
|
| 10:40 |
<hashar> |
Rollback Quibble Jenkins jobs update due to broken `git` introduced by https://gerrit.wikimedia.org/r/c/integration/config/+/983892 |
[releng] |
| 10:38 |
<hashar> |
Updated Quibble Jenkins jobs to latest images ( https://gerrit.wikimedia.org/r/c/integration/config/+/987790 and https://gerrit.wikimedia.org/r/c/integration/config/+/983892 ) |
[releng] |
| 10:29 |
<fnegri@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.grid.cleanup_queue_errors (exit_code=0) |
[tools] |
| 10:29 |
<fnegri@cloudcumin1001> |
START - Cookbook wmcs.toolforge.grid.cleanup_queue_errors |
[tools] |
| 09:26 |
<moritzm> |
installing 5.10.205 kernels on Bullseye hosts |
[production] |
| 09:15 |
<_joe_> |
upgrading conftool across the fleet |
[production] |
| 08:01 |
<moritzm> |
installing 6.1.69 kernels on Bookworm hosts |
[production] |
| 01:27 |
<zabe> |
zabe@mwmaint2002:~$ mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=arzwiki --logwiki=metawiki 'WanderingPlaywrite' 'WanderingPlaywright' # T354397 |
[production] |
| 01:13 |
<wm-bot> |
<bd808> Killed stuck pod running for >24h after ping by legoktm on irc |
[tools.gitlab-account-approval] |
| 00:59 |
<cwhite> |
restarted prometheus@k8s on prometheus1006 and backed up the wal for OOM loop investigation |
[production] |
| 00:52 |
<cwhite> |
restarted prometheus@k8s on prometheus1005 and backed up the wal for OOM loop investigation |
[production] |
|
2024-01-04
§
|
| 23:10 |
<ebernhardson@deploy2002> |
helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 23:10 |
<ebernhardson@deploy2002> |
helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 22:34 |
<ebernhardson@deploy2002> |
helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 22:33 |
<ebernhardson@deploy2002> |
helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 22:33 |
<ebernhardson@deploy2002> |
helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 22:33 |
<ebernhardson@deploy2002> |
helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 22:31 |
<ebernhardson@deploy2002> |
helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 22:31 |
<ebernhardson@deploy2002> |
helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 22:29 |
<ebernhardson@deploy2002> |
helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 22:29 |
<ebernhardson@deploy2002> |
helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 22:29 |
<ebernhardson@deploy2002> |
helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 22:29 |
<ebernhardson@deploy2002> |
helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 22:25 |
<ebernhardson@deploy2002> |
helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 22:25 |
<ebernhardson@deploy2002> |
helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 22:24 |
<rzl@deploy2002> |
helmfile [codfw] DONE helmfile.d/admin 'apply'. |
[production] |
| 22:24 |
<rzl@deploy2002> |
helmfile [codfw] START helmfile.d/admin 'apply'. |
[production] |
| 22:22 |
<dani@deploy2002> |
helmfile [eqiad] DONE helmfile.d/services/miscweb: apply |
[production] |
| 22:22 |
<dani@deploy2002> |
helmfile [eqiad] START helmfile.d/services/miscweb: apply |
[production] |
| 22:22 |
<dani@deploy2002> |
helmfile [codfw] DONE helmfile.d/services/miscweb: apply |
[production] |
| 22:21 |
<dani@deploy2002> |
helmfile [codfw] START helmfile.d/services/miscweb: apply |
[production] |
| 22:21 |
<dani@deploy2002> |
helmfile [staging] DONE helmfile.d/services/miscweb: apply |
[production] |
| 22:21 |
<dani@deploy2002> |
helmfile [staging] START helmfile.d/services/miscweb: apply |
[production] |
| 22:00 |
<rzl@deploy2002> |
helmfile [codfw] DONE helmfile.d/admin 'apply'. |
[production] |
| 22:00 |
<rzl@deploy2002> |
helmfile [codfw] START helmfile.d/admin 'apply'. |
[production] |
| 21:38 |
<ebernhardson@deploy2002> |
helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 21:38 |
<ebernhardson@deploy2002> |
helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 21:27 |
<brennen> |
end of utc late backport window |
[production] |
| 21:26 |
<brennen@deploy2002> |
Finished scap: Backport for [[gerrit:987738|Ensure all non-okay statuses from ::getImageContents have a message (T354374)]] (duration: 08m 01s) |
[production] |
| 21:20 |
<brennen@deploy2002> |
brennen and dreamyjazz: Continuing with sync |
[production] |
| 21:19 |
<brennen@deploy2002> |
brennen and dreamyjazz: Backport for [[gerrit:987738|Ensure all non-okay statuses from ::getImageContents have a message (T354374)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
| 21:18 |
<brennen@deploy2002> |
Started scap: Backport for [[gerrit:987738|Ensure all non-okay statuses from ::getImageContents have a message (T354374)]] |
[production] |
| 21:17 |
<brennen@deploy2002> |
Finished scap: Backport for [[gerrit:987734|Check for invalid JSON on a good response from PhotoDNA (T354370)]] (duration: 07m 57s) |
[production] |
| 21:11 |
<brennen@deploy2002> |
brennen and dreamyjazz: Continuing with sync |
[production] |
| 21:10 |
<brennen@deploy2002> |
brennen and dreamyjazz: Backport for [[gerrit:987734|Check for invalid JSON on a good response from PhotoDNA (T354370)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
| 21:09 |
<brennen@deploy2002> |
Started scap: Backport for [[gerrit:987734|Check for invalid JSON on a good response from PhotoDNA (T354370)]] |
[production] |
| 20:41 |
<ryankemper> |
[apifeatureusage] T350703 Restarted `logstash` on `apifeatureusage[1,2]001` |
[production] |
| 20:39 |
<dduvall@deploy2002> |
rebuilt and synchronized wikiversions files: group2 wikis to 1.42.0-wmf.12 refs T350088 |
[production] |
| 20:30 |
<mutante> |
mwmaint2002 - /usr/local/sbin/sync-home-mwmaint after gerrit:987778 |
[production] |
| 20:20 |
<dduvall@deploy2002> |
Synchronized php: group1 wikis to 1.42.0-wmf.12 refs T350088 (duration: 06m 09s) |
[production] |