|
2021-10-04
ยง
|
| 21:09 |
<brennen> |
finished upgrading shared runners (1002 - 1005) to gitlab-runner 14.3.2 (T292256) |
[releng] |
| 21:02 |
<brennen> |
gitlab-runners: upgrading each shared runner to 14.3.2 |
[releng] |
| 19:42 |
<wm-bot> |
<lucaswerkmeister> deployed 1697521bf5 (l10n updates) |
[tools.lexeme-forms] |
| 18:13 |
<jiji@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 18:12 |
<James_F> |
Docker: Publish composer 2.x-based images for T279857 |
[releng] |
| 17:25 |
<wm-bot> |
<bd808> Restarted to pick up 942ec3e |
[tools.admin] |
| 17:07 |
<bstorm> |
reboot everything T291406 |
[toolsbeta] |
| 17:06 |
<bstorm> |
use cumin to edit fstab to remove old nfs mounts T291406 |
[toolsbeta] |
| 16:56 |
<elukey> |
restart java daemons on an-coord1001 (standby) |
[analytics] |
| 16:51 |
<bblack> |
rolling restart of haproxy for DoTLS on dns300[12],authdns1001,authdns2001 to recycle connections |
[production] |
| 16:46 |
<James_F> |
Zuul: [mediawiki/extensions/SportsTeams] Add BlogPage as phan dependency |
[releng] |
| 16:41 |
<bstorm> |
setting mount_nfs: true on toolsbeta-mail prefix (which is the correct setting) |
[toolsbeta] |
| 16:35 |
<bstorm> |
deleting cloudstore-nfs-01 as that was the old instance for "nfs-01" T291406 |
[cloudstore] |
| 15:54 |
<James_F> |
Zuul: Add Lindsay Wardell personal e-mail to CI allow list |
[releng] |
| 15:33 |
<wm-bot> |
<root> Ran `jstart -j y -mem 1g -once wmopbot.sh` from .bash_history in attempt to restart bot |
[tools.wmopbot] |
| 15:24 |
<vgutierrez> |
pool cp5006 |
[production] |
| 15:17 |
<ladsgroup@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . |
[production] |
| 15:16 |
<ladsgroup@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . |
[production] |
| 14:50 |
<phuedx> |
phuedx@mwmaint1002:~$ mwscript extensions/SecurePoll/cli/purgeDecryptionKeys.php --wiki=votewiki --before="20210101000000" |
[production] |
| 14:46 |
<ladsgroup@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . |
[production] |
| 14:46 |
<effie> |
uploading scap 4.0.2 - T291095 |
[production] |
| 14:45 |
<ladsgroup@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . |
[production] |
| 14:45 |
<dcaro> |
rebooting toolsbeta-sgewebgrid-generic-0901.toolsbeta.eqiad1.wikimedia.cloud to force a fsck of the dm-0 device on boot (T290970) |
[toolsbeta] |
| 14:39 |
<brennen> |
gitlab: upgrade to 14.3.2 (note there was an additional patch release on 2021-10-01) complete (T292256) |
[production] |
| 14:31 |
<brennen> |
gitlab1001: upgrading to 14.3.2 (T292256) |
[releng] |
| 14:25 |
<Amir1> |
cleaning up wb_changes_subscription rows from closed wikis (T292440) |
[production] |
| 14:24 |
<brennen> |
gitlab: downtime for upgrade to 14.3.1 |
[production] |
| 14:19 |
<elukey> |
import AMD ROCm 4.3.1 packages in buster-wikimedia's thirdparty/amd-rocm431 - T287267 |
[production] |
| 14:19 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 14:17 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 14:13 |
<ladsgroup@deploy1002> |
Synchronized wmf-config/Wikibase.php: Config: [[gerrit:725905|Explicitly enable dispatching and pruning for wikidata (T48643)]] (duration: 00m 58s) |
[production] |
| 14:08 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 14:06 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 14:03 |
<jelto@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on gitlab2001.wikimedia.org with reason: upgrade gitlab2001 to new version https://phabricator.wikmiedia.org/T292256 |
[production] |
| 14:03 |
<jelto@cumin1001> |
START - Cookbook sre.hosts.downtime for 1:00:00 on gitlab2001.wikimedia.org with reason: upgrade gitlab2001 to new version https://phabricator.wikmiedia.org/T292256 |
[production] |
| 14:01 |
<ladsgroup@deploy1002> |
Synchronized wmf-config: Config: [[gerrit:725502|Enable dispatching via jobs everywhere (T48643)]] (duration: 01m 00s) |
[production] |
| 13:43 |
<elukey> |
failover analytics-hive to an-coord1002 (to restart java daemons on 1001) |
[analytics] |
| 12:57 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 12:56 |
<ladsgroup@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:725785|Enable dispatching for wikidatawiki and commonswiki (T292088)]] (duration: 01m 00s) |
[production] |
| 12:54 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 12:08 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 12:02 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on ganeti2026.codfw.wmnet with reason: Ganeti tests |
[production] |
| 12:02 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.downtime for 2 days, 0:00:00 on ganeti2026.codfw.wmnet with reason: Ganeti tests |
[production] |
| 12:02 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on ganeti2025.codfw.wmnet with reason: Ganeti tests |
[production] |
| 12:02 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.downtime for 2 days, 0:00:00 on ganeti2025.codfw.wmnet with reason: Ganeti tests |
[production] |
| 12:01 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 11:55 |
<urbanecm> |
EU B&C window done |
[production] |
| 11:55 |
<urbanecm@deploy1002> |
Synchronized multiversion/MWWikiversions.php: 508cf5cc6d213373f7c9ba1cdef142ebc8398022: Let DB expressions intersect DB lists (T290609) (duration: 00m 58s) |
[production] |
| 11:50 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: a855078cf52d88cc2cd27a0adc7c6a680c80dd39: dewiki, nlwiki: Bump Growth features to 80% (T288420, T285254) (duration: 00m 58s) |
[production] |
| 11:46 |
<urbanecm@deploy1002> |
Synchronized private/PrivateSettings.php: 5728376: Update T250887 mitigations (duration: 00m 58s) |
[production] |