2021-06-05
§
|
20:34 |
<wm-bot> |
<lucaswerkmeister> deployed fcf67b1016 (improve title) |
[tools.lexeme-forms] |
20:34 |
<James_F> |
Zuul: [mediawiki/extensions/TitleIcon] Switch to non-composer, with-selenium |
[releng] |
16:16 |
<Amir1> |
deleting all private archives of mm2. All are inaccessible now (T282303) |
[production] |
15:21 |
<Amir1> |
delete mbox files of group D and E in mm2 (T282303) |
[production] |
14:35 |
<oblivian@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
13:30 |
<wm-bot> |
<poslovitch> [git] Updated to 01fcc66 |
[tools.lingua-libre-bot] |
12:23 |
<wm-bot> |
<lucaswerkmeister> wiki no longer read-only (T284368) |
[tools.notwikilambda] |
12:11 |
<wm-bot> |
<lucaswerkmeister> ran extensions/WikiLambda/maintenance/reloadBuiltinData.php, most objects seemed to work, only a few errors (T284368) |
[tools.notwikilambda] |
11:53 |
<wm-bot> |
<lucaswerkmeister> tried to run extensions/WikiLambda/development/updateLanguageCodes.php, most objects failed with the same “value en for Z11K1 … invalid” error as quoted in T284368 |
[tools.notwikilambda] |
11:36 |
<wm-bot> |
<lucaswerkmeister> made wiki read-only for maintenance (T284368) |
[tools.notwikilambda] |
00:21 |
<mutante> |
backup1001 - systemctl baclua-dir works again (restoring backup for non-existing host) |
[production] |
00:18 |
<mutante> |
backup1001 systemctl reload bacula-dir fails |
[production] |
2021-06-04
§
|
23:57 |
<Krinkle> |
integration-agent-qemu-1001 back up, Thanks andrewbogott |
[releng] |
23:47 |
<Krinkle> |
Qemu jobs are stuck. Jenkins is unable to connect to integration-agent-qemu-1001 |
[releng] |
23:25 |
<wm-bot> |
<lucaswerkmeister> deployed 16c0cd2606 (improve batch mode results page) |
[tools.lexeme-forms] |
22:08 |
<cwhite@cumin1001> |
END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host doh4001.wikimedia.org |
[production] |
21:51 |
<cwhite@cumin1001> |
START - Cookbook sre.ganeti.makevm for new host doh4001.wikimedia.org |
[production] |
21:30 |
<bstorm> |
deleting "tools-k8s-ingress-3", "tools-k8s-ingress-2", "tools-k8s-ingress-1" T264221 |
[tools] |
21:21 |
<bstorm> |
cleared error state from 4 grid queues |
[tools] |
20:59 |
<bblack> |
repool cp1087 - T278729 |
[production] |
20:13 |
<James_F> |
Zuul: Switch almost all node10 jobs to node12 T284345 |
[releng] |
20:11 |
<James_F> |
Zuul: [VisualEditor/VisualEditor] Switch node10 jobs to node12 T284345 |
[releng] |
20:11 |
<bblack@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp1087.eqiad.wmnet with reason: REIMAGE |
[production] |
20:09 |
<bblack@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on cp1087.eqiad.wmnet with reason: REIMAGE |
[production] |
19:19 |
<James_F> |
Docker: Publishing node12 CI images T284343 |
[releng] |
19:06 |
<bblack> |
depool cp1087 - T278729 |
[production] |
18:21 |
<ayounsi@cumin1001> |
END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) |
[production] |
17:42 |
<razzi> |
sudo cookbook sre.aqs.roll-restart aqs to deploy new mediawiki history snapshot |
[analytics] |
17:36 |
<razzi@cumin1001> |
END (PASS) - Cookbook sre.aqs.roll-restart (exit_code=0) |
[production] |
17:33 |
<razzi@cumin1001> |
START - Cookbook sre.aqs.roll-restart |
[production] |
17:33 |
<razzi@cumin1001> |
END (FAIL) - Cookbook sre.aqs.roll-restart (exit_code=99) |
[production] |
17:33 |
<razzi@cumin1001> |
START - Cookbook sre.aqs.roll-restart |
[production] |
17:28 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1040.eqiad.wmnet with reason: REIMAGE |
[production] |
17:25 |
<andrew@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1040.eqiad.wmnet with reason: REIMAGE |
[production] |
15:25 |
<topranks> |
Adding 1:1 NAT configuration for fran2001 / analytics.codfw.wikimedia.org to pfw3-codfw (backup site) |
[production] |
15:00 |
<Lucas_WMDE> |
wb-reconcile: ran `git gc --prune=now` in mw and wb and switched WikibaseReconcileEdit back to main |
[wikidata-dev] |
14:47 |
<krinkle@deploy1002> |
Synchronized wmf-config/CommonSettings.php: I434d9cfa29d84f (duration: 00m 56s) |
[production] |
14:46 |
<krinkle@deploy1002> |
Synchronized php-1.37.0-wmf.7/extensions/DiscussionTools/extension.json: Iea41ab8599ffae (duration: 00m 56s) |
[production] |
14:44 |
<krinkle@deploy1002> |
Synchronized php-1.37.0-wmf.7/extensions/DiscussionTools/includes/: Iea41ab8599ffae (duration: 00m 59s) |
[production] |
14:41 |
<krinkle@deploy1002> |
Scap failed!: 9/9 canaries failed their endpoint checks(https://en.wikipedia.org) |
[production] |
13:39 |
<Krinkle> |
mwmaint1002: Running purge_parsercache_now.php on pc1008, server 3/4, ref T282761 |
[production] |
13:33 |
<oblivian@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
12:46 |
<marostegui> |
Upgrade mysql on clouddb1016 T283235 |
[production] |