4751-4800 of 10000 results (127ms)
2024-10-05 §
16:36 <hnowlan@deploy1003> helmfile [staging] START helmfile.d/services/thumbor: apply [production]
13:31 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db1192 (T367856)', diff saved to https://phabricator.wikimedia.org/P69470 and previous config saved to /var/cache/conftool/dbconfig/20241005-133058-ladsgroup.json [production]
13:30 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 12:00:00 on db1192.eqiad.wmnet with reason: Maintenance [production]
13:30 <ladsgroup@cumin1002> START - Cookbook sre.hosts.downtime for 2 days, 12:00:00 on db1192.eqiad.wmnet with reason: Maintenance [production]
13:30 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1178 (T367856)', diff saved to https://phabricator.wikimedia.org/P69469 and previous config saved to /var/cache/conftool/dbconfig/20241005-133036-ladsgroup.json [production]
13:15 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1178', diff saved to https://phabricator.wikimedia.org/P69468 and previous config saved to /var/cache/conftool/dbconfig/20241005-131529-ladsgroup.json [production]
13:00 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1178', diff saved to https://phabricator.wikimedia.org/P69467 and previous config saved to /var/cache/conftool/dbconfig/20241005-130022-ladsgroup.json [production]
12:45 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1178 (T367856)', diff saved to https://phabricator.wikimedia.org/P69466 and previous config saved to /var/cache/conftool/dbconfig/20241005-124515-ladsgroup.json [production]
2024-10-04 §
17:48 <ejegg> fundraising civicrm upgraded from 90199f62 to 45855ff4 [production]
16:21 <ayounsi@cumin1002> END (FAIL) - Cookbook sre.hosts.dhcp (exit_code=99) for host sretest2001.codfw.wmnet [production]
16:00 <bking@cumin2002> END (FAIL) - Cookbook sre.wdqs.categories-reload (exit_code=99) reloading categories to wdqs-categories1001.eqiad.wmnet [production]
14:29 <mforns@deploy2002> Finished deploy [airflow-dags/analytics@4b69f50]: add category to commons impact metrics allowlist (duration: 01m 48s) [production]
14:28 <mforns@deploy2002> Started deploy [airflow-dags/analytics@4b69f50]: add category to commons impact metrics allowlist [production]
13:54 <bking@cumin2002> START - Cookbook sre.wdqs.categories-reload reloading categories to wdqs-categories1001.eqiad.wmnet [production]
13:33 <bking@cumin2002> END (ERROR) - Cookbook sre.wdqs.categories-reload (exit_code=97) reloading categories to wdqs-categories1001.eqiad.wmnet [production]
13:32 <bking@cumin2002> START - Cookbook sre.wdqs.categories-reload reloading categories to wdqs-categories1001.eqiad.wmnet [production]
13:19 <ayounsi@cumin1002> START - Cookbook sre.hosts.dhcp for host sretest2001.codfw.wmnet [production]
12:00 <jnuche@deploy2002> Finished deploy [releng/jenkins-deploy@9096f1b] (releasing): (no justification provided) (duration: 01m 13s) [production]
11:59 <jnuche@deploy2002> Started deploy [releng/jenkins-deploy@9096f1b] (releasing): (no justification provided) [production]
11:47 <jnuche@deploy2002> Finished deploy [releng/jenkins-deploy@9096f1b] (releasing): (no justification provided) (duration: 00m 47s) [production]
11:46 <jnuche@deploy2002> Started deploy [releng/jenkins-deploy@9096f1b] (releasing): (no justification provided) [production]
10:19 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host irc2004.wikimedia.org [production]
10:16 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host irc2004.wikimedia.org [production]
10:13 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host irc1004.wikimedia.org [production]
10:09 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host irc1004.wikimedia.org [production]
10:07 <moritzm> upload ircstream 0.13.0+sse12u1 to apt.wikimedia.org bookworm/ircstream-sse component (seperate build using the experimental eventstream feature branch of ircstream) T376014 [production]
09:43 <btullis@cumin1002> END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database shnwikinews (T375432) [production]
09:35 <moritzm> upload ircstream 0.13.0+wmf12u1 to apt.wikimedia.org T376014 [production]
09:18 <btullis@cumin1002> START - Cookbook sre.wikireplicas.add-wiki for database shnwikinews (T375432) [production]
09:17 <btullis@cumin1002> END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database kgewiki (T374814) [production]
09:17 <btullis@cumin1002> START - Cookbook sre.wikireplicas.add-wiki for database kgewiki (T374814) [production]
09:17 <btullis@cumin1002> END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database gorwikiquote (T375094) [production]
09:16 <btullis@cumin1002> START - Cookbook sre.wikireplicas.add-wiki for database gorwikiquote (T375094) [production]
09:16 <btullis@cumin1002> END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database madwiktionary (T375023) [production]
09:16 <btullis@cumin1002> START - Cookbook sre.wikireplicas.add-wiki for database madwiktionary (T375023) [production]
09:15 <btullis@cumin1002> END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database moswiki (T375568) [production]
09:15 <btullis@cumin1002> START - Cookbook sre.wikireplicas.add-wiki for database moswiki (T375568) [production]
09:09 <jelto@deploy2002> helmfile [staging] DONE helmfile.d/services/wikidata-query-gui: apply [production]
08:58 <jelto@deploy2002> helmfile [staging] START helmfile.d/services/wikidata-query-gui: apply [production]
07:51 <oblivian@puppetserver1001> conftool action : set/weight=10; selector: dc=eqiad,cluster=kubernetes,name=mw1439.eqiad.wmnet [production]
07:51 <oblivian@puppetserver1001> conftool action : set/weight=1; selector: dc=eqiad,cluster=kubernetes,name=mw1439.eqiad.wmnet [production]
07:30 <hashar> upgrading Jenkins on CI Jenkins [production]
07:04 <moritzm> import jenkins 2.462.3 to thirdparty/ci T376449 [production]
01:45 <ejegg> payments-wiki upgraded from e88750e6 to ed2d78b3 [production]
2024-10-03 §
22:37 <brennen@deploy2002> Finished scap sync-world: Backport for [[gerrit:1077802|Revert "Turn on Parsoid Selective Update metrics" (T376433)]] (duration: 07m 04s) [production]
22:33 <brennen@deploy2002> brennen: Continuing with sync [production]
22:32 <brennen@deploy2002> brennen: Backport for [[gerrit:1077802|Revert "Turn on Parsoid Selective Update metrics" (T376433)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
22:30 <brennen@deploy2002> Started scap sync-world: Backport for [[gerrit:1077802|Revert "Turn on Parsoid Selective Update metrics" (T376433)]] [production]
22:18 <brennen@deploy2002> scap failed: <CalledProcessError> Command 'sudo -u mwbuilder /srv/mwbuilder/release/make-container-image/build-images.py /srv/mediawiki-staging/scap/image-build --staging-dir /srv/mediawiki-staging --mediawiki-versions 1.43.0-wmf.25 --multiversion-image-name docker-registry.discovery.wmnet/restricted/mediawiki-multiversion --multiversion-debug-image-name docker-registry.discovery.wmnet/restricted/m [production]
22:18 <brennen@deploy2002> Started scap sync-world: Backport for [[gerrit:1077802|Revert "Turn on Parsoid Selective Update metrics" (T376433)]] [production]