|
2026-09-14
§
|
| 07:48 |
<brouberol@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply |
[production] |
| 07:48 |
<brouberol@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply |
[production] |
| 07:48 |
<brouberol@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthbook: apply |
[production] |
| 07:48 |
<brouberol@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook: apply |
[production] |
| 07:48 |
<brouberol@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthboo-next: apply |
[production] |
| 07:47 |
<brouberol@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook-next: apply |
[production] |
| 07:47 |
<brouberol@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/superset: apply |
[production] |
| 07:47 |
<brouberol@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/superset: apply |
[production] |
| 07:47 |
<brouberol@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/superset-next: apply |
[production] |
| 07:45 |
<brouberol@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/superset-next: apply |
[production] |
| 07:45 |
<brouberol@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/spark-history: apply |
[production] |
| 07:45 |
<brouberol@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/spark-history: apply |
[production] |
| 07:45 |
<brouberol@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/spark-history: apply |
[production] |
| 07:44 |
<brouberol@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/spark-history: apply |
[production] |
| 07:31 |
<tstarling@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1340801|Allow title-like strings with Package: prefix in require() (T430644)]], [[gerrit:1340802|Runtime: Add a facility for loading files by title (T430644)]] (duration: 34m 30s) |
[production] |
| 07:18 |
<tstarling@deploy1003> |
tstarling: Continuing with deployment |
[production] |
| 07:17 |
<tstarling@deploy1003> |
tstarling: Backport for [[gerrit:1340801|Allow title-like strings with Package: prefix in require() (T430644)]], [[gerrit:1340802|Runtime: Add a facility for loading files by title (T430644)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 06:56 |
<tstarling@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1340801|Allow title-like strings with Package: prefix in require() (T430644)]], [[gerrit:1340802|Runtime: Add a facility for loading files by title (T430644)]] |
[production] |
| 06:26 |
<TimStarling> |
on deploy1003: docker image pull docker-registry.wikimedia.org/php8.3-fpm-multiversion-base |
[production] |
| 05:51 |
<_joe_> |
pulled bookworm:latest from build2004 to build2001 T437829 |
[production] |
| 05:39 |
<_joe_> |
force-running build-base-images on build2004 for T437829 |
[production] |
| 04:52 |
<TimStarling> |
on build2001 rebuilding base images T437829 |
[production] |
| 03:00 |
<tstarling@deploy1003> |
sync-world failed: <CalledProcessError> Command 'sudo -u mwbuilder /srv/mwbuilder/release/make-container-image/build-images.py --http-proxy http://webproxy:8080 --https-proxy http://webproxy:8080 /srv/mediawiki-staging/scap/image-build --staging-dir /srv/mediawiki-staging --mediawiki-versions 1.47.0-wmf.18,1.47.0-wmf.19,next --multiversion-image-basename docker-registry.discovery.wmnet/restricted |
[production] |
| 02:59 |
<tstarling@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1340801|Allow title-like strings with Package: prefix in require() (T430644)]], [[gerrit:1340802|Runtime: Add a facility for loading files by title (T430644)]] |
[production] |
| 02:00 |
<mwpresync@deploy1003> |
Started scap build-images: Publishing wmf/next image |
[production] |
|
2026-09-12
§
|
| 19:40 |
<ladsgroup@cumin1003> |
END (PASS) - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies (exit_code=0) rolling restart_daemons on A:swift-fe-eqiad |
[production] |
| 19:32 |
<ladsgroup@cumin1003> |
START - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies rolling restart_daemons on A:swift-fe-eqiad |
[production] |
| 19:30 |
<ladsgroup@cumin1003> |
END (PASS) - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies (exit_code=0) rolling restart_daemons on A:swift-fe-codfw |
[production] |
| 19:21 |
<ladsgroup@cumin1003> |
START - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies rolling restart_daemons on A:swift-fe-codfw |
[production] |
| 18:23 |
<Southparkfan> |
project-wide puppet hiera: remove puppetmaster::geoip::{fetch_private,use_proxy}, puppetdb_host, profile::puppetmaster::common::{command_broadcast,puppetdb_host,puppetdb_hosts} |
[releng] |
| 18:23 |
<Southparkfan> |
project-wide puppet hiera: remove puppetmaster::geoip::{fetch_private,use_proxy}, puppetdb_host, profile::puppetmaster::common::{command_broadcast,puppetdb_host,puppetdb_hosts} |
[deployment-prep] |
| 18:14 |
<Southparkfan> |
project-wide puppet hiera: remove role::puppetmaster::puppetdb::shared_buffers, obsoleted by profile::puppetdb::database::shared_buffers |
[releng] |
| 18:14 |
<Southparkfan> |
project-wide puppet hiera: remove role::puppetmaster::puppetdb::shared_buffers, obsoleted by profile::puppetdb::database::shared_buffers |
[deployment-prep] |
| 18:09 |
<Southparkfan> |
project-wide puppet hiera: remove profile::puppetdb::master pointing to former deployment-puppetdb02 (overridden in deployment-puppetdb prefix), profile::puppetdb::slaves (by default already empty) + profile::puppetdb::extra_authorized_hosts (variable does not exist, couldn't find it in historic commits either) |
[releng] |
| 18:09 |
<Southparkfan> |
project-wide puppet hiera: remove profile::puppetdb::master pointing to former deployment-puppetdb02 (overridden in deployment-puppetdb prefix), profile::puppetdb::slaves (by default already empty) + profile::puppetdb::extra_authorized_hosts (variable does not exist, couldn't find it in historic commits either) |
[deployment-prep] |
| 02:08 |
<mwpresync@deploy1003> |
Finished scap build-images: Publishing wmf/next image (duration: 07m 35s) |
[production] |
| 02:00 |
<mwpresync@deploy1003> |
Started scap build-images: Publishing wmf/next image |
[production] |
|
2026-09-11
§
|
| 21:51 |
<amastilovic@deploy1003> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply |
[production] |
| 21:50 |
<amastilovic@deploy1003> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply |
[production] |
| 16:47 |
<sbassett@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1339808|Use escaped() for story link parentheses in recent changes (T182213)]], [[gerrit:1339813|Use escaped() for HTML parentheses params in ChangeLineFormatter (T182213)]] (duration: 07m 23s) |
[production] |
| 16:43 |
<sbassett@deploy1003> |
sbassett: Continuing with deployment |
[production] |
| 16:42 |
<sbassett@deploy1003> |
sbassett: Backport for [[gerrit:1339808|Use escaped() for story link parentheses in recent changes (T182213)]], [[gerrit:1339813|Use escaped() for HTML parentheses params in ChangeLineFormatter (T182213)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 16:40 |
<sbassett@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1339808|Use escaped() for story link parentheses in recent changes (T182213)]], [[gerrit:1339813|Use escaped() for HTML parentheses params in ChangeLineFormatter (T182213)]] |
[production] |
| 16:29 |
<dancy> |
Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1339162 |
[releng] |
| 16:08 |
<bking@cumin2003> |
END (FAIL) - Cookbook sre.hadoop.roll-restart-workers (exit_code=99) restart workers for Hadoop analytics cluster: Roll restart of jvm daemons for openjdk upgrade. |
[production] |
| 14:39 |
<bking@cumin2003> |
START - Cookbook sre.hadoop.roll-restart-workers restart workers for Hadoop analytics cluster: Roll restart of jvm daemons for openjdk upgrade. |
[production] |
| 14:10 |
<ssastry@deploy1003> |
helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply |
[production] |