1701-1750 of 10000 results (85ms)
2023-07-31 ยง
14:52 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1166 (T342617)', diff saved to https://phabricator.wikimedia.org/P49823 and previous config saved to /var/cache/conftool/dbconfig/20230731-145232-ladsgroup.json [production]
14:47 <sukhe> finished rolling out gdnsd 3.99.0~alpha2 upgrade [production]
14:45 <fabfur> imported prometheus-rdkafka-exporter package into bookworm-wikimedia (https://gerrit.wikimedia.org/r/c/operations/software/prometheus-rdkafka-exporter/+/942613) T342154 [production]
14:37 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1166', diff saved to https://phabricator.wikimedia.org/P49821 and previous config saved to /var/cache/conftool/dbconfig/20230731-143725-ladsgroup.json [production]
14:32 <fabfur> imported file-read-backwards package into bookworm-wikimedia (https://gerrit.wikimedia.org/r/c/operations/debs/file-read-backwards/+/942491) T342154 [production]
14:31 <btullis@deploy1002> helmfile [eqiad] START helmfile.d/services/datahub: apply on main [production]
14:26 <volans> uploaded python3-wmflib_1.2.3 to apt.wikimedia.org buster-wikimedia,bullseye-wikimedia,bookworm-wikimedia [production]
14:25 <btullis@deploy1002> helmfile [codfw] DONE helmfile.d/services/datahub: sync on main [production]
14:22 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1166', diff saved to https://phabricator.wikimedia.org/P49820 and previous config saved to /var/cache/conftool/dbconfig/20230731-142220-ladsgroup.json [production]
14:21 <btullis@deploy1002> helmfile [codfw] START helmfile.d/services/datahub: apply on main [production]
14:10 <btullis@deploy1002> helmfile [staging] DONE helmfile.d/services/datahub: sync on main [production]
14:09 <jforrester@deploy1002> Finished scap: Backport for [[gerrit:942685|Wikifunctions: Add WF as alias for NS_PROJECT (and WT for its talk) (T342964)]] (duration: 07m 27s) [production]
14:07 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1166 (T342617)', diff saved to https://phabricator.wikimedia.org/P49819 and previous config saved to /var/cache/conftool/dbconfig/20230731-140713-ladsgroup.json [production]
14:05 <btullis@deploy1002> helmfile [staging] START helmfile.d/services/datahub: apply on main [production]
14:03 <jforrester@deploy1002> jforrester: Continuing with sync [production]
14:03 <jforrester@deploy1002> jforrester: Backport for [[gerrit:942685|Wikifunctions: Add WF as alias for NS_PROJECT (and WT for its talk) (T342964)]] synced to the testservers mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option) [production]
14:01 <jforrester@deploy1002> Started scap: Backport for [[gerrit:942685|Wikifunctions: Add WF as alias for NS_PROJECT (and WT for its talk) (T342964)]] [production]
13:59 <sukhe> reprepro -C component/dnsdist include bookworm-wikimedia dnsdist_1.8.0-1+wmf12u1_amd64.changes: T342154 [production]
13:57 <jforrester@deploy1002> Finished scap: Backport for [[gerrit:942684|Wikifunctions: Disable the Collection extension for now, broken (T342931)]] (duration: 07m 38s) [production]
13:57 <btullis@deploy1002> helmfile [staging] DONE helmfile.d/services/datahub: sync on main [production]
13:52 <sukhe> reprepro -C main include bullseye-wikimedia gdnsd_3.99.0~alpha2-1_amd64.changes [production]
13:51 <jforrester@deploy1002> jforrester: Continuing with sync [production]
13:51 <jforrester@deploy1002> jforrester: Backport for [[gerrit:942684|Wikifunctions: Disable the Collection extension for now, broken (T342931)]] synced to the testservers mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option) [production]
13:50 <jforrester@deploy1002> Started scap: Backport for [[gerrit:942684|Wikifunctions: Disable the Collection extension for now, broken (T342931)]] [production]
13:49 <jforrester@deploy1002> Synchronized wmf-config/interwiki.php: T325908 (duration: 06m 25s) [production]
13:45 <moritzm> install gtk+3.0 bugfix updates from Bullseye 11.7 point release [production]
13:44 <btullis@deploy1002> helmfile [staging] START helmfile.d/services/datahub: apply on main [production]
13:42 <fabfur> imported fifo-log-demux package into bookworm-wikimedia (https://gerrit.wikimedia.org/r/c/operations/software/fifo-log-demux/+/942414) T342154 [production]
13:38 <jforrester@deploy1002> Finished scap: Backport for [[gerrit:941995|Remove F: namespace alias (T325910)]] (duration: 24m 24s) [production]
13:37 <marostegui@cumin1001> dbctl commit (dc=all): 'db2114 (re)pooling @ 100%: Repooling after migration', diff saved to https://phabricator.wikimedia.org/P49818 and previous config saved to /var/cache/conftool/dbconfig/20230731-133707-root.json [production]
13:29 <jforrester@deploy1002> jforrester and epicpupper: Continuing with sync [production]
13:29 <jforrester@deploy1002> jforrester and epicpupper: Backport for [[gerrit:941995|Remove F: namespace alias (T325910)]] synced to the testservers mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option) [production]
13:24 <moritzm> imported jenkins 2.401.3 to thirdparty/ci for bullseye-wikimedia T342572 [production]
13:22 <marostegui@cumin1001> dbctl commit (dc=all): 'db2114 (re)pooling @ 75%: Repooling after migration', diff saved to https://phabricator.wikimedia.org/P49817 and previous config saved to /var/cache/conftool/dbconfig/20230731-132201-root.json [production]
13:14 <jforrester@deploy1002> Started scap: Backport for [[gerrit:941995|Remove F: namespace alias (T325910)]] [production]
13:13 <James_F> WikiLambda backport verified for T342891 T342687 T341500 T343006 T342901 and T343041 [production]
13:09 <jforrester@deploy1002> Synchronized php-1.41.0-wmf.19/extensions/WikiLambda/: (no justification provided) (duration: 07m 16s) [production]
13:06 <marostegui@cumin1001> dbctl commit (dc=all): 'db2114 (re)pooling @ 50%: Repooling after migration', diff saved to https://phabricator.wikimedia.org/P49816 and previous config saved to /var/cache/conftool/dbconfig/20230731-130657-root.json [production]
13:00 <jnuche> CI Jenkins upgraded to 2.401.3: https://phabricator.wikimedia.org/T342572 [production]
12:57 <moritzm> installing 6.1.38 kernels on Bookworm hosts [production]
12:55 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1166 (T342617)', diff saved to https://phabricator.wikimedia.org/P49815 and previous config saved to /var/cache/conftool/dbconfig/20230731-125513-ladsgroup.json [production]
12:55 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1166.eqiad.wmnet with reason: Maintenance [production]
12:54 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1166.eqiad.wmnet with reason: Maintenance [production]
12:53 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1196.eqiad.wmnet with reason: Maint [production]
12:53 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on db1196.eqiad.wmnet with reason: Maint [production]
12:52 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depool db1196 T342284', diff saved to https://phabricator.wikimedia.org/P49814 and previous config saved to /var/cache/conftool/dbconfig/20230731-125252-ladsgroup.json [production]
12:51 <marostegui@cumin1001> dbctl commit (dc=all): 'db2114 (re)pooling @ 25%: Repooling after migration', diff saved to https://phabricator.wikimedia.org/P49813 and previous config saved to /var/cache/conftool/dbconfig/20230731-125152-root.json [production]
12:49 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db2127 (T342617)', diff saved to https://phabricator.wikimedia.org/P49812 and previous config saved to /var/cache/conftool/dbconfig/20230731-124912-ladsgroup.json [production]
12:49 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2127.codfw.wmnet with reason: Maintenance [production]
12:48 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2127.codfw.wmnet with reason: Maintenance [production]