8301-8350 of 10000 results (95ms)
2023-01-04 ยง
14:40 <urbanecm> UTC afternoon B&C window done [production]
14:40 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 8:00:00 on db2094.codfw.wmnet with reason: Maintenance [production]
14:40 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2156.codfw.wmnet with reason: Maintenance [production]
14:40 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 4:00:00 on db2156.codfw.wmnet with reason: Maintenance [production]
14:39 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2149 (T326011)', diff saved to https://phabricator.wikimedia.org/P42782 and previous config saved to /var/cache/conftool/dbconfig/20230104-143949-marostegui.json [production]
14:38 <marostegui> dbmaint deploy schema change on s3 eqiad T326223 [production]
14:38 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:875305|Start reading from cul_actor on testwiki (T233004)]], [[gerrit:875312|aswikiquote: Set timezone to Asia/Kolkata (T321246)]] (duration: 09m 50s) [production]
14:37 <marostegui> dbmaint deploy schema change on s5 eqiad T326223 [production]
14:32 <XioNoX> fix inconsistent mtu on mr1-eqiad - T315838 [production]
14:30 <urbanecm@deploy1002> urbanecm and urbanecm and zabe: Backport for [[gerrit:875305|Start reading from cul_actor on testwiki (T233004)]], [[gerrit:875312|aswikiquote: Set timezone to Asia/Kolkata (T321246)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet [production]
14:28 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:875305|Start reading from cul_actor on testwiki (T233004)]], [[gerrit:875312|aswikiquote: Set timezone to Asia/Kolkata (T321246)]] [production]
14:27 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:870978|plwiki: Add editcontentmodel to interface-admin (T325819)]], [[gerrit:874884|Mark active sections even when their headings are in wrapper elements (T318044 T324869)]] (duration: 09m 32s) [production]
14:27 <XioNoX> fix inconsistent mtu on mr1-codfw - T315838 [production]
14:24 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2149', diff saved to https://phabricator.wikimedia.org/P42781 and previous config saved to /var/cache/conftool/dbconfig/20230104-142442-marostegui.json [production]
14:24 <marostegui> dbmaint deploy schema change on s7 eqiad T326227 [production]
14:22 <XioNoX> fix inconsistent mtu on mr1-eqsin - T315838 [production]
14:19 <urbanecm@deploy1002> urbanecm and stang and matmarex: Backport for [[gerrit:870978|plwiki: Add editcontentmodel to interface-admin (T325819)]], [[gerrit:874884|Mark active sections even when their headings are in wrapper elements (T318044 T324869)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet [production]
14:18 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:870978|plwiki: Add editcontentmodel to interface-admin (T325819)]], [[gerrit:874884|Mark active sections even when their headings are in wrapper elements (T318044 T324869)]] [production]
14:16 <urbanecm@deploy1002> backport aborted: (duration: 00m 07s) [production]
14:16 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:870920|Revert "trwiki: Add 20 years celebration logos" (T325823)]], [[gerrit:870988|kuwiki: Install SandboxLink (T325469)]] (duration: 09m 37s) [production]
14:16 <marostegui> Sanitize new wikis T326138 T321294 T321288 T321256 [production]
14:15 <XioNoX> fix inconsistent mtu on mr1-esams - T315838 [production]
14:14 <marostegui> dbmaint deploy schema change on s7 eqiad T326228 [production]
14:13 <marostegui> dbmaint deploy schema change on s7 eqiad T326226 [production]
14:11 <marostegui> dbmaint deploy schema change on s8 eqiad T326221 [production]
14:11 <marostegui> dbmaint deploy schema change on s7 eqiad T326221 [production]
14:11 <marostegui> dbmaint deploy schema change on s6 eqiad T326221 [production]
14:11 <marostegui> dbmaint deploy schema change on s5 eqiad T326221 [production]
14:11 <marostegui> dbmaint deploy schema change on s4 eqiad T326221 [production]
14:11 <marostegui> dbmaint deploy schema change on s3 eqiad T326221 [production]
14:11 <marostegui> dbmaint deploy schema change on s2 eqiad T326221 [production]
14:11 <marostegui> dbmaint deploy schema change on s1 eqiad T326221 [production]
14:10 <marostegui> dbmaint deploy schema change on s7 eqiad T326225 [production]
14:10 <marostegui> dbmaint deploy schema change on s7 T326225 [production]
14:09 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on puppetdb2002.codfw.wmnet with reason: maintenance [production]
14:09 <jmm@cumin2002> START - Cookbook sre.hosts.downtime for 1:00:00 on puppetdb2002.codfw.wmnet with reason: maintenance [production]
14:09 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2149', diff saved to https://phabricator.wikimedia.org/P42780 and previous config saved to /var/cache/conftool/dbconfig/20230104-140936-marostegui.json [production]
14:08 <urbanecm@deploy1002> urbanecm and stang: Backport for [[gerrit:870920|Revert "trwiki: Add 20 years celebration logos" (T325823)]], [[gerrit:870988|kuwiki: Install SandboxLink (T325469)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet [production]
14:06 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:870920|Revert "trwiki: Add 20 years celebration logos" (T325823)]], [[gerrit:870988|kuwiki: Install SandboxLink (T325469)]] [production]
14:04 <XioNoX> fix inconsistent mtu on mr1-ulsfo - T315838 [production]
14:02 <marostegui> dbmaint deploy schema change on s3 T326221 [production]
14:02 <moritzm> updating buster nodes running 5.10 to 5.10.158-2~deb10u1 (only rollout of the new kernel, no reboots) [production]
14:02 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:874844|Update interwiki cache]] (duration: 08m 00s) [production]
13:58 <marostegui> dbmaint deploy schema change on s7 T326221 [production]
13:57 <marostegui> dbmaint deploy schema change on s8 T326221 [production]
13:57 <marostegui> dbmaint deploy schema change on s6 T326221 [production]
13:56 <marostegui> dbmaint deploy schema change on s5 T326221 [production]
13:55 <marostegui> dbmaint deploy schema change on s4 T326221 [production]
13:54 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2149 (T326011)', diff saved to https://phabricator.wikimedia.org/P42779 and previous config saved to /var/cache/conftool/dbconfig/20230104-135429-marostegui.json [production]
13:54 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:874844|Update interwiki cache]] [production]