6401-6450 of 10000 results (55ms)
2021-04-29 ยง
13:37 <otto@deploy1002> Started deploy [analytics/refinery@b3c5820]: update event_sanitized_main allowlst on an-launcher1002 - T273789 [production]
13:11 <moritzm> installing postgresql-11 security updates [production]
13:08 <jbond42> merge netbase change to manage /etc/services [production]
13:07 <liw@deploy1002> Synchronized php: group1 wikis to 1.37.0-wmf.3 (duration: 01m 07s) [production]
13:06 <liw@deploy1002> rebuilt and synchronized wikiversions files: group1 wikis to 1.37.0-wmf.3 [production]
12:36 <Amir1> upgrading Quiddity to admin in mailman3 [production]
12:36 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on eventlog1002.eqiad.wmnet with reason: Testing migration of processors to eventlog1003 [production]
12:36 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on eventlog1002.eqiad.wmnet with reason: Testing migration of processors to eventlog1003 [production]
12:26 <moritzm> installing grub2 updates from buster point release [production]
12:06 <jbond42> update debmonitor.discover.wmnet ssl cert [production]
11:59 <ladsgroup@deploy1002> Synchronized wmf-config/extension-list: Config: [[gerrit:683454|Undeploy JADE from production, Part III (T281418)]] (duration: 01m 07s) [production]
11:54 <ladsgroup@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:683453|Undeploy JADE from production, Part II (T281418)]], Part I (duration: 01m 06s) [production]
11:49 <ladsgroup@deploy1002> Synchronized wmf-config/CommonSettings.php: Config: [[gerrit:683452|Undeploy JADE from production, Part I (T281418)]] (duration: 01m 07s) [production]
11:45 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sretest1002.eqiad.wmnet [production]
11:40 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single for host sretest1002.eqiad.wmnet [production]
11:38 <mbsantos@deploy1002> Synchronized wmf-config/CommonSettings.php: Config: [[gerrit:683548|Enable suggested values in TemplateData and VisualEditor CommonSettings (T273857)]] (duration: 01m 07s) [production]
11:34 <ladsgroup@deploy1002> Synchronized php-1.37.0-wmf.1/extensions/ContentTranslation/specials/SpecialContentTranslation.php: Backport: [[gerrit:683534|Another fix for token cookie handling (T281346)]] (duration: 01m 07s) [production]
11:32 <ladsgroup@deploy1002> Synchronized php-1.37.0-wmf.3/extensions/ContentTranslation/specials/SpecialContentTranslation.php: Backport: [[gerrit:683533|Another fix for token cookie handling (T281346)]] (duration: 01m 08s) [production]
11:32 <marostegui@cumin1001> dbctl commit (dc=all): 'db1110 (re)pooling @ 100%: Repool db1110', diff saved to https://phabricator.wikimedia.org/P15658 and previous config saved to /var/cache/conftool/dbconfig/20210429-113211-root.json [production]
11:24 <mbsantos@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:683547|Enable suggested values in TemplateData and VisualEditor InitialiseSettings (T273857)]] (duration: 01m 07s) [production]
11:17 <marostegui@cumin1001> dbctl commit (dc=all): 'db1110 (re)pooling @ 75%: Repool db1110', diff saved to https://phabricator.wikimedia.org/P15657 and previous config saved to /var/cache/conftool/dbconfig/20210429-111708-root.json [production]
11:02 <marostegui@cumin1001> dbctl commit (dc=all): 'db1110 (re)pooling @ 50%: Repool db1110', diff saved to https://phabricator.wikimedia.org/P15656 and previous config saved to /var/cache/conftool/dbconfig/20210429-110204-root.json [production]
10:59 <moritzm> updating apt on buster (SUA 198), which eases bullseye upgrades T275873 [production]
10:56 <ladsgroup@deploy1002> Synchronized php-1.37.0-wmf.3/extensions/ContentTranslation/modules/base/mw.cx.SiteMapper.js: Backport: [[gerrit:683135|Fix CX token cookie (T281346)]] (duration: 01m 08s) [production]
10:54 <ladsgroup@deploy1002> Synchronized php-1.37.0-wmf.1/extensions/ContentTranslation/modules/base/mw.cx.SiteMapper.js: Backport: [[gerrit:683134|Fix CX token cookie (T281346)]] (duration: 01m 09s) [production]
10:47 <marostegui@cumin1001> dbctl commit (dc=all): 'db1110 (re)pooling @ 25%: Repool db1110', diff saved to https://phabricator.wikimedia.org/P15655 and previous config saved to /var/cache/conftool/dbconfig/20210429-104700-root.json [production]
10:27 <marostegui> Upgrade kernel on db1110 [production]
10:24 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1110 for kernel upgrade', diff saved to https://phabricator.wikimedia.org/P15654 and previous config saved to /var/cache/conftool/dbconfig/20210429-102447-marostegui.json [production]
09:42 <volans> uploaded pynetbox 5.3.0-2 to bullseye-wikimedia on qpt.w.o [production]
09:39 <volans@deploy1002> Finished deploy [homer/deploy@e394769]: Release v0.2.8 (duration: 03m 30s) [production]
09:35 <volans@deploy1002> Started deploy [homer/deploy@e394769]: Release v0.2.8 [production]
09:01 <jynus> stop replication and checking data of db2100:s7 [production]
08:57 <marostegui> Upgrade kernel on db2133 [production]
08:51 <marostegui> Upgrade kernel on db2125 [production]
08:50 <marostegui> Upgrade kernel on db2124 [production]
08:46 <marostegui> Upgrade kernel on db2122 [production]
08:40 <marostegui@cumin1001> dbctl commit (dc=all): 'db1083 (re)pooling @ 100%: Repool db1083', diff saved to https://phabricator.wikimedia.org/P15652 and previous config saved to /var/cache/conftool/dbconfig/20210429-084011-root.json [production]
08:39 <marostegui> Upgrade kernel on db2121 [production]
08:33 <marostegui> Upgrade kernel on db2120 [production]
08:28 <volans@deploy1002> Finished deploy [homer/deploy@89cd07c]: Release v0.2.7 (duration: 03m 08s) [production]
08:27 <marostegui> Upgrade kernel on db2115 [production]
08:25 <volans@deploy1002> Started deploy [homer/deploy@89cd07c]: Release v0.2.7 [production]
08:25 <marostegui@cumin1001> dbctl commit (dc=all): 'db1083 (re)pooling @ 80%: Repool db1083', diff saved to https://phabricator.wikimedia.org/P15651 and previous config saved to /var/cache/conftool/dbconfig/20210429-082507-root.json [production]
08:19 <marostegui> Upgrade kernel on db2114 [production]
08:12 <marostegui> Upgrade kernel on db2109 [production]
08:10 <marostegui@cumin1001> dbctl commit (dc=all): 'db1083 (re)pooling @ 70%: Repool db1083', diff saved to https://phabricator.wikimedia.org/P15649 and previous config saved to /var/cache/conftool/dbconfig/20210429-081004-root.json [production]
07:55 <marostegui@cumin1001> dbctl commit (dc=all): 'db1083 (re)pooling @ 60%: Repool db1083', diff saved to https://phabricator.wikimedia.org/P15648 and previous config saved to /var/cache/conftool/dbconfig/20210429-075500-root.json [production]
07:54 <marostegui> Upgrade kernel on db2089 [production]
07:48 <jynus> rolling restart of bacula hosts T273182 [production]
07:48 <marostegui@deploy1002> Synchronized wmf-config/db-eqiad.php: Repool pc1007 (duration: 01m 07s) [production]