4551-4600 of 10000 results (37ms)
2021-02-16 ยง
17:27 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1352.eqiad.wmnet with reason: REIMAGE [production]
17:24 <godog> swift codfw-prod decrease HDD weight for ms-be20[16-27] - T272837 [production]
17:23 <jforrester@deploy1001> Finished deploy [integration/docroot@8ab9125]: Update docroot with Special:MyLanguage links. (duration: 00m 11s) [production]
17:23 <jforrester@deploy1001> Started deploy [integration/docroot@8ab9125]: Update docroot with Special:MyLanguage links. [production]
17:21 <akosiaris@deploy1001> helmfile [staging-codfw] DONE helmfile.d/admin 'sync'. [production]
17:21 <akosiaris@deploy1001> helmfile [staging-codfw] START helmfile.d/admin 'sync'. [production]
17:18 <akosiaris@deploy1001> helmfile [staging-codfw] START helmfile.d/admin 'sync'. [production]
16:25 <klausman@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ml-etcd[2001-2003].codfw.wmnet with reason: klausman: Pushing new etcd changes from T273071 [production]
16:25 <klausman@cumin2001> START - Cookbook sre.hosts.downtime for 2:00:00 on ml-etcd[2001-2003].codfw.wmnet with reason: klausman: Pushing new etcd changes from T273071 [production]
16:17 <moritzm> installing edk2 security updates [production]
16:09 <moritzm> installing python-bottle security updates on buster [production]
15:58 <papaul> power down ms-be2031 for firmware upgrade [production]
15:44 <klausman@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ml-etcd[1001-1003].eqiad.wmnet with reason: klausman: Pushing new etcd changes from T273071 [production]
15:44 <klausman@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on ml-etcd[1001-1003].eqiad.wmnet with reason: klausman: Pushing new etcd changes from T273071 [production]
15:27 <cdanis> re-enabling Puppet on cp-upload@eqsin to deploy Iab4d211 T274888 [production]
15:26 <akosiaris@deploy1001> helmfile [staging-codfw] DONE helmfile.d/admin 'sync'. [production]
15:25 <akosiaris@deploy1001> helmfile [staging-codfw] START helmfile.d/admin 'sync'. [production]
15:25 <akosiaris@deploy1001> helmfile [staging-codfw] DONE helmfile.d/admin 'sync'. [production]
15:25 <akosiaris@deploy1001> helmfile [staging-codfw] START helmfile.d/admin 'sync'. [production]
15:17 <akosiaris@deploy1001> helmfile [staging-codfw] DONE helmfile.d/admin 'sync'. [production]
15:17 <akosiaris@deploy1001> helmfile [staging-codfw] START helmfile.d/admin 'sync'. [production]
15:16 <akosiaris@deploy1001> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
15:16 <akosiaris@deploy1001> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
15:15 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings.php: WikimediaEvents: Sample mediawiki.client.session_tick at 1:100 (T274172) (duration: 01m 00s) [production]
15:14 <akosiaris@deploy1001> helmfile [staging-codfw] DONE helmfile.d/admin 'sync'. [production]
15:14 <akosiaris@deploy1001> helmfile [staging-codfw] START helmfile.d/admin 'sync'. [production]
15:13 <akosiaris@deploy1001> helmfile [staging-codfw] DONE helmfile.d/admin 'sync'. [production]
15:13 <akosiaris@deploy1001> helmfile [staging-codfw] START helmfile.d/admin 'sync'. [production]
15:12 <cdanis> previous message was re: T274888 [production]
15:11 <cdanis> โœ”๏ธ cdanis@cumin1001.eqiad.wmnet ~ ๐Ÿ•™โ˜• sudo cumin 'A:cp-upload and A:eqsin' 'disable-puppet "cdanis deploying Iab4d211 T263496"' [production]
14:38 <twentyafterfour@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.36.0-wmf.30 refs T271344 bfc73b6e8b33e49e916d9d93cf5cdb7624297d44 [production]
14:24 <twentyafterfour> MediaWiki train: prepare to promote all wikis to 1.36.0-wmf.30 refs T271344 [production]
14:07 <akosiaris> rolling restart of cp500[1-6] [production]
13:40 <marostegui> Deploy schema change on s2 codfw - T273359 [production]
13:13 <urbanecm@deploy1001> Synchronized static/images/cswiki-black-ribbon.png: 5d5b5c41d889f6f30566f23bd9f71d16337b9d6d: Temporarily add cswiki-black-ribbon.png as a static resource (duration: 01m 07s) [production]
13:02 <jayme@deploy1001> helmfile [staging-codfw] DONE helmfile.d/admin 'sync'. [production]
12:53 <aborrero@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
12:46 <aborrero@cumin1001> START - Cookbook sre.dns.netbox [production]
12:41 <jayme@deploy1001> helmfile [staging-codfw] START helmfile.d/admin 'sync'. [production]
12:39 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/Wikibase.php: Config: [[gerrit:664507|Enable Wikibase Repo ID generator rate limiting on Test Wikidata (T272032)]] 2/2 (duration: 01m 06s) [production]
12:38 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:664507|Enable Wikibase Repo ID generator rate limiting on Test Wikidata (T272032)]] 1/2 (duration: 01m 12s) [production]
12:29 <jayme@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'kube-system' for release 'eventrouter' . [production]
12:08 <jayme@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'kube-system' for release 'eventrouter' . [production]
12:06 <marostegui> Deploy schema change on s5 codfw - T273359 [production]
11:54 <urbanecm@deploy1001> Synchronized php-1.36.0-wmf.30/extensions/DiscussionTools/includes/CommentFormatter.php: 5f4f516177a355b42b896ee142d66c0c969e20f1: CommentFormatter: Fix problems with editsection and quotes (T274709) (duration: 01m 12s) [production]
11:54 <kharlan@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'linkrecommendation' for release 'production' . [production]
11:54 <kharlan@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'linkrecommendation' for release 'external' . [production]
11:52 <kharlan@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'linkrecommendation' for release 'external' . [production]
11:52 <kharlan@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'linkrecommendation' for release 'production' . [production]
11:47 <kharlan@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'linkrecommendation' for release 'staging' . [production]