5301-5350 of 10000 results (38ms)
2021-01-13 ยง
15:41 <akosiaris@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'eventgate-analytics' for release 'production' . [production]
15:41 <akosiaris@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'eventgate-analytics' for release 'canary' . [production]
15:26 <hashar> Pruned Docker containers and images on all Docker based Jenkins agents [releng]
15:22 <hashar> Stopping Jenkins CI on contint2001 to upgrade Jenkins # T271507 [production]
15:11 <elukey@cumin1001> START - Cookbook sre.hadoop.roll-restart-masters [production]
15:06 <volans@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:10:00 on cumin2001.codfw.wmnet with reason: volans's test [production]
15:06 <volans@cumin2001> START - Cookbook sre.hosts.downtime for 0:10:00 on cumin2001.codfw.wmnet with reason: volans's test [production]
15:05 <volans> upgraded spicerack to 0.0.47-1+deb10u1 on cumin2001 - T257905 [production]
15:04 <andrewbogott> deleting matrix-synapse-01.matrix.eqiad1.wikimedia.cloud after discussion on T193964 [matrix]
15:01 <hashar> Upgraded Jenkins on releases1002 / releases2002 hosts # T271507 [production]
14:57 <moritzm> imported jenkins 2.263.2 (security release) to apt.wikimedia.org/buster-wikimedia [production]
14:27 <urbanecm@deploy1001> Synchronized php-1.36.0-wmf.26/skins/Vector/includes/templates/legacy/Sidebar.mustache: 5a117ded68b5e0fc7f9b4a8a4513780e57eceefe: Use {{link-mainpage}} in legacy sidebar same as new logo (T271873) (duration: 01m 05s) [production]
14:17 <akosiaris@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'eventgate-main' for release 'canary' . [production]
14:17 <akosiaris@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'eventgate-main' for release 'production' . [production]
14:16 <akosiaris@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'canary' . [production]
14:15 <akosiaris@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'production' . [production]
14:14 <akosiaris@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'canary' . [production]
14:14 <akosiaris@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'production' . [production]
14:14 <akosiaris@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'eventgate-analytics' for release 'production' . [production]
14:12 <akosiaris@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'eventgate-analytics' for release 'canary' . [production]
14:10 <dcaro> dcaro doing puppet tests, puppet runs might break [toolsbeta]
14:04 <liw@deploy1001> Synchronized php: group1 wikis to 1.36.0-wmf.26 (duration: 01m 03s) [production]
14:03 <liw@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.36.0-wmf.26 [production]
13:52 <akosiaris@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-main' for release 'production' . [production]
13:52 <akosiaris@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-main' for release 'canary' . [production]
13:51 <akosiaris@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'production' . [production]
13:51 <akosiaris@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'canary' . [production]
13:50 <akosiaris@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'canary' . [production]
13:50 <akosiaris@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'production' . [production]
13:49 <akosiaris@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics' for release 'canary' . [production]
13:49 <akosiaris@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics' for release 'production' . [production]
13:48 <godog> swift codfw-prod: more weight to ms-be20[58-61] - T269337 [production]
13:36 <akosiaris@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'eventstreams' for release 'canary' . [production]
13:36 <akosiaris@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'eventstreams' for release 'production' . [production]
13:31 <akosiaris@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'eventstreams' for release 'canary' . [production]
13:31 <akosiaris@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'eventstreams' for release 'production' . [production]
13:07 <akosiaris@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventstreams' for release 'production' . [production]
12:40 <arturo> try increasing systemd watchdog timeout for conntrackd in cloudnet1004 (T268335) [admin]
12:15 <dcausse> European mid-day backport window done [production]
12:09 <dcausse@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T239931: Revert "Disable sanity check cirrus jobs for Wikidata" (duration: 01m 16s) [production]
11:52 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc2029.codfw.wmnet with reason: REIMAGE [production]
11:49 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc1029.eqiad.wmnet with reason: REIMAGE [production]
11:49 <jiji@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mc2029.codfw.wmnet with reason: REIMAGE [production]
11:47 <jiji@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mc1029.eqiad.wmnet with reason: REIMAGE [production]
11:45 <dcaro> https://gerrit.wikimedia.org/r/c/operations/puppet/+/654419 merged and deployed (and tested) (T268877) [admin]
11:40 <dcaro> merging https://gerrit.wikimedia.org/r/c/operations/puppet/+/654419 that might affect the encapi service (puppet on cloud environment), no downtime expected though (T268877) [admin]
11:40 <kart_> Updated cxserver to 2021-01-12-095820-production (T234220, T270408) [production]
11:37 <kartik@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'cxserver' for release 'production' . [production]
11:33 <kartik@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'cxserver' for release 'production' . [production]
11:23 <kartik@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'cxserver' for release 'staging' . [production]