9301-9350 of 10000 results (41ms)
2020-07-09 ยง
08:44 <marostegui> Stop haproxy on dbproxy1017 before upgrading to buster - T255408 [production]
08:23 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1136', diff saved to https://phabricator.wikimedia.org/P11827 and previous config saved to /var/cache/conftool/dbconfig/20200709-082355-marostegui.json [production]
08:23 <moritzm> imported osm2pgsql 0.96.0+ds-1~bpo9+1 to "main" component T256877 [production]
08:22 <elukey@cumin1001> START - Cookbook sre.hadoop.change-distro [production]
08:20 <elukey@cumin1001> END (PASS) - Cookbook sre.hadoop.stop-cluster (exit_code=0) [production]
08:13 <elukey@cumin1001> START - Cookbook sre.hadoop.stop-cluster [production]
08:11 <XioNoX> disable igmp snooping on msw1-codfw [production]
07:59 <marostegui> Stop db1117:3322 to clone db1084, this will trigger haproxy alerts - T257540 [production]
07:57 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1136', diff saved to https://phabricator.wikimedia.org/P11825 and previous config saved to /var/cache/conftool/dbconfig/20200709-075749-marostegui.json [production]
07:19 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
07:15 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime [production]
06:52 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
06:49 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime [production]
05:39 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1101:3317', diff saved to https://phabricator.wikimedia.org/P11824 and previous config saved to /var/cache/conftool/dbconfig/20200709-053905-marostegui.json [production]
05:32 <marostegui@cumin1001> dbctl commit (dc=all): 'Remove db1084 from dbctl', diff saved to https://phabricator.wikimedia.org/P11823 and previous config saved to /var/cache/conftool/dbconfig/20200709-053206-marostegui.json [production]
05:18 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1084', diff saved to https://phabricator.wikimedia.org/P11822 and previous config saved to /var/cache/conftool/dbconfig/20200709-051826-marostegui.json [production]
05:13 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1101:3317', diff saved to https://phabricator.wikimedia.org/P11821 and previous config saved to /var/cache/conftool/dbconfig/20200709-051355-marostegui.json [production]
05:11 <marostegui> Remove revision triggers from db2093:3315 T238966 [production]
05:10 <marostegui> Deploy schema change on s5 codfw, lag will be generated - T238966 [production]
01:43 <tzatziki> reset email for GseSro [production]
00:58 <cdanis> โœ”๏ธ cdanis@cumin1001.eqiad.wmnet ~ ๐Ÿ•˜๐Ÿบ sudo cumin A:cp 'enable-puppet "cdanis deploying I6c1b646e T256395"' [production]
00:49 <cdanis> โœ”๏ธ cdanis@cumin1001.eqiad.wmnet ~ ๐Ÿ•˜๐Ÿบ sudo cumin A:cp 'disable-puppet "cdanis deploying I6c1b646e T256395"' [production]
2020-07-08 ยง
21:56 <mutante> deleting files from releases2001 that are not existing on releases1001 to make them mirrors. rsync with --delete and the command from quickdatacopy class (T247652) [production]
21:55 <mutante> rsyncing releases files from releases1001 to releases2002 and releases1002. deleting files from releases2002 not existing on releases1002 to make them mirrors ( T247652_ [production]
20:59 <cstone> civicrm revision changed from d73ee2e73f to 8b09c87ce2, [production]
20:27 <Amir1> end of foreachwikiindblist wikidataclient extensions/Wikibase/lib/maintenance/populateSitesTable.php --force-protocol https (T256012) [production]
20:08 <Amir1_> start of foreachwikiindblist wikidataclient extensions/Wikibase/lib/maintenance/populateSitesTable.php --force-protocol https (T256012) [production]
19:18 <twentyafterfour@deploy1001> Synchronized php: group1 wikis to 1.35.0-wmf.40 refs T256668 (duration: 01m 04s) [production]
19:17 <twentyafterfour@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.40 refs T256668 [production]
18:58 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 091442cf035a6d76f1211291afbb3193c513595d: Add *.nga.gov to the wgCopyUploadsDomains allowlist of Wikimedia Commons (T256518) (duration: 01m 04s) [production]
18:55 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 2e5943ddb30e08607a9ffb6ed05a042e8367e2e1: Add scan-bugs.org to $wgCopyUploadsDomains (T256569) (duration: 01m 04s) [production]
18:46 <urbanecm@deploy1001> Synchronized static/images/project-logos/: f42cdf2: Change bnwiki logo (T255328) (duration: 01m 04s) [production]
18:27 <ppchelko@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Cleanup: remove temporary wmgDisableHTCP variable gerrit:607596 T250781 IS.php (duration: 01m 01s) [production]
18:20 <ppchelko@deploy1001> Synchronized wmf-config/CommonSettings.php: Disable HTCP purging everywhere gerrit:607593 T250781 CS.php (duration: 01m 03s) [production]
18:18 <ppchelko@deploy1001> Synchronized wmf-config/wikitech.php: Disable HTCP purging everywhere gerrit:607593 T250781 wikitech.php (duration: 01m 04s) [production]
18:17 <ppchelko@deploy1001> Synchronized wmf-config/reverse-proxy.php: Disable HTCP purging everywhere gerrit:607593 T250781 reverse-proxy.php (duration: 01m 04s) [production]
18:11 <ppchelko@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Add wgEventServiceDefault to refactor EventBus event stream config gerrit:610160 T229863, IS.php (duration: 01m 03s) [production]
18:04 <ppchelko@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Add wgEventServiceDefault to refactor EventBus event stream config gerrit:610160 T229863 (duration: 01m 04s) [production]
17:34 <elukey@cumin1001> END (FAIL) - Cookbook sre.hadoop.change-distro (exit_code=99) [production]
17:16 <elukey@cumin1001> START - Cookbook sre.hadoop.change-distro [production]
17:16 <elukey@cumin1001> END (PASS) - Cookbook sre.hadoop.stop-cluster (exit_code=0) [production]
17:08 <elukey@cumin1001> START - Cookbook sre.hadoop.stop-cluster [production]
16:57 <_joe_> restarting restbase across the fleet to transition to using envoy [production]
16:40 <_joe_> restarting restbase on restbase2010 to route calls to mediawiki, parsoid via envoy [production]
16:40 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:37 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
16:32 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:27 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
15:22 <jgleeson> updated fundraising-tools from a244e0e85f --> f5b8528214 [production]
15:16 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]