1101-1150 of 10000 results (60ms)
2019-07-10 §
13:22 <godog> reset ilo on ms-be2022 - bios can't talk to it on boot [production]
12:49 <godog> reboot ms-be2022 - T225713 [production]
11:53 <Urbanecm> Purged 14 urls for T211413 [production]
11:51 <Urbanecm> Purged 24 urls for T227635 [production]
11:11 <Urbanecm> EU SWAT done [production]
11:11 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: Remove autopromote to patroller on testwiki (T168718) (duration: 00m 58s) [production]
11:10 <urbanecm@deploy1001> Synchronized static/images/project-logos/: SWAT: Several logo changes (T227635 T211413) (duration: 01m 00s) [production]
11:09 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: Remove fawikiquote HD logo (T211413) (duration: 00m 57s) [production]
11:07 <urbanecm@deploy1001> sync-file aborted: SWAT: Several logo changes (T227635 T211413) (duration: 00m 20s) [production]
11:06 <urbanecm@deploy1001> Synchronized docroot/noc/conf/highlight.php: SWAT: [[:gerrit:521576|Fix non-working "raw text" links on noc.wikimedia.org web pages]] (T227606) (duration: 01m 02s) [production]
09:57 <moritzm> re-enabled puppet on hosts using acme_chief::cert for reboots of acmechief hosts (actually did that 20 minutes ago, but missed to log earlier) [production]
09:54 <jynus> disabling puppet on prometheus* hosts for upcoming deploy [production]
09:38 <fsero> doing the same on ms-be1030 [production]
09:37 <fsero> docker-registry: running manual only once swift-container-sync on ms-be2019 [production]
09:36 <moritzm> rearmed keyholder on acmechief1001 [production]
09:29 <moritzm> rebooting acmechief1001 to pick up MDS-enabled qemu [production]
09:25 <moritzm> rearmed keyholder on acmechief2001 [production]
09:22 <moritzm> rebooting acmechief2001 to pick up MDS-enabled qemu [production]
09:21 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:21 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
09:19 <moritzm> disabled puppet on hosts using acme_chief::cert for reboots of acmechief hosts [production]
08:16 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
08:16 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
08:06 <vgutierrez@cumin1001> START - Cookbook sre.ganeti.makevm [production]
08:06 <vgutierrez@cumin1001> START - Cookbook sre.ganeti.makevm [production]
05:41 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Fully repool db1079 after upgrade (duration: 00m 57s) [production]
05:32 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1079 after upgrade (duration: 00m 57s) [production]
05:17 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Slowly repool db1079 after upgrade (duration: 00m 58s) [production]
05:05 <marostegui> Upgrade db1079 [production]
05:05 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1079 for upgrade (duration: 00m 59s) [production]
2019-07-09 §
23:07 <jhuneidi@deploy1001> rebuilt and synchronized wikiversions files: group0 wikis to 1.34.0-wmf.13 refs T220738 [production]
23:06 <robh> updating power ports on T209101 and disabling ports not in used (only turning off one side and awaiting any icinga alerts for 15 minutes before touching other side of power) [production]
22:55 <krinkle@deploy1001> Synchronized php-1.34.0-wmf.13/extensions/AbuseFilter/includes/AbuseFilter.php: 0096dff3022 / T227613 (duration: 00m 57s) [production]
22:52 <krinkle@deploy1001> Synchronized php-1.34.0-wmf.13/extensions/SecurePoll/includes/pages/: c7d7a55b8e8d947234a9 / T227620 (duration: 00m 57s) [production]
22:09 <krinkle@deploy1001> Synchronized php-1.34.0-wmf.13/extensions/Collection/includes/CollectionProposals.php: T227407 / 69a30966c (duration: 00m 57s) [production]
21:53 <krinkle@deploy1001> Synchronized php-1.34.0-wmf.13/includes/libs/rdbms/: T226770 / 4c2a58589f2db (duration: 00m 59s) [production]
20:58 <jhuneidi@deploy1001> rebuilt and synchronized wikiversions files: Revert "group0 wikis to 1.34.0-wmf.11" [production]
20:37 <mutante> scb1001 - re-activate puppet, run puppet, stop pdfrender service, run puppet again (T226675) [production]
20:36 <mutante> scb2001 - sudo systemctl stop pdfrender (T226675) [production]
20:25 <mutante> temp disabling puppet on scb1001 - removing pdfrender classes from scb2001 [production]
20:23 <jhuneidi@deploy1001> rebuilt and synchronized wikiversions files: group0 wikis to 1.34.0-wmf.13 refs T220738 [production]
20:12 <jhuneidi@deploy1001> Finished scap: testwikis wikis to 1.34.0-wmf.13 (duration: 36m 39s) [production]
19:36 <jhuneidi@deploy1001> Started scap: testwikis wikis to 1.34.0-wmf.13 [production]
19:17 <XioNoX> enable samping on cr2-eqiad:border-in4 [production]
19:14 <XioNoX> replace netflow target on cr2-eqiad with netflow1001 [production]
18:19 <longma> cutting the branch for 1.34.0-wmf.13 T220738 [production]
17:32 <mholloway-shell@deploy1001> Finished deploy [mobileapps/deploy@2a9d097]: Fix etag generation for the talk endpoint, take 2 (duration: 02m 04s) [production]
17:30 <mholloway-shell@deploy1001> Started deploy [mobileapps/deploy@2a9d097]: Fix etag generation for the talk endpoint, take 2 [production]
17:30 <mholloway-shell@deploy1001> Finished deploy [mobileapps/deploy@2a9d097]: Fix etag generation for the talk endpoint (T227481) (duration: 03m 49s) [production]
17:26 <mholloway-shell@deploy1001> Started deploy [mobileapps/deploy@2a9d097]: Fix etag generation for the talk endpoint (T227481) [production]