201-250 of 10000 results (65ms)
2019-07-10 §
09:22 <moritzm> rebooting acmechief2001 to pick up MDS-enabled qemu [production]
09:21 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:21 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
09:19 <moritzm> disabled puppet on hosts using acme_chief::cert for reboots of acmechief hosts [production]
08:16 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
08:16 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
08:06 <vgutierrez@cumin1001> START - Cookbook sre.ganeti.makevm [production]
08:06 <vgutierrez@cumin1001> START - Cookbook sre.ganeti.makevm [production]
05:41 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Fully repool db1079 after upgrade (duration: 00m 57s) [production]
05:32 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1079 after upgrade (duration: 00m 57s) [production]
05:17 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Slowly repool db1079 after upgrade (duration: 00m 58s) [production]
05:05 <marostegui> Upgrade db1079 [production]
05:05 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1079 for upgrade (duration: 00m 59s) [production]
2019-07-09 §
23:07 <jhuneidi@deploy1001> rebuilt and synchronized wikiversions files: group0 wikis to 1.34.0-wmf.13 refs T220738 [production]
23:06 <robh> updating power ports on T209101 and disabling ports not in used (only turning off one side and awaiting any icinga alerts for 15 minutes before touching other side of power) [production]
22:55 <krinkle@deploy1001> Synchronized php-1.34.0-wmf.13/extensions/AbuseFilter/includes/AbuseFilter.php: 0096dff3022 / T227613 (duration: 00m 57s) [production]
22:52 <krinkle@deploy1001> Synchronized php-1.34.0-wmf.13/extensions/SecurePoll/includes/pages/: c7d7a55b8e8d947234a9 / T227620 (duration: 00m 57s) [production]
22:09 <krinkle@deploy1001> Synchronized php-1.34.0-wmf.13/extensions/Collection/includes/CollectionProposals.php: T227407 / 69a30966c (duration: 00m 57s) [production]
21:53 <krinkle@deploy1001> Synchronized php-1.34.0-wmf.13/includes/libs/rdbms/: T226770 / 4c2a58589f2db (duration: 00m 59s) [production]
20:58 <jhuneidi@deploy1001> rebuilt and synchronized wikiversions files: Revert "group0 wikis to 1.34.0-wmf.11" [production]
20:37 <mutante> scb1001 - re-activate puppet, run puppet, stop pdfrender service, run puppet again (T226675) [production]
20:36 <mutante> scb2001 - sudo systemctl stop pdfrender (T226675) [production]
20:25 <mutante> temp disabling puppet on scb1001 - removing pdfrender classes from scb2001 [production]
20:23 <jhuneidi@deploy1001> rebuilt and synchronized wikiversions files: group0 wikis to 1.34.0-wmf.13 refs T220738 [production]
20:12 <jhuneidi@deploy1001> Finished scap: testwikis wikis to 1.34.0-wmf.13 (duration: 36m 39s) [production]
19:36 <jhuneidi@deploy1001> Started scap: testwikis wikis to 1.34.0-wmf.13 [production]
19:17 <XioNoX> enable samping on cr2-eqiad:border-in4 [production]
19:14 <XioNoX> replace netflow target on cr2-eqiad with netflow1001 [production]
18:19 <longma> cutting the branch for 1.34.0-wmf.13 T220738 [production]
17:32 <mholloway-shell@deploy1001> Finished deploy [mobileapps/deploy@2a9d097]: Fix etag generation for the talk endpoint, take 2 (duration: 02m 04s) [production]
17:30 <mholloway-shell@deploy1001> Started deploy [mobileapps/deploy@2a9d097]: Fix etag generation for the talk endpoint, take 2 [production]
17:30 <mholloway-shell@deploy1001> Finished deploy [mobileapps/deploy@2a9d097]: Fix etag generation for the talk endpoint (T227481) (duration: 03m 49s) [production]
17:26 <mholloway-shell@deploy1001> Started deploy [mobileapps/deploy@2a9d097]: Fix etag generation for the talk endpoint (T227481) [production]
16:59 <godog> reboot ms-be2039 with oemhp_powerreg=os - T225713 [production]
16:54 <godog> reboot ms-be2027 with oemhp_powerreg=os - T225713 [production]
16:42 <godog> reboot ms-be2026 with oemhp_powerreg=os - T225713 [production]
16:29 <godog> reboot ms-be2025 with oemhp_powerreg=os - T225713 [production]
15:44 <XioNoX> reject RPKI invalids on Ashburn peering links - T220669 [production]
15:38 <akosiaris> restart pybal on lvs2003, lvs1015. Removal of pdfrender service T226675 [production]
15:38 <XioNoX> reject RPKI invalids on Amsterdam peering link - T220669 [production]
15:33 <akosiaris> restart pybal on lvs2006, lvs1016. Removal of pdfrender service T226675 [production]
15:28 <XioNoX> reject RPKI invalids on Chicago peering link - T220669 [production]
15:27 <godog> reboot ms-be2024 with oemhp_powerreg=os - T225713 [production]
15:22 <godog> reboot ms-be2023 with oemhp_powerreg=os - T225713 [production]
15:20 <XioNoX> reject RPKI invalids on Singapore peering link - T220669 [production]
15:13 <XioNoX> reject RPKI invalids on Dallas peering link - T220669 [production]
15:03 <jeh> rebooting cloudnet1003.eqiad T224228 [production]
14:53 <gehel> repooled elastic2054 - T227298 [production]
14:50 <moritzm> installing orespoolcounter100[34] T227567 [production]
14:42 <XioNoX> reject RPKI invalids on ulsfo peering link - T220669 [production]