8151-8200 of 10000 results (86ms)
2019-07-10 §
15:23 <ema> cp-ulsfo: upgrade varnish to 5.1.3-1wm11 T227672 [production]
15:08 <ema> restart wb2-phab wikibugs job [production]
14:51 <ema> upload varnish 5.1.3-1wm11 to stretch-wikimedia T227672 [production]
14:42 <godog> reimage ms-be2022 - T227667 [production]
14:03 <jbond42> copy puppetdb-termini 4.4.0-1~wmf2 from stretch-wikimedia to jessie-wikimedia [production]
13:47 <ema> cp hosts: cleanup WP zero leftovers T213769 [production]
13:22 <godog> reset ilo on ms-be2022 - bios can't talk to it on boot [production]
12:49 <godog> reboot ms-be2022 - T225713 [production]
11:53 <Urbanecm> Purged 14 urls for T211413 [production]
11:51 <Urbanecm> Purged 24 urls for T227635 [production]
11:11 <Urbanecm> EU SWAT done [production]
11:11 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: Remove autopromote to patroller on testwiki (T168718) (duration: 00m 58s) [production]
11:10 <urbanecm@deploy1001> Synchronized static/images/project-logos/: SWAT: Several logo changes (T227635 T211413) (duration: 01m 00s) [production]
11:09 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: Remove fawikiquote HD logo (T211413) (duration: 00m 57s) [production]
11:07 <urbanecm@deploy1001> sync-file aborted: SWAT: Several logo changes (T227635 T211413) (duration: 00m 20s) [production]
11:06 <urbanecm@deploy1001> Synchronized docroot/noc/conf/highlight.php: SWAT: [[:gerrit:521576|Fix non-working "raw text" links on noc.wikimedia.org web pages]] (T227606) (duration: 01m 02s) [production]
09:57 <moritzm> re-enabled puppet on hosts using acme_chief::cert for reboots of acmechief hosts (actually did that 20 minutes ago, but missed to log earlier) [production]
09:54 <jynus> disabling puppet on prometheus* hosts for upcoming deploy [production]
09:38 <fsero> doing the same on ms-be1030 [production]
09:37 <fsero> docker-registry: running manual only once swift-container-sync on ms-be2019 [production]
09:36 <moritzm> rearmed keyholder on acmechief1001 [production]
09:29 <moritzm> rebooting acmechief1001 to pick up MDS-enabled qemu [production]
09:25 <moritzm> rearmed keyholder on acmechief2001 [production]
09:22 <moritzm> rebooting acmechief2001 to pick up MDS-enabled qemu [production]
09:21 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:21 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
09:19 <moritzm> disabled puppet on hosts using acme_chief::cert for reboots of acmechief hosts [production]
08:16 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
08:16 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
08:06 <vgutierrez@cumin1001> START - Cookbook sre.ganeti.makevm [production]
08:06 <vgutierrez@cumin1001> START - Cookbook sre.ganeti.makevm [production]
05:41 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Fully repool db1079 after upgrade (duration: 00m 57s) [production]
05:32 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1079 after upgrade (duration: 00m 57s) [production]
05:17 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Slowly repool db1079 after upgrade (duration: 00m 58s) [production]
05:05 <marostegui> Upgrade db1079 [production]
05:05 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1079 for upgrade (duration: 00m 59s) [production]
2019-07-09 §
23:07 <jhuneidi@deploy1001> rebuilt and synchronized wikiversions files: group0 wikis to 1.34.0-wmf.13 refs T220738 [production]
23:06 <robh> updating power ports on T209101 and disabling ports not in used (only turning off one side and awaiting any icinga alerts for 15 minutes before touching other side of power) [production]
22:55 <krinkle@deploy1001> Synchronized php-1.34.0-wmf.13/extensions/AbuseFilter/includes/AbuseFilter.php: 0096dff3022 / T227613 (duration: 00m 57s) [production]
22:52 <krinkle@deploy1001> Synchronized php-1.34.0-wmf.13/extensions/SecurePoll/includes/pages/: c7d7a55b8e8d947234a9 / T227620 (duration: 00m 57s) [production]
22:09 <krinkle@deploy1001> Synchronized php-1.34.0-wmf.13/extensions/Collection/includes/CollectionProposals.php: T227407 / 69a30966c (duration: 00m 57s) [production]
21:53 <krinkle@deploy1001> Synchronized php-1.34.0-wmf.13/includes/libs/rdbms/: T226770 / 4c2a58589f2db (duration: 00m 59s) [production]
20:58 <jhuneidi@deploy1001> rebuilt and synchronized wikiversions files: Revert "group0 wikis to 1.34.0-wmf.11" [production]
20:37 <mutante> scb1001 - re-activate puppet, run puppet, stop pdfrender service, run puppet again (T226675) [production]
20:36 <mutante> scb2001 - sudo systemctl stop pdfrender (T226675) [production]
20:25 <mutante> temp disabling puppet on scb1001 - removing pdfrender classes from scb2001 [production]
20:23 <jhuneidi@deploy1001> rebuilt and synchronized wikiversions files: group0 wikis to 1.34.0-wmf.13 refs T220738 [production]
20:12 <jhuneidi@deploy1001> Finished scap: testwikis wikis to 1.34.0-wmf.13 (duration: 36m 39s) [production]
19:36 <jhuneidi@deploy1001> Started scap: testwikis wikis to 1.34.0-wmf.13 [production]
19:17 <XioNoX> enable samping on cr2-eqiad:border-in4 [production]