3401-3450 of 10000 results (56ms)
2018-08-17 §
09:03 <gehel> depool wdqs2003 to catch up on updates [production]
08:29 <jynus> stopping db2073 for upgrade [production]
08:13 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1097 (duration: 00m 54s) [production]
08:06 <gehel> silencing systemd check as mjolnir is flapping [production]
07:59 <gehel> restarting mjolnir on all elastic / cirrus nodes [production]
07:42 <jynus> stopping db2085 for upgrade [production]
07:41 <moritzm> rebooting mw2220-mw2242 for kernel security update (also bundling wikidiff and apache updates) [production]
00:42 <krinkle@deploy1001> Synchronized wmf-config/: rm StartProfiler.php / Ia83751695f35def / T201782 (duration: 00m 50s) [production]
00:39 <krinkle@deploy1001> Synchronized docroot/noc/: Ia83751695f35def (duration: 00m 50s) [production]
2018-08-16 §
23:41 <ejegg> re-activated CiviCRM scheduled jobs [production]
23:34 <catrope@deploy1001> Synchronized php-1.32.0-wmf.16/skins/MinervaNeue/resources/skins.minerva.content.styles.images/magnifying-glass.svg: Correct MinervaNeue search icon (T199000) (duration: 00m 51s) [production]
23:18 <ejegg> disabled CiviCRM scheduled jobs for version upgrade [production]
23:15 <eileen> civicrm revision changed from b60ceb3d2f to 3f6dd6c9a6, config revision is 74ae910b0e [production]
22:32 <XioNoX> re-activating BGP sessions between cr1/2-ulsfo and the office's router2 [production]
22:25 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@e70f9d5]: retry git fat init fail (duration: 00m 14s) [production]
22:24 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@e70f9d5]: retry git fat init fail [production]
22:24 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@e70f9d5]: dont override the spark sharelib (duration: 00m 11s) [production]
22:24 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@e70f9d5]: dont override the spark sharelib [production]
21:56 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@651904b]: use spark 2.3.0, oozie still doesnt like 2.3.1 (duration: 00m 16s) [production]
21:56 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@651904b]: use spark 2.3.0, oozie still doesnt like 2.3.1 [production]
21:56 <ebernhardson@deploy1001> deploy aborted: try again after git-fat init fail (duration: 00m 01s) [production]
21:55 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@5731563]: try again after git-fat init fail [production]
21:51 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@5731563]: try again after git-fat init fail (duration: 00m 18s) [production]
21:50 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@5731563]: try again after git-fat init fail [production]
21:46 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@5731563]: point oozie sharelib at spark2.3.0 (duration: 04m 56s) [production]
21:44 <mutante> rebooting cobalt (gerrit.wikimedia.org) for kernel upgrade [production]
21:41 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@5731563]: point oozie sharelib at spark2.3.0 [production]
21:39 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@5731563]: point oozie sharelib at spark2.3.0 (duration: 00m 14s) [production]
21:39 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@5731563]: point oozie sharelib at spark2.3.0 [production]
21:29 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@5731563]: point oozie sharelib at spark2.3.1 (duration: 00m 18s) [production]
21:28 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@5731563]: point oozie sharelib at spark2.3.1 [production]
21:23 <thcipriani> contint1001 - installing jenkins upgrade [production]
21:08 <mutante> contint2001 - installing jenkins upgrade [production]
21:05 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@76dddd2]: debug git-fat initialization fail (duration: 00m 16s) [production]
21:04 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@76dddd2]: debug git-fat initialization fail [production]
21:01 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@76dddd2]: debug git-fat initialization fail (duration: 00m 06s) [production]
21:01 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@76dddd2]: debug git-fat initialization fail [production]
21:00 <mutante> releases1001 - installing package upgrade like on releases2001 before, scheduling downtime, reboot [production]
20:53 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@76dddd2]: (no justification provided) (duration: 00m 02s) [production]
20:53 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@76dddd2]: (no justification provided) [production]
20:50 <mutante> releases2001 - rebooting [production]
20:48 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@76dddd2]: point transfer_to_es at spark 2.x (duration: 00m 46s) [production]
20:48 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@76dddd2]: point transfer_to_es at spark 2.x [production]
20:47 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@76dddd2]: point transfer_to_es at spark 2.x (duration: 01m 33s) [production]
20:46 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@76dddd2]: point transfer_to_es at spark 2.x [production]
20:38 <mutante> releases2001: upgrading openjdk, systemd, jenkins [production]
20:33 <mutante> releases1001/2001: upgrading apache2 packages [production]
20:26 <mutante> gerrit2001 - scheduled downtime, rebooting [production]
19:54 <mutante> phab1002 closing idle root screen that was used for rsyncing repos [production]
19:15 <thcipriani> clearing gerrit accounts cache [production]