|
2018-08-17
§
|
| 16:24 |
<gehel> |
disabling systemd state check for elastic eqiad until T202120 is fixed |
[production] |
| 14:38 |
<moritzm> |
rebooting elnath for some kernel tests |
[production] |
| 13:02 |
<jynus> |
stopping db2084 for upgrade |
[production] |
| 12:49 |
<imarlier@deploy1001> |
Finished deploy [performance/coal@aff3793]: (no justification provided) (duration: 01m 06s) |
[production] |
| 12:48 |
<imarlier@deploy1001> |
Started deploy [performance/coal@aff3793]: (no justification provided) |
[production] |
| 12:46 |
<gehel> |
rebooting relforge for JVM and kernel upgrade |
[production] |
| 12:36 |
<moritzm> |
installing openjdk-8 security updates on elastic* in codfw (eqiad already has it via the recent reimage to stretch) |
[production] |
| 12:30 |
<jynus@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1097 (duration: 00m 53s) |
[production] |
| 12:07 |
<gehel> |
repooling wdqs2003, catched up on updates |
[production] |
| 10:58 |
<moritzm> |
rebooting mw2152-mw2162 for kernel security update (also bundling wikidiff and apache updates) |
[production] |
| 10:35 |
<moritzm> |
powercycling mw2286 |
[production] |
| 09:47 |
<moritzm> |
rebooting mw2243-mw2290 for kernel security update (also bundling wikidiff and apache updates) |
[production] |
| 09:03 |
<gehel> |
depool wdqs2003 to catch up on updates |
[production] |
| 08:29 |
<jynus> |
stopping db2073 for upgrade |
[production] |
| 08:13 |
<jynus@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1097 (duration: 00m 54s) |
[production] |
| 08:06 |
<gehel> |
silencing systemd check as mjolnir is flapping |
[production] |
| 07:59 |
<gehel> |
restarting mjolnir on all elastic / cirrus nodes |
[production] |
| 07:42 |
<jynus> |
stopping db2085 for upgrade |
[production] |
| 07:41 |
<moritzm> |
rebooting mw2220-mw2242 for kernel security update (also bundling wikidiff and apache updates) |
[production] |
| 00:42 |
<krinkle@deploy1001> |
Synchronized wmf-config/: rm StartProfiler.php / Ia83751695f35def / T201782 (duration: 00m 50s) |
[production] |
| 00:39 |
<krinkle@deploy1001> |
Synchronized docroot/noc/: Ia83751695f35def (duration: 00m 50s) |
[production] |
|
2018-08-16
§
|
| 23:41 |
<ejegg> |
re-activated CiviCRM scheduled jobs |
[production] |
| 23:34 |
<catrope@deploy1001> |
Synchronized php-1.32.0-wmf.16/skins/MinervaNeue/resources/skins.minerva.content.styles.images/magnifying-glass.svg: Correct MinervaNeue search icon (T199000) (duration: 00m 51s) |
[production] |
| 23:18 |
<ejegg> |
disabled CiviCRM scheduled jobs for version upgrade |
[production] |
| 23:15 |
<eileen> |
civicrm revision changed from b60ceb3d2f to 3f6dd6c9a6, config revision is 74ae910b0e |
[production] |
| 22:32 |
<XioNoX> |
re-activating BGP sessions between cr1/2-ulsfo and the office's router2 |
[production] |
| 22:25 |
<ebernhardson@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@e70f9d5]: retry git fat init fail (duration: 00m 14s) |
[production] |
| 22:24 |
<ebernhardson@deploy1001> |
Started deploy [wikimedia/discovery/analytics@e70f9d5]: retry git fat init fail |
[production] |
| 22:24 |
<ebernhardson@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@e70f9d5]: dont override the spark sharelib (duration: 00m 11s) |
[production] |
| 22:24 |
<ebernhardson@deploy1001> |
Started deploy [wikimedia/discovery/analytics@e70f9d5]: dont override the spark sharelib |
[production] |
| 21:56 |
<ebernhardson@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@651904b]: use spark 2.3.0, oozie still doesnt like 2.3.1 (duration: 00m 16s) |
[production] |
| 21:56 |
<ebernhardson@deploy1001> |
Started deploy [wikimedia/discovery/analytics@651904b]: use spark 2.3.0, oozie still doesnt like 2.3.1 |
[production] |
| 21:56 |
<ebernhardson@deploy1001> |
deploy aborted: try again after git-fat init fail (duration: 00m 01s) |
[production] |
| 21:55 |
<ebernhardson@deploy1001> |
Started deploy [wikimedia/discovery/analytics@5731563]: try again after git-fat init fail |
[production] |
| 21:51 |
<ebernhardson@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@5731563]: try again after git-fat init fail (duration: 00m 18s) |
[production] |
| 21:50 |
<ebernhardson@deploy1001> |
Started deploy [wikimedia/discovery/analytics@5731563]: try again after git-fat init fail |
[production] |
| 21:46 |
<ebernhardson@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@5731563]: point oozie sharelib at spark2.3.0 (duration: 04m 56s) |
[production] |
| 21:44 |
<mutante> |
rebooting cobalt (gerrit.wikimedia.org) for kernel upgrade |
[production] |
| 21:41 |
<ebernhardson@deploy1001> |
Started deploy [wikimedia/discovery/analytics@5731563]: point oozie sharelib at spark2.3.0 |
[production] |
| 21:39 |
<ebernhardson@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@5731563]: point oozie sharelib at spark2.3.0 (duration: 00m 14s) |
[production] |
| 21:39 |
<ebernhardson@deploy1001> |
Started deploy [wikimedia/discovery/analytics@5731563]: point oozie sharelib at spark2.3.0 |
[production] |
| 21:29 |
<ebernhardson@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@5731563]: point oozie sharelib at spark2.3.1 (duration: 00m 18s) |
[production] |
| 21:28 |
<ebernhardson@deploy1001> |
Started deploy [wikimedia/discovery/analytics@5731563]: point oozie sharelib at spark2.3.1 |
[production] |
| 21:23 |
<thcipriani> |
contint1001 - installing jenkins upgrade |
[production] |
| 21:08 |
<mutante> |
contint2001 - installing jenkins upgrade |
[production] |
| 21:05 |
<ebernhardson@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@76dddd2]: debug git-fat initialization fail (duration: 00m 16s) |
[production] |
| 21:04 |
<ebernhardson@deploy1001> |
Started deploy [wikimedia/discovery/analytics@76dddd2]: debug git-fat initialization fail |
[production] |
| 21:01 |
<ebernhardson@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@76dddd2]: debug git-fat initialization fail (duration: 00m 06s) |
[production] |
| 21:01 |
<ebernhardson@deploy1001> |
Started deploy [wikimedia/discovery/analytics@76dddd2]: debug git-fat initialization fail |
[production] |
| 21:00 |
<mutante> |
releases1001 - installing package upgrade like on releases2001 before, scheduling downtime, reboot |
[production] |