|
2018-10-11
§
|
| 07:43 |
<addshore> |
deploy https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/Wikibase/+/466031 to mwmaint1002 only (increasing tracking of wikidata dispatching) T205865 |
[production] |
| 07:36 |
<elukey> |
roll restart of aqs on aqs100[4-9] to pick up new Druid settings |
[production] |
| 06:00 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Increase db1092 weight (duration: 00m 49s) |
[production] |
| 05:43 |
<marostegui> |
Purge binary logs on pc2005 due to disk space issues - T206740 |
[production] |
| 05:29 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1109 (duration: 00m 48s) |
[production] |
| 05:24 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1109 (duration: 00m 51s) |
[production] |
| 02:25 |
<krinkle@deploy1001> |
Synchronized w/static.php: T127233 - Ic6acb70 (duration: 00m 49s) |
[production] |
| 02:10 |
<krinkle@deploy1001> |
Synchronized php-1.32.0-wmf.24/includes/page/WikiPage.php: T203942 - Ib211d98498f (duration: 00m 49s) |
[production] |
| 02:07 |
<krinkle@deploy1001> |
Synchronized php-1.32.0-wmf.24/tests/phpunit/includes/page/: Ib211d98498f (duration: 00m 49s) |
[production] |
| 01:38 |
<krinkle@deploy1001> |
Synchronized wmf-config/etcd.php: T176370 - I5e7e5d167d517 (duration: 00m 55s) |
[production] |
|
2018-10-10
§
|
| 23:08 |
<krinkle@deploy1001> |
Synchronized php-1.32.0-wmf.24/maintenance/resources/foreign-resources.yaml: Ic865e7077d (duration: 00m 49s) |
[production] |
| 22:59 |
<krinkle@deploy1001> |
Synchronized php-1.32.0-wmf.24/extensions/MultimediaViewer/: T206099 - I53dbce0a (duration: 00m 49s) |
[production] |
| 22:43 |
<krinkle@deploy1001> |
Synchronized php-1.32.0-wmf.24/includes/specials/SpecialDeletedContributions.php: T187619 - Ic6b0d8020553 (duration: 00m 48s) |
[production] |
| 22:41 |
<krinkle@deploy1001> |
Synchronized php-1.32.0-wmf.24/extensions/ORES/includes/FetchScoreJob.php: T204753 - Icc28230585bc (duration: 00m 49s) |
[production] |
| 22:25 |
<mutante> |
icinga1001 - chmod 2710 /var/lib/icinga/rw |
[production] |
| 22:16 |
<krinkle@deploy1001> |
Synchronized wmf-config/arclamp.php: T206092 - If607ad111a (duration: 00m 48s) |
[production] |
| 21:50 |
<krinkle@deploy1001> |
Synchronized php-1.32.0-wmf.24/extensions/ContentTranslation/specials/SpecialContentTranslation.php: T205433 - Ib34b28c5bb114c (duration: 00m 49s) |
[production] |
| 21:48 |
<krinkle@deploy1001> |
Synchronized php-1.32.0-wmf.24/extensions/Echo/includes/DiscussionParser.php: T204291 - Ia5323b401b94 (duration: 00m 51s) |
[production] |
| 21:45 |
<XioNoX> |
Add icinga1001 to mr* security policies - T206704 |
[production] |
| 20:34 |
<thcipriani> |
upgrading ci jenkins install on contint1001 |
[production] |
| 20:19 |
<thcipriani> |
upgrading releases-jenkins jenkins install on releases1001 |
[production] |
| 20:17 |
<thcipriani> |
upgrading releases-jenkins jenkins install on releases2001 |
[production] |
| 19:58 |
<mutante> |
icinga - enabled icinga service on icinga1001 (stretch), but all notifications are disabled |
[production] |
| 19:43 |
<mutante> |
awight restarted ORES celery workers on ores2003 (~17:00), ores200* (17:05) |
[production] |
| 19:39 |
<awight> |
restarted ORES celery workers on ores2003 (~17:00), ores200* (17:05) |
[production] |
| 19:35 |
<kaldari@deploy1001> |
Finished scap: (no justification provided) (duration: 22m 05s) |
[production] |
| 19:13 |
<kaldari@deploy1001> |
Started scap: (no justification provided) |
[production] |
| 19:11 |
<kaldari> |
scap sync to rebuild i18n cache |
[production] |
| 18:35 |
<XioNoX> |
disable VC port 1/2 on asw2-c-eqiad:fpc3 (to fpc8) |
[production] |
| 18:20 |
<otto@deploy1001> |
Finished deploy [analytics/refinery@28bbee8]: Add accept header to webrequest logs - T170606 (duration: 10m 34s) |
[production] |
| 18:19 |
<XioNoX> |
delete sessions to AS6805 on cr2-esams (left AMS-IX) |
[production] |
| 18:10 |
<otto@deploy1001> |
Started deploy [analytics/refinery@28bbee8]: Add accept header to webrequest logs - T170606 |
[production] |
| 18:09 |
<otto@deploy1001> |
Finished deploy [analytics/refinery@4e2d956]: Add accept header to webrequest logs - T170606 (duration: 04m 35s) |
[production] |
| 18:05 |
<otto@deploy1001> |
Started deploy [analytics/refinery@4e2d956]: Add accept header to webrequest logs - T170606 |
[production] |
| 17:49 |
<XioNoX> |
replace 10.195.0.0/25 with 10.195.0.0/24 in prefix-list fundraising-codfw4 on cr1/2-codfw - T206637 |
[production] |
| 16:25 |
<mutante> |
LDAP - added isaacj to wmf group (for SWAP access, existing shell user since recently) (T206631) (T205840) |
[production] |
| 16:16 |
<_joe_> |
restart of now-unused jobqueue redises for stopping the alerts post-switchover |
[production] |
| 16:09 |
<ejegg> |
updated CiviCRM from 1165e7ed79 to 4cc21d61c5 |
[production] |
| 15:59 |
<vgutierrez> |
Uploaded certcentral 0.1 to apt.wikimedia.org (stretch) - T199711 |
[production] |
| 15:55 |
<cmjohnson1> |
scheduled downtime for host cloudvirt1019 swap raid card T196507 |
[production] |
| 15:35 |
<moritzm> |
uploaded jenkins 2.138.2 security release to apt.wikimedia.org (jessie/stretch) (T206234) |
[production] |
| 15:11 |
<_joe_> |
started again hhvm on mwmaint2001 |
[production] |
| 14:51 |
<ejegg> |
turned fundraising scheduled jobs back on |
[production] |
| 14:43 |
<ejegg> |
turned off fundraising scheduled jobs |
[production] |
| 14:42 |
<END> |
(PASS) - Cookbook sre.switchdc.mediawiki.08-restore-ttl (exit_code=0) (volans@neodymium) |
[production] |
| 14:42 |
<START> |
- Cookbook sre.switchdc.mediawiki.08-restore-ttl (volans@neodymium) |
[production] |
| 14:42 |
<END> |
(FAIL) - Cookbook sre.switchdc.mediawiki.08-start-maintenance (exit_code=99) (volans@neodymium) |
[production] |
| 14:40 |
<START> |
- Cookbook sre.switchdc.mediawiki.08-start-maintenance (volans@neodymium) |
[production] |
| 14:39 |
<END> |
(FAIL) - Cookbook sre.switchdc.mediawiki.08-start-maintenance (exit_code=99) (volans@neodymium) |
[production] |
| 14:38 |
<START> |
- Cookbook sre.switchdc.mediawiki.08-start-maintenance (volans@neodymium) |
[production] |