|
2016-05-10
§
|
| 09:44 |
<moritzm> |
rolling restart of swift backend servers in codfw and eqiad |
[production] |
| 09:32 |
<moritzm> |
powercycling ms-be2016, unresponsive and serial console is dead |
[production] |
| 09:06 |
<moritzm> |
restarting etherpad-lite on etherpad1001 for openssl update |
[production] |
| 08:56 |
<moritzm> |
restarting exim on fermium/lists.wikimedia.org for openssl update |
[production] |
| 08:52 |
<moritzm> |
restarting tor on radium for openssl update |
[production] |
| 08:29 |
<godog> |
bootstrap restbase2007-b T132976 |
[production] |
| 06:33 |
<mobrovac> |
restbase deploy end of 1c890c4 |
[production] |
| 06:24 |
<mobrovac> |
restbase deploy start of 1c890c4 |
[production] |
| 02:33 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Tue May 10 02:33:17 UTC 2016 (duration 8m 57s) |
[production] |
| 02:24 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.23) (duration: 09m 23s) |
[production] |
|
2016-05-09
§
|
| 23:15 |
<demon@tin> |
Synchronized wmf-config/InitialiseSettings.php: nowiki flow beta (duration: 00m 26s) |
[production] |
| 23:12 |
<demon@tin> |
Synchronized wmf-config/: Obsolete graph settings (duration: 00m 29s) |
[production] |
| 23:08 |
<demon@tin> |
Synchronized wmf-config/mobile.php: Enable $wgMFStripResponsiveImages (duration: 00m 27s) |
[production] |
| 23:04 |
<demon@tin> |
Synchronized wmf-config/InitialiseSettings.php: lazy load images in MF for bnwiki (duration: 00m 26s) |
[production] |
| 22:14 |
<gehel> |
restarting elasticsearch on elastic1026 (high load) |
[production] |
| 21:56 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: pedias back to wmf.23 |
[production] |
| 21:42 |
<mutante> |
argon - scheduling eternal downtime, shut down | https://en.wiktionary.org/wiki/good_riddance#Etymology |
[production] |
| 21:37 |
<mutante> |
argon - revoke puppet cert, stop salt |
[production] |
| 21:04 |
<chasemp> |
clean out old snapshots on labstore1001 |
[production] |
| 20:58 |
<mdholloway> |
mobileapps deployed f206e94 |
[production] |
| 20:36 |
<mdholloway> |
starting mobileapps deployment |
[production] |
| 20:29 |
<gehel> |
restarting logstash server logstash100[26].eqiad.wmnet (T110236) |
[production] |
| 20:26 |
<gehel> |
restarting logstash server logstash1001.eqiad.wmnet (T110236)upgrade |
[production] |
| 19:58 |
<demon@tin> |
Synchronized php-1.27.0-wmf.22/extensions/NavigationTiming/: backport firstPaintTime fix (duration: 00m 33s) |
[production] |
| 18:41 |
<mutante> |
irc.wm.org - before restarting ircd on old, ~ 199 users on new, after: ~ 293 users on new |
[production] |
| 18:37 |
<mutante> |
argon - restarting ircd (this is the old server) |
[production] |
| 17:37 |
<elukey> |
camus+puppet re-enabled on analytics1027 after maintenance |
[production] |
| 17:30 |
<elukey> |
analytics1002 Yarn+HDFS masters failed over to analytics1001 for Java upgrades (restored original state) |
[production] |
| 17:22 |
<elukey> |
analytics1001 Yarn+HDFS masters failed over to analytics1002 for Java upgrades |
[production] |
| 17:07 |
<elukey> |
executed authdns-update on ns0.w.o to introduce new aqs records |
[production] |
| 17:05 |
<gehel> |
cluster restart completed for eqiad / codfw elasticsearch (T110236)$ |
[production] |
| 16:34 |
<gehel> |
restarting elasticsearch server elastic1031.eqiad.wmnet (T110236), includes JDK upgrade |
[production] |
| 16:12 |
<gehel> |
restarting elasticsearch server elastic1030.eqiad.wmnet (T110236), includes JDK upgrade |
[production] |
| 15:51 |
<elukey> |
disabled camus+puppet on analytics1027 as prep step for maintenance on the cluster. |
[production] |
| 15:41 |
<gehel> |
restarting elasticsearch server elastic1029.eqiad.wmnet (T110236), includes JDK upgrade |
[production] |
| 15:37 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Add museudaimigracao.org.br to wgCopyUploadsDomains [[gerrit:287636]] (duration: 00m 32s) |
[production] |
| 15:30 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Add National Digital Library of Brazil domains to wgCopyUploadsDomains [[gerrit:287635]] (duration: 00m 27s) |
[production] |
| 15:01 |
<jynus> |
turning off es2001-es2010 |
[production] |
| 14:51 |
<hashar> |
Zuul went deadlock. Restarted |
[production] |
| 14:32 |
<gehel> |
restarting elasticsearch server elastic1028.eqiad.wmnet (T110236), includes JDK upgrade |
[production] |
| 14:30 |
<gehel> |
restarting cassandra.metrics-collector on maps-test200[1234] (T134514) - correction |
[production] |
| 14:29 |
<gehel> |
restarting cassandra on maps-test200[1234] (T134514) |
[production] |
| 14:23 |
<elukey> |
restarting hadoop java daemons for Java upgrades on analytics104X and analytics105X hosts |
[production] |
| 14:09 |
<elukey> |
memcached restarted on mc1009 with only slab_reassign set (T129963) |
[production] |
| 14:06 |
<gehel> |
restarting elasticsearch server elastic1027.eqiad.wmnet (T110236), includes JDK upgrade |
[production] |
| 13:37 |
<gehel> |
restarting elasticsearch server elastic1026.eqiad.wmnet (T110236), includes JDK upgrade |
[production] |
| 13:27 |
<moritzm> |
restarting salt-master on neodymium to pick up openssl update |
[production] |
| 13:14 |
<gehel> |
restarting elasticsearch server elastic1025.eqiad.wmnet (T110236), includes JDK upgrade |
[production] |
| 13:12 |
<elukey> |
restarting hadoop java daemons for Java upgrades on analytics102X and analytics 103X hosts |
[production] |
| 13:07 |
<moritzm> |
restarting nginx on carbon/apt.wikimedia.org to pick up openssl update |
[production] |