|
2014-12-05
§
|
| 03:30 |
<springle> |
Synchronized wmf-config/db-eqiad.php: repool db1060, warm up (duration: 00m 06s) |
[production] |
| 02:55 |
<springle> |
upgrade db1060 trusty |
[production] |
| 02:35 |
<springle> |
manual sync-common on mw1203 (after apparently transient sync-file network error on tin) |
[production] |
| 02:26 |
<springle> |
Synchronized wmf-config/db-eqiad.php: depool db1060 (duration: 00m 08s) |
[production] |
| 02:21 |
<LocalisationUpdate> |
completed (1.25wmf11) at 2014-12-05 02:20:57+00:00 |
[production] |
| 02:20 |
<l10nupdate> |
Synchronized php-1.25wmf11/cache/l10n: (no message) (duration: 00m 01s) |
[production] |
| 02:16 |
<LocalisationUpdate> |
completed (1.25wmf10) at 2014-12-05 02:16:49+00:00 |
[production] |
| 02:16 |
<l10nupdate> |
Synchronized php-1.25wmf10/cache/l10n: (no message) (duration: 00m 01s) |
[production] |
| 02:01 |
<awight> |
Synchronized php-1.25wmf11/extensions/CentralNotice: rollback Googlebot cloaking (duration: 00m 08s) |
[production] |
| 02:01 |
<awight> |
Synchronized php-1.25wmf10/extensions/CentralNotice: rollback Googlebot cloaking (duration: 00m 05s) |
[production] |
| 01:31 |
<awight> |
Synchronized php-1.25wmf10/extensions/CentralNotice: rollback CentralNotice 'improvement' (duration: 00m 05s) |
[production] |
| 01:31 |
<awight> |
Synchronized php-1.25wmf11/extensions/CentralNotice: rollback CentralNotice 'improvement' (duration: 00m 09s) |
[production] |
| 00:42 |
<maxsem> |
Synchronized search-redirect.php: Second attempt (duration: 00m 05s) |
[production] |
| 00:42 |
<maxsem> |
Synchronized search-redirect.php: https://gerrit.wikimedia.org/r/#/c/177665/ (duration: 00m 06s) |
[production] |
| 00:35 |
<maxsem> |
Synchronized wmf-config/: https://gerrit.wikimedia.org/r/#/c/177708/ (duration: 00m 07s) |
[production] |
| 00:32 |
<maxsem> |
Synchronized wmf-config/: https://gerrit.wikimedia.org/r/#/c/177600/ (duration: 00m 06s) |
[production] |
| 00:28 |
<maxsem> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/173083/ (duration: 00m 05s) |
[production] |
| 00:22 |
<maxsem> |
Synchronized wmf-config/: https://gerrit.wikimedia.org/r/#/c/177660/ (duration: 00m 06s) |
[production] |
| 00:17 |
<maxsem> |
Synchronized wmf-config/: https://gerrit.wikimedia.org/r/#/c/177494/ (duration: 00m 07s) |
[production] |
| 00:09 |
<maxsem> |
Synchronized php-1.25wmf10/extensions/Wikidata/: https://gerrit.wikimedia.org/r/#q,177693,n,z (duration: 00m 11s) |
[production] |
| 00:09 |
<maxsem> |
Synchronized php-1.25wmf11/extensions/Wikidata/: https://gerrit.wikimedia.org/r/#q,177693,n,z (duration: 00m 14s) |
[production] |
| 00:04 |
<maxsem> |
Synchronized php-1.25wmf11/extensions/VisualEditor/: https://gerrit.wikimedia.org/r/#q,177643,n,z (duration: 00m 07s) |
[production] |
|
2014-12-04
§
|
| 22:36 |
<awight> |
Synchronized php-1.25wmf11/extensions/CentralNotice: push CentralNotice features (duration: 00m 06s) |
[production] |
| 22:35 |
<awight> |
Synchronized php-1.25wmf10/extensions/CentralNotice: push CentralNotice features (duration: 00m 08s) |
[production] |
| 22:01 |
<YuviPanda> |
nodejs sucks. |
[production] |
| 21:36 |
<awight> |
Synchronized wmf-config: Shortening CentralNotice close box to 1 week (duration: 00m 07s) |
[production] |
| 21:16 |
<awight> |
pushed CentralNotice fixes to hide from Google |
[production] |
| 21:16 |
<awight> |
Synchronized php-1.25wmf11/extensions/CentralNotice: Hide CentralNotice banners from Google (duration: 00m 07s) |
[production] |
| 21:16 |
<awight> |
Synchronized php-1.25wmf10/extensions/CentralNotice: Hide CentralNotice banners from Google (duration: 00m 06s) |
[production] |
| 21:08 |
<ori> |
restarted ganglia-monitor on mw1081 |
[production] |
| 20:56 |
<legoktm> |
removeInvalidEmails.php finished, removed a total of 218,598 emails |
[production] |
| 20:17 |
<awight> |
Synchronized robots.txt: Disallow banner stuff in robots.txt (duration: 00m 07s) |
[production] |
| 19:16 |
<legoktm> |
running removeInvalidEmails.php across all wikis |
[production] |
| 18:57 |
<demon> |
Synchronized wmf-config/StartProfiler.php: (no message) (duration: 00m 05s) |
[production] |
| 18:33 |
<legoktm> |
ran removeInvalidEmails.php on testwiki |
[production] |
| 18:28 |
<bd808> |
Rolling restart of the elasticsearch cluster for logstash did not fix corrupted logstash-2014.11.30 index. It was worth a shot. |
[production] |
| 18:23 |
<bd808> |
restarted elasticsearch on logstash1002 |
[production] |
| 17:28 |
<bd808> |
restarted elasticsearch on logstash1003 to see if the missing indices would recover |
[production] |
| 16:28 |
<bd808> |
restarted elasticsearch on logstash1001. |
[production] |
| 14:40 |
<godog> |
upgrade to diamond 3.5 on trusty hosts in esams |
[production] |
| 14:31 |
<godog> |
upgrade to diamond 3.5 on trusty hosts in esams |
[production] |
| 14:14 |
<hashar> |
Jenkins: haven't had to restart it, I cancelled a few jobs and it went back up processing jobs.. |
[production] |
| 14:12 |
<hashar> |
Jenkins in deadlock , restarting it ( https://phabricator.wikimedia.org/T72597 ) |
[production] |
| 13:45 |
<_joe_> |
repooling mw1081 |
[production] |
| 13:10 |
<_joe_> |
depooling mw1081 to activate hyperthreading |
[production] |
| 12:09 |
<paravoid> |
powercycling rhenium, kernel locked up |
[production] |
| 11:24 |
<godog> |
upgrade to diamond 3.5 on trusty hosts in ulsfo |
[production] |
| 10:44 |
<godog> |
upgrade diamond to 3.5 on all trusty machines in codfw |
[production] |
| 10:33 |
<godog> |
test-upgrade diamond 3.5 on swift in codfw |
[production] |
| 10:01 |
<ori> |
disabling puppet on mw1081 and restarting hhvm with hhvm.server.stat_cache\t=true to observe impact |
[production] |