|
2015-08-05
§
|
| 17:07 |
<bblack> |
really depooled cp1046, cp1061, cp1066 ( thermal batch 1: https://phabricator.wikimedia.org/T103226 ) |
[production] |
| 17:02 |
<bblack> |
depooled cp1046, cp1061, cp1066 ( thermal batch 1: https://phabricator.wikimedia.org/T103226 ) |
[production] |
| 16:43 |
<hoo> |
Started scap: Rebuild l10n cache for wmf17, got forgotten during the train |
[production] |
| 16:28 |
<bblack> |
cache puppets disabled for a little while, to make sure do_esi doesn't melt things |
[production] |
| 15:11 |
<thcipriani> |
Synchronized php-1.26wmf17/extensions/ContentTranslation/modules/tools/ext.cx.tools.mt.js: SWAT: FIX: Not able to set cursor in previous sections [[gerrit:229328]] (duration: 00m 12s) |
[production] |
| 15:02 |
<andrewbogott> |
rebooting labvirt1009 |
[production] |
| 14:51 |
<gwicke> |
stopped restbase on restbase1009 |
[production] |
| 14:44 |
<moritzm> |
restarted HHVM on appservers (mw1026-mw1113) for tidy/pcre security updates |
[production] |
| 14:42 |
<jynus> |
Synchronized wmf-config/db-eqiad.php: depool db1056 (duration: 00m 12s) |
[production] |
| 14:29 |
<jynus> |
Synchronized wmf-config/db-eqiad.php: repool db1059 (duration: 00m 13s) |
[production] |
| 13:16 |
<hoo> |
Removed Wikidata JSON dumps from Monday and Tuesday as they were incomplete/ had the wrong serialization format |
[production] |
| 12:41 |
<moritzm> |
restarted HHVM on canary appservers for tidy/pcre security updates, remaining app servers following soon |
[production] |
| 12:32 |
<paravoid> |
upgrading asw-c-codfw and asw-d-codfw to newer junos |
[production] |
| 11:17 |
<jynus> |
Synchronized wmf-config/db-eqiad.php: repool db1056, depool db1059 (duration: 00m 12s) |
[production] |
| 11:01 |
<godog> |
depool restbase1009, investigating healthcheck returning 500s |
[production] |
| 10:52 |
<godog> |
pool restbase100[789] in pybal |
[production] |
| 10:43 |
<paravoid> |
upgrading asw-b-codfw to newer junos |
[production] |
| 10:36 |
<jynus> |
applying schema change for s4 on codfw, some lag expected |
[production] |
| 09:08 |
<dcausse> |
es1.7.1: upgrade elastic1010 |
[production] |
| 07:46 |
<dcausse> |
es1.7.1: upgrade elastic1009 |
[production] |
| 07:12 |
<jynus> |
Synchronized wmf-config/db-eqiad.php: depool db1056 for maintenance, db1064 set to 100% (duration: 00m 12s) |
[production] |
| 06:29 |
<springle> |
finish OSC gerrit 228756 s5 wb_items_per_site.ips_site_page |
[production] |
| 06:27 |
<@tin> |
ResourceLoader cache refresh completed at Wed Aug 5 06:27:08 UTC 2015 (duration 27m 7s) |
[production] |
| 06:26 |
<dcausse> |
es1.7.1: upgrade elastic1008 |
[production] |
| 04:56 |
<ebernhardson> |
restarted elasticsearch on elastic1007 for 1.7.1 upgrade |
[production] |
| 03:34 |
<legoktm> |
Synchronized wmf-config/InitialiseSettings.php: Disable two more wikis due to namespace conflicts - https://gerrit.wikimedia.org/r/229292 (duration: 00m 12s) |
[production] |
| 03:09 |
<ebernhardson> |
restarted elasticsearch on elastic1006 for 1.7.1 upgrade |
[production] |
| 03:04 |
<@tin> |
LocalisationUpdate completed (1.26wmf17) at 2015-08-05 03:04:08+00:00 |
[production] |
| 02:57 |
<l10nupdate> |
Synchronized php-1.26wmf17/cache/l10n: (no message) (duration: 10m 30s) |
[production] |
| 02:31 |
<@tin> |
LocalisationUpdate completed (1.26wmf16) at 2015-08-05 02:31:44+00:00 |
[production] |
| 02:28 |
<l10nupdate> |
Synchronized php-1.26wmf16/cache/l10n: (no message) (duration: 06m 56s) |
[production] |
| 01:44 |
<ebernhardson> |
restarting elasticsearch of es1005 |
[production] |
|
2015-08-04
§
|
| 23:59 |
<maxsem> |
Synchronized php-1.26wmf16/extensions/WikimediaEvents/: SWAT (duration: 00m 12s) |
[production] |
| 23:57 |
<maxsem> |
Synchronized php-1.26wmf17/extensions/WikimediaEvents/: SWAT (duration: 00m 12s) |
[production] |
| 23:08 |
<mattflaschen> |
Synchronized wmf-config/InitialiseSettings.php: Disable Flow on betawikiversity (duration: 00m 13s) |
[production] |
| 22:07 |
<twentyafterfour> |
Synchronized php-1.26wmf17: forgot submodule update (duration: 01m 39s) |
[production] |
| 20:46 |
<twentyafterfour> |
Finished scap: fixup wikidata submodule version (duration: 23m 26s) |
[production] |
| 20:22 |
<twentyafterfour> |
Started scap: fixup wikidata submodule version |
[production] |
| 19:46 |
<dcausse> |
es1.7.1: upgrade elastic1003 |
[production] |
| 19:12 |
<ori> |
Applied Icba6d7a87 on mw1017 for a couple of webpagetest runs |
[production] |
| 19:08 |
<twentyafterfour> |
rebuilt wikiversions.cdb and synchronized wikiversions files: group0 wikis to 1.26wmf17 |
[production] |
| 18:51 |
<twentyafterfour> |
Finished scap: rebuild localization cache, sync 1.26wmf17 (duration: 28m 39s) |
[production] |
| 18:42 |
<dcausse> |
es1.7.1: upgrade elastic1002 |
[production] |
| 18:22 |
<twentyafterfour> |
Started scap: rebuild localization cache, sync 1.26wmf17 |
[production] |
| 18:00 |
<andrewbogott> |
re-imaging labnodepool1001 |
[production] |
| 17:35 |
<jynus> |
Synchronized wmf-config/db-eqiad.php: Increase db1064 traffic (duration: 00m 13s) |
[production] |
| 17:18 |
<dcausse> |
es1.7.1: upgrade elastic1001 |
[production] |
| 17:17 |
<hoo> |
Started dumpwikidatajson.sh on snapshot1003 to create a correct Wikidata json dump |
[production] |
| 17:14 |
<hoo> |
Synchronized php-1.26wmf16/extensions/Wikidata/: Fix maintenance/dumpJson.php fatal (duration: 00m 21s) |
[production] |
| 17:11 |
<chasemp> |
freezing elasticsearch indexes for 1.7.1 |
[production] |