|
2015-06-17
§
|
| 17:24 |
<ottomata> |
starting reinstall of Zookeeper analytics nodes (analytics102[345]): https://phabricator.wikimedia.org/T101713 |
[production] |
| 17:16 |
<godog> |
bounce cassandra on restbase1001 |
[production] |
| 17:14 |
<jynus> |
rolling schema changes on ruwiki master |
[production] |
| 17:13 |
<mutante> |
running puppet via salt on api appservers in batches, switch to ganglia_new and carbon |
[production] |
| 17:12 |
<godog> |
cassandra stopped sending graphite metrics after restart, investigating (test cluster works fine tho) |
[production] |
| 16:58 |
<jynus> |
rolling schema changes on ruwiki slaves |
[production] |
| 16:28 |
<godog> |
start upgrading restbase1001 to cassandra 2.1.6 T102015 |
[production] |
| 16:02 |
<thcipriani> |
Finished scap: Wikitech-Ldap host record roll-out (duration: 24m 35s) |
[production] |
| 15:37 |
<thcipriani> |
Started scap: Wikitech-Ldap host record roll-out |
[production] |
| 15:19 |
<anomie> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Give patrolmarks right to "*" on dewiki [[gerrit:218901]] (duration: 00m 13s) |
[production] |
| 15:17 |
<anomie> |
Synchronized wmf-config/throttle.php: SWAT: Add a throttle exception for United Islands of Prague [[gerrit:217413]] (duration: 00m 14s) |
[production] |
| 15:15 |
<anomie> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Disable captcha on labswiki for now [[gerrit:218908]] (duration: 00m 13s) |
[production] |
| 15:10 |
<anomie> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Add extra namespace aliases for Italian Wikipedia [[gerrit:215708]] (duration: 00m 13s) |
[production] |
| 15:08 |
<anomie> |
SWAT: Enable anti-abuse features on labswiki [[gerrit:218903]] |
[production] |
| 15:08 |
<jynus> |
testing some schema changes on testwiki |
[production] |
| 15:00 |
<aude> |
Synchronized usagetracking.dblist: Enable Wikibase usage tracking on nowiki and plwiki (duration: 00m 13s) |
[production] |
| 13:56 |
<aude> |
Synchronized usagetracking.dblist: Enable Wikibase usage tracking on fiwiki and idwiki (duration: 00m 13s) |
[production] |
| 13:26 |
<aude> |
Synchronized usagetracking.dblist: Enable Wikibase usage tracking on bgwiki and eowiki (duration: 00m 13s) |
[production] |
| 10:52 |
<akosiaris> |
reload pybal on lvs1006 |
[production] |
| 10:50 |
<mobrovac> |
finished deploying mathoid I40ef68 on SCA |
[production] |
| 10:48 |
<akosiaris> |
repooled mathoid.svc.eqiad.wmnet: sca1002 backend |
[production] |
| 10:44 |
<akosiaris> |
enable puppet on sca1002 |
[production] |
| 10:43 |
<akosiaris> |
enable puppet |
[production] |
| 10:43 |
<akosiaris> |
depool sca1002 for mathoid.svc.eqiad.wmnet |
[production] |
| 10:43 |
<akosiaris> |
reloaded pybal on lvs1003 |
[production] |
| 10:28 |
<akosiaris> |
repool sca1002, depool sca1001 |
[production] |
| 10:18 |
<mark> |
Halting pvmove of md124 on labstore1001 |
[production] |
| 09:30 |
<akosiaris> |
disable puppet on sca1001 |
[production] |
| 09:09 |
<akosiaris> |
depool sca1001, resource: mathoid |
[production] |
| 09:09 |
<akosiaris> |
puppet disabled on sca1002 |
[production] |
| 08:37 |
<YuviPanda> |
run sudo salt -t 20 -b 100 '*' cmd.run 'sudo service salt-minion restart' on virt1000, attempt to get them to answer on labcontrol1001 instead |
[production] |
| 06:53 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Wed Jun 17 06:52:58 UTC 2015 (duration 52m 57s) |
[production] |
| 02:56 |
<LocalisationUpdate> |
completed (1.26wmf10) at 2015-06-17 02:56:49+00:00 |
[production] |
| 02:55 |
<springle> |
Synchronized wmf-config/db-eqiad.php: depool db1045 (duration: 00m 13s) |
[production] |
| 02:54 |
<springle> |
found wikiversions.json modified on tin since 2015-06-16 23:27 (catrope?); stashed and reapplied the file in order to do a pull |
[production] |
| 02:54 |
<l10nupdate> |
Synchronized php-1.26wmf10/cache/l10n: (no message) (duration: 04m 44s) |
[production] |
| 02:35 |
<LocalisationUpdate> |
completed (1.26wmf9) at 2015-06-17 02:35:23+00:00 |
[production] |
| 02:32 |
<l10nupdate> |
Synchronized php-1.26wmf9/cache/l10n: (no message) (duration: 06m 12s) |
[production] |
| 02:21 |
<ori> |
Synchronized php-1.26wmf9/extensions/CentralNotice/modules/ext.centralNotice.bannerController/bannerController.js: I480cbc7ad (duration: 00m 12s) |
[production] |
| 02:21 |
<ori> |
Synchronized php-1.26wmf10/extensions/CentralNotice/modules/ext.centralNotice.bannerController/bannerController.js: I480cbc7ad (duration: 00m 12s) |
[production] |
| 00:10 |
<paravoid> |
draining esams because of upcoming network maintenance window |
[production] |
|
2015-06-16
§
|
| 23:28 |
<catrope> |
Synchronized wmf-config/InitialiseSettings.php: Enable local upload on fawikivoyage; enable logging for T76305 (duration: 00m 13s) |
[production] |
| 23:28 |
<catrope> |
Synchronized wmf-config/CommonSettings.php: Set previous values for password length policies (duration: 00m 16s) |
[production] |
| 23:17 |
<twentyafterfour> |
Finished scap: testwiki to 1.26wmf10 (duration: 43m 04s) |
[production] |
| 23:02 |
<godog> |
restore INFO cassandra logging level on restbase1003 |
[production] |
| 22:44 |
<godog> |
start cassandra on restbase1008 |
[production] |
| 22:43 |
<godog> |
enable back some cassandra debugging on restbase1003 |
[production] |
| 22:33 |
<twentyafterfour> |
Started scap: testwiki to 1.26wmf10 |
[production] |
| 22:26 |
<urandom> |
restored default logging level on restbase1003 |
[production] |
| 22:22 |
<urandom> |
enabling even more debugging on restbase1003 |
[production] |