|
2016-04-04
§
|
| 10:23 |
<godog> |
reduce reserved blocks for /srv on restbase2004 |
[production] |
| 10:06 |
<hashar> |
integration: salt -v '*-slave*' cmd.run 'rm /usr/local/bin/grunt; rm -fR /usr/local/lib/node_modules/grunt-cli' | T124474 |
[releng] |
| 10:04 |
<hashar> |
integration: salt -v '*-slave*' cmd.run 'npm -g uninstall grunt-cli' | T124474 |
[releng] |
| 09:59 |
<moritzm> |
installing pcre3 updates |
[production] |
| 09:57 |
<godog> |
start expanding raid0 on restbase2003 |
[production] |
| 09:54 |
<ema> |
nginx rolling restart for openssl upgrade: cp1046, cp1052, cp1068, cp1071, cp1099 |
[production] |
| 09:53 |
<elukey> |
de-pooled aqs1001.eqiad.wmnet as pre-step for nodejs upgrade |
[analytics] |
| 09:53 |
<elukey> |
de-pooled aqs1001.eqiad.wmnet as pre-step for nodejs upgrade |
[production] |
| 09:41 |
<godog> |
depool restbase2003 before raid expansion |
[production] |
| 09:37 |
<godog> |
repool restbase2004 |
[production] |
| 09:33 |
<godog> |
deploy restbase ba39d2bcd2f5 to restbase2004 before repooling |
[production] |
| 09:26 |
<volans> |
Re-enabling Puppet on cluster mysql and parsercache to deploy change 279596, T111654 |
[production] |
| 09:10 |
<volans> |
Disabling Puppet on cluster mysql and parsercache to merge and test change 279596 on db2040, T111654 |
[production] |
| 08:50 |
<moritzm> |
installing gnupg updates |
[production] |
| 06:54 |
<moritzm> |
installing apt bugfix updates |
[production] |
| 04:18 |
<TimStarling> |
iridium came back up, but mcelog reports high CPU temperature prior to the shutdown |
[production] |
| 04:13 |
<TimStarling> |
attempting to turn iridium back on via drac. "getraclog" says it powered itself off after resetting four times |
[production] |
| 03:15 |
<greg-g> |
Phabricator is down |
[releng] |
| 03:15 |
<greg-g> |
Phabricator is down |
[production] |
| 02:33 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Mon Apr 4 02:33:39 UTC 2016 (duration 8m 31s) |
[production] |
| 02:25 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.19) (duration: 11m 45s) |
[production] |
| 00:49 |
<krinkle@tin> |
Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 29s) |
[production] |
| 00:30 |
<krinkle@tin> |
Synchronized w/static.php: (no message) (duration: 00m 35s) |
[production] |
| 00:21 |
<Krinkle> |
mwscript deleteEqualMessages.php --wiki ruwiki (T45917) |
[production] |
| 00:06 |
<Krinkle> |
mwscript deleteEqualMessages.php --wiki metawiki --delete |
[production] |
|
2016-04-03
§
|
| 22:37 |
<Krinkle> |
mwscript deleteEqualMessages.php --wiki eswiki --lang-code ca (T45917) |
[production] |
| 22:37 |
<Krinkle> |
mwscript deleteEqualMessages.php --wiki eswiki (T45917) |
[production] |
| 22:34 |
<Krinkle> |
mwscript deleteEqualMessages.php --wiki eswiki |
[production] |
| 19:16 |
<Krenair> |
mw1146 began to respond with 503s to all requests, tried restarting apache2/hhvm and shortly afterwards it started working again |
[production] |
| 13:26 |
<reedy@tin> |
Synchronized wmf-config/InitialiseSettings-labs.php: labs copy upload thing. noooooop for prod (duration: 00m 33s) |
[production] |
| 13:02 |
<reedy@tin> |
Synchronized wmf-config/InitialiseSettings.php: labs copy upload thing. noooooop for prod (duration: 00m 28s) |
[production] |
| 11:37 |
<ori@tin> |
Synchronized wmf-config/extension-list-labs: I0d081186: Also add Newsletter to extension-list-labs (duration: 00m 27s) |
[production] |
| 11:34 |
<ori@tin> |
Synchronized wmf-config/InitialiseSettings-labs.php: I3ffe65b8: Load the Newsletter extension on the beta cluster (2/2) (duration: 00m 33s) |
[production] |
| 11:34 |
<ori@tin> |
Synchronized wmf-config/CommonSettings-labs.php: I3ffe65b8: Load the Newsletter extension on the beta cluster (1/2) (duration: 00m 34s) |
[production] |
| 07:01 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/281079 |
[releng] |
| 03:16 |
<Amir1> |
manually rebooted deployment-ores-web and deployment-sca01 |
[releng] |
| 03:14 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.19) (duration: 56m 43s) |
[production] |
|
2016-04-02
§
|
| 23:32 |
<Luke081515> |
updating the repos |
[rcm.cac] |
| 22:58 |
<Amir1> |
added local hack to pupetmaster to make scap3 provider more verbose |
[releng] |
| 20:28 |
<hashar> |
Restarted Jenkins on gallium |
[production] |
| 19:46 |
<hashar> |
Upgrading Jenkins Gearman plugin to v2.0 , bring in diff registration for faster updates of Gearman server |
[releng] |
| 19:16 |
<dereckson@tin> |
Synchronized wmf-config/InitialiseSettings.php: 350K celebration logo for cs.wikipedia (T131605) (duration: 00m 29s) |
[production] |
| 19:14 |
<dereckson@tin> |
Synchronized static/images/project-logos/cswiki.png: 350K celebration logo for cs.wikipedia (duration: 00m 33s) |
[production] |
| 14:39 |
<Amir1> |
manually added 281170/5 to beta puppetmaster |
[releng] |
| 14:22 |
<Amir1> |
manually added 281161/1 to beta puppetmaster |
[releng] |
| 14:06 |
<valhallasw`cloud> |
systemctl restart celery-quarry-worker.service hangs. Will now reboot quarry-runner-02. |
[quarry] |
| 14:02 |
<valhallasw`cloud> |
killed 100% CPU using process on quarry-runner-02 (ptrace suggested some sort of idle loop). Let's see if that has any effect. |
[quarry] |
| 11:31 |
<Reedy> |
deleted archived logs older than 30 days from deployment-fluorine |
[releng] |
| 10:45 |
<reedy@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: wikitech back to .19 |
[production] |
| 10:01 |
<reedy@tin> |
Synchronized php-1.27.0-wmf.19/extensions/OATHAuth: Fix for 2FA testing (duration: 00m 30s) |
[production] |