|
2012-03-28
§
|
| 16:47 |
<cmjohnson1> |
msw1-d1-pmtpa replacement complete |
[production] |
| 16:34 |
<cmjohnson1> |
replacing msw-d1-pmtpa per rt2639 |
[production] |
| 15:36 |
<reedy> |
synchronized wmf-config/CommonSettings.php 'Bump account creation limit per request on -tech' |
[production] |
| 15:34 |
<Reedy> |
srv221 is full |
[production] |
| 15:34 |
<reedy> |
synchronized wmf-config/CommonSettings.php 'Bump account creation limit per request on -tech' |
[production] |
| 14:39 |
<RobH> |
restarted morebots in screen on wikitech, no longer as catrope, as roan has root on that box |
[production] |
| 14:36 |
<RobH> |
got virt1001 to pxe, but dhcp doesnt know how to handle, need subnet details. |
[production] |
| 14:34 |
<notpeter> |
lucene hosed on search9 and search15. restarting, then will look after cause |
[production] |
| 13:14 |
<Jeff_Green> |
restarting puppet/puppetmaster on stafford to experiment with report settings |
[production] |
| 02:10 |
<LocalisationUpdate> |
completed (1.19) at Wed Mar 28 02:10:34 UTC 2012 |
[production] |
|
2012-03-27
§
|
| 23:12 |
<tstarling> |
synchronized php-1.19/cache/trusted-xff.cdb |
[production] |
| 20:19 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Bug 33789 - Enable botadmin usergroup on ml.wikipedia' |
[production] |
| 19:20 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Fix lezwiki namespace' |
[production] |
| 19:11 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Remove ruwiki arbcom talk from namespaceprotection' |
[production] |
| 19:00 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Bug 35138 - Create Gujarati Wikisource' |
[production] |
| 18:26 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Bug 35138 - Create Gujarati Wikisource' |
[production] |
| 18:22 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Bug 35138 - Create Gujarati Wikisource' |
[production] |
| 18:16 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Bug 34351 - Create Wikisource in Belarusian' |
[production] |
| 18:14 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Bug 34351 - Create Wikisource in Belarusian' |
[production] |
| 18:10 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Bug 34351 - Create Wikisource in Belarusian' |
[production] |
| 18:05 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Bug 35290 - Create Slovenian Wikiversity' |
[production] |
| 18:05 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Bug 35290 - Create Slovenian Wikiversity' |
[production] |
| 17:00 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Config for lezwiki' |
[production] |
| 16:58 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Config for lezwiki' |
[production] |
| 16:56 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Config for lezwiki' |
[production] |
| 16:48 |
<reedy> |
ran sync-common-all |
[production] |
| 16:32 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'prep work for new wikis' |
[production] |
| 16:08 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Bug 34527 - Create a Arbcom namespace on Russian Wikipedia' |
[production] |
| 16:06 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Bug 34527 - Create a Arbcom namespace on Russian Wikipedia' |
[production] |
| 15:47 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Bug 35161 - Incubator configuration updates' |
[production] |
| 15:11 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Bug 32825 - Favicon for siwiki' |
[production] |
| 14:40 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Bug 35516 - Add Skin: namespace to MW.org' |
[production] |
| 08:15 |
<apergos> |
test you silly morebot |
[production] |
|
2012-03-26
§
|
| 17:14 |
<notpeter> |
backingup plwiki.nspart1 index on search7, deleting working copy, and restarting lsearchd. (note: this will probably cause some downtime on some languages while the proc restarts...) |
[production] |
| 15:18 |
<RobH> |
db59 has errors, but as it was a fusion io testbed server, it is more than likely tweaked for such, it is not in any rotation |
[production] |
| 14:54 |
<RobH> |
db59 shutting down for io card removal per rt 2589 |
[production] |
| 13:37 |
<mutante> |
while on it, installing a whole bunch of package updates on db42 |
[production] |
| 13:25 |
<mutante> |
db42 was out of disk , caused by ~5G citations.csv in /tmp, gzipped the file |
[production] |
| 09:59 |
<mutante> |
..and on ms-be-3. running puppet on db59 |
[production] |
| 09:43 |
<mutante> |
another corrupted .yaml file on ssl2 |
[production] |
| 09:33 |
<mutante> |
brewster - delete puppet lock file, restart lighttpd, puppet ... |
[production] |
| 09:05 |
<mutante> |
brewster was out of disk - deleted lighttpd access.log.1, gzipped access.log |
[production] |
| 02:18 |
<LocalisationUpdate> |
completed (1.19) at Mon Mar 26 02:18:03 UTC 2012 |
[production] |
|
2012-03-25
§
|
| 22:26 |
<RobH> |
row b servertech firmware in eqiad all updated, should clear alarms as they come back online |
[production] |
| 22:18 |
<RobH> |
firmware updates on servertechs in row b eqiad, disregard alarms |
[production] |
| 20:14 |
<RobH> |
to fellow ops, you can disregard those observium errors, as I caused them |
[production] |
| 20:13 |
<RobH> |
firmware updated on all power strips in row a eqiad. |
[production] |
| 16:22 |
<RobH> |
ps1-a1-sdtpa firmware update complete |
[production] |
| 16:16 |
<RobH> |
updating firmware on ps1-a1-sdtpa |
[production] |
| 16:14 |
<RobH> |
ps1-b1-sdtpa firmware updated successfully |
[production] |