|
2012-04-19
§
|
| 23:33 |
<binasher> |
powercycled es1004 |
[production] |
| 21:08 |
<Jeff_Green> |
changed nagios contactgroup fundraising from tfinc/awrichards --> jgreen |
[production] |
| 21:03 |
<RoanKattouw> |
Scap is broken in some weird way, it just stops running after the scap1-skins step. Doesn't run scap-1 (which does the actual sync), doesn't log "sync done", doesn't update graphite |
[production] |
| 21:01 |
<logmsgbot_> |
catrope synchronizing Wikimedia installation... : Running scap again, AFTv5 is acting up |
[production] |
| 19:34 |
<logmsgbot_> |
catrope synchronizing Wikimedia installation... : ArticleFeedbackv5 updates |
[production] |
| 19:29 |
<RoanKattouw> |
Running scap to deploy AFTv5 updates, and running AFTv5 schema changes on enwiki at the same time |
[production] |
| 18:50 |
<logmsgbot_> |
catrope synchronized wmf-config/InitialiseSettings.php 'Set wmgArticleFeedbackv5OversightEmails for enwiki' |
[production] |
| 18:25 |
<notpeter> |
nothing obvious in logs on db1005, starting mysql |
[production] |
| 18:15 |
<notpeter> |
rebooting db1005. it's dead, jim. |
[production] |
| 17:53 |
<RoanKattouw> |
Running schema changes for AFTv5 on testwiki |
[production] |
| 17:52 |
<Jeff_Green> |
discovered nfs1 had ~1K redundant iptables rules, removed extras and reloaded |
[production] |
| 17:42 |
<Jeff_Green> |
discovered sanger had ~7K redundant iptables rules, removed extras and reloaded |
[production] |
| 08:35 |
<mutante> |
emery - "udp2log_age" says some squid logfiles have not been written to in 6 hours, but from the filenames looks like this isnt a reason to worry, right |
[production] |
| 07:49 |
<mutante> |
stat1 - this also needs udp2log stuff fixed. currently Could not find class misc::udp2log::udp-filter |
[production] |
| 07:47 |
<mutante> |
gilman - what's up with it? closes SSH, does not like mgmt pass, was running jenkins but broken |
[production] |
| 07:43 |
<mutante> |
owa[1-3] They dont have real puppet freshness issues, it's rather firewalling and the snmp traps |
[production] |
| 02:30 |
<logmsgbot_> |
LocalisationUpdate completed (1.20wmf1) at Thu Apr 19 02:30:33 UTC 2012 |
[production] |
| 02:21 |
<logmsgbot_> |
LocalisationUpdate completed (1.19) at Thu Apr 19 02:21:31 UTC 2012 |
[production] |
|
2012-04-18
§
|
| 22:55 |
<LeslieCarr> |
updating exim4.conf on mchenry to not allow old ranges |
[production] |
| 21:03 |
<logmsgbot_> |
aaron rebuilt wikiversions.cdb and synchronized wikiversions files: |
[production] |
| 20:47 |
<logmsgbot_> |
catrope synchronized php-1.20wmf1/resources/startup.js 'touch' |
[production] |
| 20:46 |
<logmsgbot_> |
catrope synchronized php-1.20wmf1/extensions/SyntaxHighlight_GeSHi/ 'Deploying GeSHi fix https://gerrit.wikimedia.org/r/#change,4949' |
[production] |
| 20:05 |
<logmsgbot_> |
aaron rebuilt wikiversions.cdb and synchronized wikiversions files: specieswiki and foundationwiki to 1.20wmf1 |
[production] |
| 19:56 |
<logmsgbot_> |
aaron synchronized php-1.20wmf1/extensions/LiquidThreads/classes/Hooks.php 'Avoid fatals on invalid title in API' |
[production] |
| 19:51 |
<logmsgbot_> |
aaron rebuilt wikiversions.cdb and synchronized wikiversions files: All *wiki wikis to 1.20wmf1 |
[production] |
| 19:25 |
<logmsgbot_> |
aaron rebuilt wikiversions.cdb and synchronized wikiversions files: All wikiquote and wikiversity projects to 1.20wmf1 |
[production] |
| 19:22 |
<logmsgbot_> |
aaron rebuilt wikiversions.cdb and synchronized wikiversions files: All wikibooks to 1.20wmf1 |
[production] |
| 19:18 |
<logmsgbot_> |
aaron rebuilt wikiversions.cdb and synchronized wikiversions files: All wikinewses to 1.20wmf1 |
[production] |
| 19:07 |
<logmsgbot_> |
aaron rebuilt wikiversions.cdb and synchronized wikiversions files: All wikisources to 1.20wmf1 |
[production] |
| 19:07 |
<logmsgbot_> |
catrope synchronized wmf-config/mc.php 'Swap out 10.0.2.251 (down) with 10.0.11.24 (spare). This is the last spare, there are now NO SPARES LEFT in mc.php' |
[production] |
| 19:00 |
<logmsgbot_> |
aaron rebuilt wikiversions.cdb and synchronized wikiversions files: All wiktionaries to 1.20wmf1 |
[production] |
| 18:57 |
<logmsgbot_> |
aaron synchronized php-1.20wmf1/extensions/LiquidThreads/classes/Dispatch.php 'Added type hint for better fatals' |
[production] |
| 18:44 |
<logmsgbot_> |
aaron rebuilt wikiversions.cdb and synchronized wikiversions files: enwikiversity to 1.20wmf1 |
[production] |
| 18:43 |
<logmsgbot_> |
aaron rebuilt wikiversions.cdb and synchronized wikiversions files: enwikiquote to 1.20wmf1 |
[production] |
| 18:41 |
<logmsgbot_> |
aaron rebuilt wikiversions.cdb and synchronized wikiversions files: enwikibooks to 1.20wmf1 |
[production] |
| 18:40 |
<logmsgbot_> |
aaron rebuilt wikiversions.cdb and synchronized wikiversions files: enwikinews to 1.20wmf1 |
[production] |
| 18:39 |
<logmsgbot_> |
aaron rebuilt wikiversions.cdb and synchronized wikiversions files: enwiktionary to 1.20wmf1 |
[production] |
| 18:32 |
<logmsgbot_> |
aaron rebuilt wikiversions.cdb and synchronized wikiversions files: enwikisource to 1.20wmf1 |
[production] |
| 17:20 |
<logmsgbot_> |
catrope synchronized docroot/bits/ 'Remove static-1.00 again' |
[production] |
| 16:57 |
<logmsgbot_> |
catrope synchronized docroot/bits 'Add docroot/bits/static-1.00 for testing' |
[production] |
| 16:41 |
<logmsgbot_> |
reedy synchronized wmf-config/InitialiseSettings.php 'Set wmfUseRevSha1Columns to true for enwiki' |
[production] |
| 13:30 |
<mutante> |
applied a patch to etherpad that allows admins to delete pads |
[production] |
| 12:53 |
<mutante> |
restarting/fixing etherpad issue |
[production] |
| 11:08 |
<mark> |
Sending European bits traffic back to esams |
[production] |
| 02:30 |
<logmsgbot_> |
LocalisationUpdate completed (1.20wmf1) at Wed Apr 18 02:30:50 UTC 2012 |
[production] |
| 02:21 |
<logmsgbot_> |
LocalisationUpdate completed (1.19) at Wed Apr 18 02:21:49 UTC 2012 |
[production] |
| 02:13 |
<logmsgbot_> |
catrope synchronized php-1.20wmf1/README 'Dummy sync to capture which hosts time out on sync-file' |
[production] |