2014-04-01
§
|
23:32 |
<ebernhardson> |
synchronized docroot and w |
[production] |
21:42 |
<hashar> |
Ganglia in labs is more or less back in activity: http://ganglia.wmflabs.org/ No clue what it is graphing though |
[production] |
21:28 |
<hashar> |
jenkins killed stuck build (5 hours+) of beta-update-databases-eqiad . Might have been blocking Jenkins build queue |
[production] |
19:09 |
<Reedy> |
ori gracefulled mw1018, mw1050, mw1061, mw1070, mw1139, mw1179 |
[production] |
18:45 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: zerowiki to 1.23wmf20 |
[production] |
18:43 |
<reedy> |
updated /a/common to {{Gerrit|If887effe5}}: Add zerowiki |
[production] |
18:43 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'touch' |
[production] |
18:42 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: Add zerowiki |
[production] |
18:41 |
<reedy> |
synchronized database lists files: |
[production] |
18:37 |
<reedy> |
synchronized docroot and w |
[production] |
18:36 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: non wikipedias to 1.23wmf20 |
[production] |
18:28 |
<mutante> |
ms10 - shut down |
[production] |
18:19 |
<mutante> |
ms10 - disable puppet, revoke puppet cert,salt key,icinga.. |
[production] |
18:03 |
<ori> |
synchronized php-1.23wmf20/includes/profiler/ProfilerSimple.php 'Iad91f1d12: Send profiled items under the correct name' |
[production] |
18:02 |
<ori> |
synchronized php-1.23wmf19/includes/profiler/ProfilerSimple.php 'Iad91f1d12: Send profiled items under the correct name' |
[production] |
17:34 |
<mutante> |
logging to eqiad wikitech after Andrew switched over |
[production] |
16:05 |
<andrewbogott> |
switching wikitech to read-only, migrating to eqiad |
[production] |
15:06 |
<reedy> |
updated /a/common to {{Gerrit|If3ca3d486}}: beta: adjust $wgCaptchaDirectory |
[production] |
15:01 |
<hashar> |
Gerrit super slow again :-( |
[production] |
14:46 |
<mutante> |
added oblivion to root-auth-keys |
[production] |
14:17 |
<mutante> |
welcome new shell user oblivion |
[production] |
14:04 |
<hashar> |
Gerrit flushed a few caches related to user accounts / LDAP |
[production] |
13:43 |
<mutante> |
adding oblivion to ops and wmf LDAP groups |
[production] |
08:44 |
<mutante> |
solr1/2 - revoke puppet certs |
[production] |
08:43 |
<mutante> |
solr3 - delete salt key, puppet cert |
[production] |
03:11 |
<springle> |
synchronized wmf-config/db-eqiad.php 's7 db1034 full steam' |
[production] |
02:02 |
<LocalisationUpdate> |
failed: git pull of extensions failed |
[production] |
01:58 |
<springle> |
killed research queries on db1047. email me |
[production] |
01:35 |
<springle> |
restarted sanitarium s3 instance for additional private wikis |
[production] |
00:59 |
<springle> |
synchronized wmf-config/db-eqiad.php 's7 repool db1034, warm up' |
[production] |
2014-03-31
§
|
23:30 |
<springle> |
synchronized wmf-config/db-eqiad.php 's7 depool db1034 for upgrade' |
[production] |
23:22 |
<ori> |
End of SWAT deploy. |
[production] |
23:21 |
<ori> |
synchronized php-1.23wmf19/extensions 'I6f0f1b18d: Update MobileFrontend, PageImages and TextExtracts for bug 63248' |
[production] |
23:16 |
<ori> |
synchronized php-1.23wmf20/extensions 'I6f0f1b18d: Update MobileFrontend, PageImages and TextExtracts for bug 63248' |
[production] |
23:05 |
<ori> |
synchronized wmf-config/InitialiseSettings.php 'I532f8ee7c: Add "upload" custom debug group to $wgDebugLogGroups' |
[production] |
23:05 |
<ori> |
updated /a/common to {{Gerrit|I532f8ee7c}}: Add 'upload' custom debug group to wgDebugLogGroups |
[production] |
23:03 |
<ori> |
Starting SWAT deploy window. |
[production] |
20:36 |
<awight> |
updated crm from 5151d97044ce2fff7299cee8920ee9bd3dbbdf54 to e726e4213f1d65cae7276f91379eb1b229b19134 |
[production] |
19:31 |
<yurik> |
synchronized docroot/bits/WikipediaMobileFirefoxOS/ |
[production] |
16:37 |
<aaron> |
synchronized wmf-config/PoolCounterSettings-eqiad.php 'Added "downloadpdf" pool counter config' |
[production] |
16:11 |
<bd808> |
Upgraded kibana on logstash cluster to e317bc663495d0172339a4d4ace9c2a580ceed45 |
[production] |
16:08 |
<mutante> |
DNS update - remove tampa search pools (a second time, was duplicate, heh) |
[production] |
15:33 |
<Jeff_Green> |
reenable fundraising services, reenable silicon icinga monitoring |
[production] |
14:28 |
<bd808> |
Started logstash on logstash1001 |
[production] |
14:23 |
<bd808> |
Elasticsearch upgraded to 1.0.1 on logstash100[123] |
[production] |
14:18 |
<hashar> |
beta cluster DNS entries migrated to point to the EQIAD datacenter. Keeping pmtpa instances around for a couple days |
[production] |
14:16 |
<bd808> |
Stopped elasticsearch on logstash100[123] |
[production] |
14:13 |
<bd808> |
Stopped logstash on logstash1001 |
[production] |
13:48 |
<Jeff_Green> |
icinga alerts disabled for silicon |
[production] |
13:34 |
<Jeff_Green> |
fundraising-system full-stop for hardware repairs on queue server |
[production] |