|
2015-01-13
§
|
| 18:38 |
<ori> |
Synchronized wmf-config/StartProfiler.php: xenon: Skip frames that don't have a 'phpStack' key (duration: 00m 06s) |
[production] |
| 17:39 |
<hashar> |
Zuul back in action. Got recheck or +2 again the changes that have been discarded. |
[production] |
| 17:37 |
<hashar> |
Restarting deadlocked Zuul , which drops ALL events. Reason is Gerrit lost connection with its database which is not handled by Zuul . See https://wikitech.wikimedia.org/wiki/Incident_documentation/20150106-Zuul |
[production] |
| 16:12 |
<demon> |
Synchronized wmf-config/: (no message) (duration: 00m 05s) |
[production] |
| 16:12 |
<demon> |
Synchronized flaggedrevs.dblist: (no message) (duration: 00m 05s) |
[production] |
| 16:02 |
<YuviPanda> |
restart mysql on virt1000, wikitech acting up again |
[production] |
| 15:23 |
<godog> |
upgrade and restart poolcounter on helium |
[production] |
| 15:17 |
<godog> |
upload poolcounter 1.0.3 to precise-wikimedia |
[production] |
| 15:17 |
<YuviPanda> |
restarted mysql on virt1000, wikitech failing with db errors. seems fine now (4 minutes ago) |
[production] |
| 15:17 |
<YuviPanda> |
test |
[production] |
| 15:14 |
<_joe_> |
jobrunners 100% on HHVM |
[production] |
| 15:14 |
<_joe_> |
reimaging mw1007 mw1008 |
[production] |
| 14:36 |
<bblack> |
ssl runtime config updated for +3DES/-RC4 ( I87616455abd58c986aa960348fc20c017f097716 ) |
[production] |
| 14:07 |
<_joe_> |
reimaging mw1005,mw1006 |
[production] |
| 13:45 |
<Jeff_Green> |
package updates and reboots on many fundraising hosts |
[production] |
| 11:30 |
<_joe_> |
reimaging mw1003, mw1004 |
[production] |
| 11:30 |
<springle> |
Synchronized wmf-config/db-eqiad.php: repool db1067, warm up (duration: 00m 05s) |
[production] |
| 11:20 |
<springle> |
upgrade db1067 trusty |
[production] |
| 10:30 |
<hoo> |
Set email for global account "Liberipedia" as per https://phabricator.wikimedia.org/T76321 |
[production] |
| 10:19 |
<_joe_> |
reimaging mw1001, mw1002 |
[production] |
| 10:02 |
<_joe_> |
net.ipv4.tcp_tw_reuse = 1 on mw1223 |
[production] |
| 08:58 |
<_joe_> |
raising the net.ipv4.ip_local_port_range on mw1196 |
[production] |
| 08:43 |
<_joe_> |
raising the net.ipv4.ip_local_port_range on mw1230 |
[production] |
| 07:30 |
<springle> |
ongoing schema changes T86415 externallinks, codfw first |
[production] |
| 04:55 |
<springle> |
Synchronized wmf-config/db-eqiad.php: depool db1067 (duration: 00m 05s) |
[production] |
| 04:07 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Tue Jan 13 04:07:54 UTC 2015 (duration 7m 52s) |
[production] |
| 02:29 |
<LocalisationUpdate> |
completed (1.25wmf14) at 2015-01-13 02:29:21+00:00 |
[production] |
| 02:29 |
<l10nupdate> |
Synchronized php-1.25wmf14/cache/l10n: (no message) (duration: 00m 03s) |
[production] |
| 02:17 |
<LocalisationUpdate> |
completed (1.25wmf13) at 2015-01-13 02:17:08+00:00 |
[production] |
| 02:17 |
<l10nupdate> |
Synchronized php-1.25wmf13/cache/l10n: (no message) (duration: 00m 03s) |
[production] |
| 00:45 |
<ori> |
Finished scap: Updates to MobileFrontend, CentralAuth, EventLogging and WikimediaEvents (duration: 06m 27s) |
[production] |
| 00:38 |
<ori> |
Started scap: Updates to MobileFrontend, CentralAuth, EventLogging and WikimediaEvents |
[production] |
|
2015-01-12
§
|
| 23:06 |
<ejegg> |
updated crm from d8a1160bca99354a856b1595cedf5c33f9ac255c to bb05adf9279bd7a795906ca476e1850a85c21711 |
[production] |
| 21:39 |
<hoo> |
Set email for global account "Carol.Christiansen" after having it confirmed by a steward and a dewiki bureaucrat (also based on old OTRS records) |
[production] |
| 21:12 |
<subbu> |
deployed parsoid version 2cd6fefa |
[production] |
| 18:48 |
<hoo> |
Ran sync-common on osmium |
[production] |
| 18:21 |
<mutante> |
purging 'mlocate' package from neon as well to fix Icinga DPKG crits |
[production] |
| 18:04 |
<bd808> |
Deployed scholarships at hash a5bc6fd |
[production] |
| 18:04 |
<demon> |
Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 06s) |
[production] |
| 18:03 |
<demon> |
Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 08s) |
[production] |
| 18:01 |
<bd808> |
Applied 2015 schema changes to scholarships database on m2-master |
[production] |
| 17:33 |
<hoo> |
mw1010: rsync: failed to set times on "/srv/mediawiki/.": Read-only file system (30) |
[production] |
| 17:31 |
<hoo> |
Synchronized php-1.25wmf13/extensions/CentralAuth/: Only test passwords once in CentralAuthUser::prepareMigration - 2nd try (duration: 00m 07s) |
[production] |
| 17:31 |
<hoo> |
Synchronized php-1.25wmf14/extensions/CentralAuth/: Only test passwords once in CentralAuthUser::prepareMigration (duration: 00m 06s) |
[production] |
| 17:31 |
<hoo> |
Synchronized php-1.25wmf13/extensions/CentralAuth/: Only test passwords once in CentralAuthUser::prepareMigration (duration: 00m 06s) |
[production] |
| 17:22 |
<mutante> |
restarted icinga-wm to join -releng |
[production] |
| 17:02 |
<mutante> |
labmon1001 - purging mlocate package that was status 'rc' |
[production] |
| 16:30 |
<godog> |
stop/start graphite-web on tungsten to clear logs |
[production] |
| 16:28 |
<bd808> |
deleted 2014-01-* and 2015-12-* indices from logstash elasticsearch cluster |
[production] |
| 16:13 |
<bd808> |
logs on logstash1001 reporting elasticserch connection errors; restarted logstash service |
[production] |