|
2014-01-21
§
|
| 23:52 |
<awight> |
crm updated from e82d2c5e64e67bee9bfa1f703fc94602addea2cb to f71526fa021fe3963a5d94151881f5a8a5c40dab |
[production] |
| 20:24 |
<cmjohnson1> |
removing iptable rules for loudon and erzurumi |
[production] |
| 20:20 |
<awight> |
updated listeners from dc21b3bf6560402238f9093f1dfbafe22be0a511 to 5e18193c5bb703e44c5cda22009ca97c295973e3 |
[production] |
| 20:06 |
<awight> |
updated listeners from 888561ae0ee5a1d5f86da98ab3062f674726717f to dc21b3bf6560402238f9093f1dfbafe22be0a511 |
[production] |
| 19:51 |
<awight> |
updated listeners from 7c5396c5954e28fe58033008a3b34ebf076a39a5 to 888561ae0ee5a1d5f86da98ab3062f674726717f |
[production] |
| 19:42 |
<ori> |
synchronized wmf-config/CommonSettings.php 'Ie9ff56755: Add wmgUniversalLanguageSelectorDefault (2/2)' |
[production] |
| 19:42 |
<ori> |
synchronized wmf-config/InitialiseSettings.php 'Ie9ff56755: Add wmgUniversalLanguageSelectorDefault' |
[production] |
| 19:41 |
<ori> |
updated /a/common to {{Gerrit|Ie9ff56755}}: Add 'wmgUniversalLanguageSelectorDefault' |
[production] |
| 19:17 |
<ori> |
synchronized php-1.23wmf10/extensions/UniversalLanguageSelector/Resources.php 'I05c76e478: Make ext.uls.mediawiki depend upon ext.uls.init' |
[production] |
| 19:08 |
<ori> |
sync-file: mw1206: ssh: connect to host mw1206 port 22: No route to host |
[production] |
| 19:07 |
<ori> |
synchronized php-1.23wmf11/extensions/UniversalLanguageSelector/Resources.php 'I05c76e478: Make ext.uls.mediawiki depend upon ext.uls.init' |
[production] |
| 18:58 |
<awight> |
updated SmashPig to 43a27bd379632792bd7fc3ffc26c859d6dbbe0d6 |
[production] |
| 17:06 |
<demon> |
finished scap: No code updates, just rebuilding all i18n (duration: 58m 29s) |
[production] |
| 16:13 |
<demon> |
started scap: No code updates, just rebuilding all i18n |
[production] |
| 11:59 |
<twkozlowski> |
bits application servers back to normal since around 11:46 UTC |
[production] |
| 11:32 |
<ori> |
bits application server overload due to I71b70d8ee |
[production] |
| 11:25 |
<ori> |
synchronized php-1.23wmf10/extensions/UniversalLanguageSelector 'I71b70d8ee: Add user preference to enable ULS' |
[production] |
| 11:24 |
<ori> |
synchronized php-1.23wmf11/extensions/UniversalLanguageSelector 'I71b70d8ee: Add user preference to enable ULS' |
[production] |
| 08:19 |
<andrewbogott> |
For wikitech labs interface: deployed new servicegroup schema and supporting code; ran maintenance/transitionServiceGroupSchema.php |
[production] |
| 03:47 |
<ori> |
synchronized php-1.23wmf10/extensions/TimedMediaHandler/TimedMediaHandler.hooks.php 'Update TimedMediaHandler for I7a6da6c62' |
[production] |
| 03:46 |
<ori> |
synchronized php-1.23wmf11/extensions/TimedMediaHandler/TimedMediaHandler.hooks.php 'Update TimedMediaHandler for I7a6da6c62' |
[production] |
| 02:50 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at 2014-01-21 02:50:24+00:00 |
[production] |
| 02:29 |
<ori> |
restarting gitblit using new upstart job def (I3f32dedf1) |
[production] |
| 02:28 |
<LocalisationUpdate> |
completed (1.23wmf11) at 2014-01-21 02:28:40+00:00 |
[production] |
| 02:15 |
<LocalisationUpdate> |
completed (1.23wmf10) at 2014-01-21 02:15:20+00:00 |
[production] |
|
2014-01-20
§
|
| 13:51 |
<akosiaris> |
finished virt1000 reinitalization from virt0 |
[production] |
| 13:51 |
<akosiaris> |
started virt1000 reinitialization from virt0 |
[production] |
| 13:44 |
<akosiaris> |
stopped, backed up virt1000 and virt0 and started them up. Preparing for reinitializing virt1000 from virt0 |
[production] |
| 11:13 |
<akosiaris> |
ms-be1003 kernel log show first lockups around Jan 19 06:30 UTC being XFS related. |
[production] |
| 11:00 |
<ori> |
restarting Gitblit on antimony to test upstart script |
[production] |
| 10:58 |
<akosiaris> |
powercycling ms-be1003. Console full of messages BUG: soft lockup - CPU#stuck for #s |
[production] |
| 02:40 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at 2014-01-20 02:40:25+00:00 |
[production] |
| 02:22 |
<LocalisationUpdate> |
completed (1.23wmf11) at 2014-01-20 02:22:28+00:00 |
[production] |
| 02:12 |
<LocalisationUpdate> |
completed (1.23wmf10) at 2014-01-20 02:12:45+00:00 |
[production] |
| 02:12 |
<springle> |
synchronized wmf-config/db-eqiad.php 'repool db1022, db1039 full steam' |
[production] |
| 01:40 |
<springle> |
synchronized wmf-config/db-eqiad.php 'repool db1039, warm up' |
[production] |
|
2014-01-19
§
|
| 18:59 |
<faidon> |
synchronized wmf-config/InitialiseSettings.php 'switch wmgRC2UDPAddress back to ekrem' |
[production] |
| 18:56 |
<faidon> |
updated /a/common to {{Gerrit|I48a026eb8}}: Revert wmgRC2UDPAddress to ekrem |
[production] |
| 18:48 |
<paravoid> |
cr1-sdtpa/cr2-pmtpa: rolling back config to pre-Tampa outage |
[production] |
| 11:01 |
<ori> |
graceful'd apache on antimony to verify Ibd528f8f2 |
[production] |
| 07:11 |
<springle> |
synchronized wmf-config/db-eqiad.php 'depool db1022' |
[production] |
| 07:04 |
<springle> |
xtrabackup clone db1007 to db1039 |
[production] |
| 06:28 |
<springle> |
synchronized wmf-config/db-pmtpa.php 's7 master update' |
[production] |
| 05:01 |
<springle> |
synchronized wmf-config/db-eqiad.php 'promote db1033 s7 master' |
[production] |
| 04:09 |
<ebernhardson> |
cherry-picked security fix to Flow for php-1.23wmf11 |
[production] |
| 03:58 |
<ebernhardson> |
synchronized php-1.23wmf11/extensions/Flow |
[production] |
| 03:19 |
<springle> |
synchronized wmf-config/db-eqiad.php 'depool db1024' |
[production] |
| 03:13 |
<springle> |
synchronized wmf-config/db-eqiad.php 'repool db1028' |
[production] |
| 03:12 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at 2014-01-19 03:12:20+00:00 |
[production] |
| 02:58 |
<p858snake|l> |
[09:59AEST] <bd808> !log Updated kibana to bef3db2 |
[production] |