|
2013-11-05
§
|
| 03:45 |
<gwicke> |
rolled back Parsoid deployment to cdbfdbb28ba2 |
[production] |
| 03:14 |
<gwicke> |
update Parsoid to 05aa83f52cecda3 to work around Vary: Accept-Encoding issue in production |
[production] |
| 03:08 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Tue Nov 5 03:08:30 UTC 2013 |
[production] |
| 02:30 |
<LocalisationUpdate> |
completed (1.23wmf1) at Tue Nov 5 02:30:26 UTC 2013 |
[production] |
| 02:16 |
<LocalisationUpdate> |
completed (1.23wmf2) at Tue Nov 5 02:16:42 UTC 2013 |
[production] |
| 02:00 |
<Jeff_Green> |
stopped mysql on db1008 to clone another |
[production] |
| 01:57 |
<gwicke> |
deployed Parsoid f416b8240e74e286 |
[production] |
| 01:04 |
<RobH> |
virt0 port saturated at 23:42 (recordkeeping for outage investigation) |
[production] |
| 01:02 |
<mutante> |
replaced SSL certs on Bugzilla with new ones that are not star.wm |
[production] |
| 00:46 |
<springle> |
running master/slave pt-table-sync on archive tables with 1M+ rows |
[production] |
| 00:20 |
<Reedy> |
Test |
[production] |
|
2013-11-04
§
|
| 23:24 |
<ori> |
synchronized php-1.23wmf2/resources/mediawiki/mediawiki.inspect.js 'Ib2252003f2: mediawiki.inspect#dumpTable: fix broken FF workaround' |
[production] |
| 23:12 |
<csteipp> |
synchronized php-1.23wmf1/includes 'bug 55332' |
[production] |
| 23:11 |
<csteipp> |
synchronized php-1.23wmf2/includes 'bug 55332' |
[production] |
| 22:39 |
<mwalker> |
synchronized php-1.23wmf2/skins/vector/ 'Deploying fix for bug 56366 : https://gerrit.wikimedia.org/r/#/c/93408/' |
[production] |
| 22:39 |
<mwalker> |
synchronized php-1.23wmf1/skins/vector/ 'Deploying fix for bug 56366 : https://gerrit.wikimedia.org/r/#/c/93408/' |
[production] |
| 22:22 |
<mwalker> |
synchronized wmf-config/CommonSettings.php 'Enabling cross wiki banner hiding for CentralNotice' |
[production] |
| 22:17 |
<mwalker> |
synchronized php-1.23wmf2/resources/mediawiki/mediawiki.inspect.js 'Pushing https://gerrit.wikimedia.org/r/#/c/93587/' |
[production] |
| 22:15 |
<mwalker> |
synchronized php-1.23wmf2/extensions/CentralNotice/ 'Updating CentralNotice to master - mobile redirects and cross wiki hiding' |
[production] |
| 22:15 |
<mwalker> |
synchronized php-1.23wmf1/extensions/CentralNotice/ 'Updating CentralNotice to master - mobile redirects and cross wiki hiding' |
[production] |
| 22:07 |
<MaxSem> |
Reindexing GeoData |
[production] |
| 21:44 |
<cmjohnson1> |
dns update |
[production] |
| 21:44 |
<hashar> |
on mediawiki/core.git deleted and retagged 1.22.0rc0 (same commit: c00622b7f6f207f1a2056d47437a5b1891b490a7 ) |
[production] |
| 21:29 |
<mutante> |
schedule icinga downtime/disable notifications for db3[29] db4[2-6] db5[1235689] |
[production] |
| 21:00 |
<cmjohnson1> |
dns update |
[production] |
| 20:51 |
<reedy> |
synchronized php-1.23wmf2/extensions/Echo 'bug 56521' |
[production] |
| 20:34 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: Non wikipedias to 1.23wmf2 |
[production] |
| 20:29 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Enable BetaFeatures and friends on mediawikiwiki and testwikidatawiki' |
[production] |
| 20:22 |
<Reedy> |
Created BetaFeatures tables on mediawikiwiki and testwikidatawiki |
[production] |
| 20:19 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: mediawikiwiki and testwikidatawiki to 1.23wmf2 |
[production] |
| 19:58 |
<mutante> |
restarted gitblit on antimony |
[production] |
| 19:48 |
<gwicke> |
updated Parsoid to d7b556f25353 |
[production] |
| 18:47 |
<awight> |
updated crm from 272966e353244e668a64c54ca4fa6f344079f4bf to 8d9240fea273faf434881a16d894ef0ad6c616c0 |
[production] |
| 18:30 |
<mark> |
Configured cr1-esams and cr2-knams for new LVS service IP range 91.198.174.192/27 |
[production] |
| 18:25 |
<aaron> |
synchronized php-1.23wmf2/maintenance/cleanupUploadStash.php 'f3332a3d932c6919b3311d89edee20f886e4e86e' |
[production] |
| 17:58 |
<awight> |
rollback crm to 272966e353244e668a64c54ca4fa6f344079f4bf |
[production] |
| 17:57 |
<awight> |
updated crm from 272966e353244e668a64c54ca4fa6f344079f4bf to 63de2d6b8bc92d6c2130a242ff4995ba71b5ce11 |
[production] |
| 17:49 |
<mark> |
Deactivated ae1.101 on cr1-esams and cr2-knams |
[production] |
| 16:42 |
<cmjohnson1> |
dns update |
[production] |
| 16:31 |
<mark> |
Disabled multicast routing between eqiad and pmtpa, setup udpmcast between chromium and dobson instead |
[production] |
| 14:44 |
<mark> |
Disabled multicast traffic reduction on csw1-sdtpa |
[production] |
| 14:41 |
<akosiaris> |
removed LACP configuration from asw-b-eqiad for palladium and set it to standard access-port and private1-b-eqiad vlan |
[production] |
| 14:41 |
<akosiaris> |
removed LACP configuration from asw-a-eqiad for strontium and set it to standard access-port and private1-a-eqiad vlan |
[production] |
| 14:24 |
<mark> |
Killed udpmcast on chromium |
[production] |
| 14:13 |
<mark> |
Configured OSPF/OSPF3 on cr1-eqiad:xe-4/2/2 <--> cr2-knams:xe-1/1/0 |
[production] |
| 13:01 |
<hashar> |
Jenkins upgrading gearman (0.0.4 -> 0.0.5) plugin on gallium from http://repo.jenkins-ci.org/repo/org/jenkins-ci/plugins/gearman-plugin/0.0.5/ |
[production] |
| 11:22 |
<mark> |
multicast routing to pmtpa restored for now |
[production] |
| 10:52 |
<mark> |
Deactivated BFD on flapping link ae0 between cr1-eqiad and cr2-eqiad |
[production] |
| 10:47 |
<mark> |
Deactivated anycast PIM RP on cr2-eqiad |
[production] |
| 10:21 |
<mark> |
Reenabled 10G wave between cr2-eqiad and cr1-sdtpa, set high OSPF metrics instead |
[production] |