|
2017-03-06
§
|
| 14:59 |
<addshore> |
EU SWAT done |
[production] |
| 14:50 |
<chasemp> |
labnet1001 'service nova-fullstack restart' |
[production] |
| 14:44 |
<addshore@tin> |
Synchronized wmf-config/extension-list-labs: Remove [[gerrit:341121|InterwikiSorting]] and add [[gerrit:341122|Cognate]] to extension-list-labs T150183 T156241 BETA ONLY (duration: 00m 39s) |
[production] |
| 14:42 |
<addshore@tin> |
Synchronized wmf-config/extension-list: [[gerrit:341121|Add InterwikiSorting extension to prod extension-list]] T150183 NOOP (duration: 00m 38s) |
[production] |
| 14:39 |
<addshore@tin> |
Synchronized wmf-config/db-labs.php: SWAT: [[gerrit:341120|Create extension1 db cluster for beta]] T156241 BETA ONLY (duration: 00m 39s) |
[production] |
| 14:37 |
<addshore@tin> |
Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:341259|Add a CSP policy to foundationwiki to prevent privacy breach]] T159386 (duration: 00m 39s) |
[production] |
| 14:23 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:341263|Change account creation throttle for idwiki to default (6)]] (duration: 00m 39s) |
[production] |
| 14:14 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:335824|Enable Translation memories multi-DC support]] T132076 2/2 (NOOP) (duration: 00m 42s) |
[production] |
| 14:13 |
<addshore@tin> |
Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:335824|Enable Translation memories multi-DC support]] T132076 1/2 (duration: 00m 50s) |
[production] |
| 14:05 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:341035|Bs.wiktionary namespace changes]] T159538 (duration: 00m 40s) |
[production] |
| 14:00 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: srwikibooks & bswiktionary logos T159534 T159542 2/2 (duration: 00m 39s) |
[production] |
| 13:58 |
<addshore@tin> |
Synchronized static/images/project-logos/: SWAT: srwikibooks & bswiktionary logos T159534 T159542 1/2 (duration: 00m 39s) |
[production] |
| 13:23 |
<godog> |
reenable puppet on graphite2001 |
[production] |
| 13:07 |
<marostegui> |
Deploy ALTER table on db2060 (s6) for the revision table - T159414 |
[production] |
| 13:07 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Depool db2060 - T159414 (duration: 00m 39s) |
[production] |
| 13:02 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2046 - T159414 (duration: 00m 50s) |
[production] |
| 12:45 |
<moritzm> |
upgrading apache on mw1209-mw1235 |
[production] |
| 12:44 |
<moritzm> |
upgrading apache on graphite* |
[production] |
| 11:49 |
<moritzm> |
installing imagemagick security updates |
[production] |
| 11:36 |
<moritzm> |
upgrading apache on krypton |
[production] |
| 11:30 |
<moritzm> |
upgrading apache on planet.wikimedia.org |
[production] |
| 11:05 |
<elukey> |
reimage the first Hadoop worker node (an1040) to Debian Jessie |
[production] |
| 10:46 |
<moritzm> |
upgrading apache on mediawiki servers in codfw |
[production] |
| 10:36 |
<gehel> |
upgrade to elasticsearch 5.2.2 on relforge cluster - T156150 |
[production] |
| 10:24 |
<elukey> |
(shamefully) replaced /etc/init.d/hadoop-hdfs-datanode script with "exit 0" to prevent the HDFS datanode daemon to start on analytics1028 (broken disk) and leave the rest running (puppet included) - T159632 |
[production] |
| 10:12 |
<gehel> |
postgresql upgrade on maps* (postgresql-9.4 postgresql-9.4-postgis-2.3 postgresql-9.4-postgis-2.3-scripts postgresql-client-9.4 postgresql-client-common postgresql-common postgresql-contrib-9.4) |
[production] |
| 10:06 |
<ariel@tin> |
Finished deploy [dumps/dumps@8521be0]: fix: retries of broken runs could except on uninited var (duration: 00m 01s) |
[production] |
| 10:06 |
<ariel@tin> |
Started deploy [dumps/dumps@8521be0]: fix: retries of broken runs could except on uninited var |
[production] |
| 09:46 |
<gehel> |
postgresql upgrade on maps-test* (postgresql-9.4 postgresql-9.4-postgis-2.3 postgresql-9.4-postgis-2.3-scripts postgresql-client-9.4 postgresql-client-common postgresql-common postgresql-contrib-9.4) |
[production] |
| 09:14 |
<ariel@tin> |
Finished deploy [dumps/dumps@04794df]: move default config into a file and clean up (duration: 00m 02s) |
[production] |
| 09:14 |
<ariel@tin> |
Started deploy [dumps/dumps@04794df]: move default config into a file and clean up |
[production] |
| 09:09 |
<gehel> |
killing stuck tilerator notification on maps-test2001 - T145534 |
[production] |
| 07:22 |
<marostegui> |
Resume pt-table-checksum on plwiki (s2) - T154485 |
[production] |
| 06:59 |
<marostegui> |
Deploy ALTER table on db2046 (s6) for the revision table - T159414 |
[production] |
| 06:46 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Depool db2046 - T159414 (duration: 00m 51s) |
[production] |
| 02:24 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Mon Mar 6 02:24:24 UTC 2017 (duration 5m 19s) |
[production] |
| 02:19 |
<l10nupdate@tin> |
scap sync-l10n completed (1.29.0-wmf.14) (duration: 07m 15s) |
[production] |
| 01:29 |
<cwd> |
updated staging civicrm database and triggers |
[production] |
|
2017-03-04
§
|
| 16:43 |
<Reedy> |
Manually generating even more captchas (going upto 10k total) in screen as reedy on terbium T159581 |
[production] |
| 16:35 |
<Reedy> |
Manually generating some more captchas T159581 |
[production] |
| 03:28 |
<legoktm> |
pausing refreshLinks.php run due to increase in job queue |
[production] |
| 03:05 |
<mutante> |
planet2001 - and this time it just worked and i can't reproduce the issue. install finished. re-adding to puppet, signing certs... |
[production] |
| 03:00 |
<mutante> |
planet2001 - reinstalling once more (T159432) |
[production] |
| 02:36 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Sat Mar 4 02:36:25 UTC 2017 (duration 5m 19s) |
[production] |
| 02:31 |
<l10nupdate@tin> |
scap sync-l10n completed (1.29.0-wmf.14) (duration: 12m 10s) |
[production] |
| 00:52 |
<mutante> |
conf2002 - ran "systemctl reset-failed" to fix Icinga alert about broken systemd state due to formerly existing but failed service etcdmirror-eqiad-wmnet. turns out you need this to remove missing units. found on http://serverfault.com/questions/606520/how-to-remove-missing-systemd-units (T131959) |
[production] |