4151-4200 of 10000 results (53ms)
2017-03-06 §
14:37 <addshore@tin> Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:341259|Add a CSP policy to foundationwiki to prevent privacy breach]] T159386 (duration: 00m 39s) [production]
14:23 <addshore@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:341263|Change account creation throttle for idwiki to default (6)]] (duration: 00m 39s) [production]
14:14 <addshore@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:335824|Enable Translation memories multi-DC support]] T132076 2/2 (NOOP) (duration: 00m 42s) [production]
14:13 <addshore@tin> Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:335824|Enable Translation memories multi-DC support]] T132076 1/2 (duration: 00m 50s) [production]
14:05 <addshore@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:341035|Bs.wiktionary namespace changes]] T159538 (duration: 00m 40s) [production]
14:00 <addshore@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: srwikibooks & bswiktionary logos T159534 T159542 2/2 (duration: 00m 39s) [production]
13:58 <addshore@tin> Synchronized static/images/project-logos/: SWAT: srwikibooks & bswiktionary logos T159534 T159542 1/2 (duration: 00m 39s) [production]
13:23 <godog> reenable puppet on graphite2001 [production]
13:07 <marostegui> Deploy ALTER table on db2060 (s6) for the revision table - T159414 [production]
13:07 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2060 - T159414 (duration: 00m 39s) [production]
13:02 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2046 - T159414 (duration: 00m 50s) [production]
12:45 <moritzm> upgrading apache on mw1209-mw1235 [production]
12:44 <moritzm> upgrading apache on graphite* [production]
11:49 <moritzm> installing imagemagick security updates [production]
11:36 <moritzm> upgrading apache on krypton [production]
11:30 <moritzm> upgrading apache on planet.wikimedia.org [production]
11:05 <elukey> reimage the first Hadoop worker node (an1040) to Debian Jessie [production]
10:46 <moritzm> upgrading apache on mediawiki servers in codfw [production]
10:36 <gehel> upgrade to elasticsearch 5.2.2 on relforge cluster - T156150 [production]
10:24 <elukey> (shamefully) replaced /etc/init.d/hadoop-hdfs-datanode script with "exit 0" to prevent the HDFS datanode daemon to start on analytics1028 (broken disk) and leave the rest running (puppet included) - T159632 [production]
10:12 <gehel> postgresql upgrade on maps* (postgresql-9.4 postgresql-9.4-postgis-2.3 postgresql-9.4-postgis-2.3-scripts postgresql-client-9.4 postgresql-client-common postgresql-common postgresql-contrib-9.4) [production]
10:06 <ariel@tin> Finished deploy [dumps/dumps@8521be0]: fix: retries of broken runs could except on uninited var (duration: 00m 01s) [production]
10:06 <ariel@tin> Started deploy [dumps/dumps@8521be0]: fix: retries of broken runs could except on uninited var [production]
09:46 <gehel> postgresql upgrade on maps-test* (postgresql-9.4 postgresql-9.4-postgis-2.3 postgresql-9.4-postgis-2.3-scripts postgresql-client-9.4 postgresql-client-common postgresql-common postgresql-contrib-9.4) [production]
09:14 <ariel@tin> Finished deploy [dumps/dumps@04794df]: move default config into a file and clean up (duration: 00m 02s) [production]
09:14 <ariel@tin> Started deploy [dumps/dumps@04794df]: move default config into a file and clean up [production]
09:09 <gehel> killing stuck tilerator notification on maps-test2001 - T145534 [production]
07:22 <marostegui> Resume pt-table-checksum on plwiki (s2) - T154485 [production]
06:59 <marostegui> Deploy ALTER table on db2046 (s6) for the revision table - T159414 [production]
06:46 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2046 - T159414 (duration: 00m 51s) [production]
02:24 <l10nupdate@tin> ResourceLoader cache refresh completed at Mon Mar 6 02:24:24 UTC 2017 (duration 5m 19s) [production]
02:19 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.14) (duration: 07m 15s) [production]
01:29 <cwd> updated staging civicrm database and triggers [production]
2017-03-05 §
22:23 <Reedy> Generating some more captchas again T159581 [production]
10:19 <elukey> disabled puppet on analytics1028 to avoid puppet to start the HDFS daemon (T159632) [production]
02:24 <l10nupdate@tin> ResourceLoader cache refresh completed at Sun Mar 5 02:24:02 UTC 2017 (duration 5m 20s) [production]
02:18 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.14) (duration: 07m 07s) [production]
2017-03-04 §
16:43 <Reedy> Manually generating even more captchas (going upto 10k total) in screen as reedy on terbium T159581 [production]
16:35 <Reedy> Manually generating some more captchas T159581 [production]
03:28 <legoktm> pausing refreshLinks.php run due to increase in job queue [production]
03:05 <mutante> planet2001 - and this time it just worked and i can't reproduce the issue. install finished. re-adding to puppet, signing certs... [production]
03:00 <mutante> planet2001 - reinstalling once more (T159432) [production]
02:36 <l10nupdate@tin> ResourceLoader cache refresh completed at Sat Mar 4 02:36:25 UTC 2017 (duration 5m 19s) [production]
02:31 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.14) (duration: 12m 10s) [production]
00:52 <mutante> conf2002 - ran "systemctl reset-failed" to fix Icinga alert about broken systemd state due to formerly existing but failed service etcdmirror-eqiad-wmnet. turns out you need this to remove missing units. found on http://serverfault.com/questions/606520/how-to-remove-missing-systemd-units (T131959) [production]
2017-03-03 §
23:23 <RainbowSprinkles> phabricator: restarted apache 1 last time, removed hack [production]
23:19 <mutante> icinga: for special external hosts benefactorevents and eventdonations, "submit passive check result for this host" -> "check_tcp -p 80" to avoid "crit hosts" that just don't respond to ICMP (http://www.htmlgraphic.com/nagios-check-host-without-ping/) [production]
23:12 <RainbowSprinkles> phabricator: restarting apache real quick [production]
22:03 <hashar> rebooting contint2001 [production]
21:54 <hashar> restarting Jenkins [production]