8901-8950 of 10000 results (45ms)
2016-09-23 §
17:31 <ebernhardson@tin> Synchronized php-1.28.0-wmf.20/extensions/CirrusSearch/includes/CompletionSuggester.php: Add timing marks to narrow down autocomplete timing regression (duration: 18m 43s) [production]
17:04 <mutante> stat1002 - before it was hanging and then fixed due to https://wikitech.wikimedia.org/wiki/Analytics/Cluster/Hadoop/Administration#Fixing_HDFS_mount_at_.2Fmnt.2Fhdfs [production]
17:03 <mutante> stat1002 - starting nagios-nrpe-server [production]
14:55 <jynus> deployed dns update (removing db1010) T129395 [production]
12:20 <moritzm> rearmed keyholder on mira [production]
12:03 <_joe_> rolling restart of mw1280-90, high cpu usage due to memory leaks. [production]
10:16 <moritzm> reimaging mira to jessie (again, previously installer config still pointed to trusty) [production]
10:05 <Amir1> ladsgroup@terbium:~$ mwscript extensions/ORES/maintenance/PopulateDatabase.php --wiki=wikidatawiki (T146461) and for 'trwiki', 'plwiki', 'fawiki', 'nlwiki', 'ruwiki', 'ptwiki' [production]
10:00 <Amir1> ladsgroup@terbium:~$ mwscript extensions/ORES/maintenance/PopulateDatabase.php --wiki=enwiki [production]
09:58 <hashar@tin> Synchronized php-1.28.0-wmf.20/extensions/ORES/includes/Cache.php: No int typehinting (causes jobs to crash) T146461 (duration: 00m 42s) [production]
09:58 <moritzm> rearmed keyholder on mira [production]
09:48 <jynus> disabling alerts and shutting down db1010 in preparation for decommissioning T129395 [production]
09:08 <moritzm> reimaging mira to jessie [production]
09:06 <elukey> reboot eventlog2001.codfw.wmnet for kernel upgrades [production]
08:52 <elukey> upgrading varnishkafka to 1.0.12-1 in cache:misc [production]
08:44 <ema> depooled nginx restart on cp4003 and cp1045 for libssl upgrade [production]
08:30 <elukey> upgrading varnishkafka to 1.0.12-1 in cache:maps [production]
07:33 <elukey> executed 'find /var/log/hhvm/ -type f -user root -exec chown www-data:www-data {} \;' for all the api and appservers to remove/prevent cronspam (root:adm files also related to new reimaged hosts, Rsyslog needs to be configured before hhvm) - T132324 [production]
07:02 <moritzm> rebooting francium for kernel security update [production]
04:03 <aaron@tin> Synchronized php-1.28.0-wmf.20/includes/deferred: 5af1b93db1bb3d14844c55e4e3ed17fe963de551 (duration: 00m 48s) [production]
04:02 <aaron@tin> Synchronized php-1.28.0-wmf.20/includes/libs/rdbms: 5af1b93db1bb3d14844c55e4e3ed17fe963de551 (duration: 00m 51s) [production]
02:46 <l10nupdate@tin> ResourceLoader cache refresh completed at Fri Sep 23 02:46:04 UTC 2016 (duration 6m 10s) [production]
02:39 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.20) (duration: 17m 04s) [production]
02:13 <maxsem@tin> Synchronized php-1.28.0-wmf.20/extensions/SecurePoll/: https://gerrit.wikimedia.org/r/#/c/312450/1 (duration: 00m 51s) [production]
02:10 <mutante> mw1206, mw1224 - restarted hhvm and apache [production]
01:49 <bblack> depooled mw1224 service apache2 [production]
00:38 <Krenair> mw1224 apache stuck, not restarting for now in case someone wants to investigate later. possibly T89912? [production]
00:17 <krenair@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/312339 (duration: 00m 48s) [production]
00:16 <krenair@tin> Synchronized wmf-config/mobile.php: https://gerrit.wikimedia.org/r/312339 (duration: 00m 47s) [production]
00:08 <krenair@tin> Synchronized php-1.28.0-wmf.20/extensions/FlaggedRevs/business/RevisionReviewForm.php: https://gerrit.wikimedia.org/r/#/c/312423/ (duration: 00m 48s) [production]
2016-09-22 §
23:46 <krenair@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/310483 (duration: 00m 48s) [production]
23:19 <krenair@tin> Synchronized php-1.28.0-wmf.20/resources/src/mediawiki.less/mediawiki.ui/mixins.less: https://gerrit.wikimedia.org/r/#/c/312340/ (duration: 00m 48s) [production]
22:49 <aaron@tin> Synchronized php-1.28.0-wmf.20/includes/libs/rdbms/loadbalancer/LoadBalancer.php: a73a7ef9286275f797411646f9c5af60d4894c73 (duration: 01m 04s) [production]
22:18 <mutante> added slaporte and zhousquared to wmf LDAP group (T146227) [production]
21:24 <hasharAway> Nodepool is all back and operational. Reduced amount of queries to the OpenStack API by more than 10% [production]
21:14 <yurik> deployed tilerator https://gerrit.wikimedia.org/r/#/c/312329/ [production]
21:05 <hasharAway> stopped nodepooled and restarted it with 0.1.1-wmf5 [production]
21:04 <mutante> upgradede nodepool to 0.1.1-wmf5 on labnodepool1001 [production]
21:04 <mutante> upgradede nodepool to 0.1.1-wmf on labnodepool1001 [production]
21:04 <krinkle@tin> Synchronized php-1.28.0-wmf.20/resources/src/mediawiki/mediawiki.js: T146099 (duration: 00m 48s) [production]
21:02 <mutante> imported nodepool_0.1.1-wmf5_amd64 into jessie-wikimedia (T145142) [production]
20:52 <urandom> T133395: RESTBase Staging: starting dumps (3, eqiad) [production]
20:47 <urandom> T133395: RESTBase Staging: altering table to set TWCS on wikipedia parsoid.html table [production]
20:20 <urandom> T133395: RESTBase Staging: Restarting Cassandra to pick up TWCS jar in classpath [production]
20:08 <thcipriani@tin> rebuilt wikiversions.php and synchronized wikiversions files: all wikis to 1.28.0-wmf.20 [production]
20:00 <thcipriani> rolling out wmf.20 to all wikis [production]
19:23 <SMalyshev> Deploying new version of WDQS GUI [production]
19:09 <thcipriani@tin> rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.28.0-wmf.20 [production]
19:01 <thcipriani> wmf.20 to group1 will watch until 20 UTC and move forward to all wikis [production]
18:56 <thcipriani@tin> Synchronized php-1.28.0-wmf.18/extensions/CentralNotice: SWAT: [[gerrit:312292|Update extensions/CentralNotice submodule (T144952)]] (duration: 00m 50s) [production]