2451-2500 of 10000 results (26ms)
2016-11-04 §
01:54 <madhuvishy> Manually reimaging labstore2003 (T149870) [production]
01:35 <catrope@tin> Synchronized php-1.29.0-wmf.1/extensions/Thanks: Avoid breakage after Flow uninstallation (duration: 00m 47s) [production]
01:18 <catrope@terbium> scap failed: IOError [Errno 13] Permission denied: u'/srv/mediawiki-staging/wmf-config/ExtensionMessages-1.29.0-wmf.1.php' (duration: 00m 20s) [production]
01:17 <catrope@terbium> Started scap: (no message) [production]
00:58 <Zppix> restarting the bot to deploy T149609 [tools.lolrrit-wm]
00:55 <Zppix> merging and deploying https://gerrit.wikimedia.org/r/#/c/318976/ [tools.lolrrit-wm]
00:48 <catrope@tin> Synchronized dblists/: Disable Flow on enwiki (T148611) (duration: 01m 04s) [production]
2016-11-03 §
23:31 <paladox> forgot to say twentyafterfour helped to fix. [tools.lolrrit-wm]
23:31 <paladox> deploying https://gerrit.wikimedia.org/r/#/c/319705/ again (a more proper fix) [tools.lolrrit-wm]
23:23 <thcipriani@tin> Synchronized php-1.29.0-wmf.1/extensions/EventBus/EventBus.php: SWAT: [[gerrit:319661|Add logging and check for empty JSON encoded body (T148251)]] (duration: 00m 47s) [production]
23:11 <thcipriani@tin> Synchronized portals: SWAT: [[gerrit:319654|Bumping portals to master (T146807)]] (duration: 00m 52s) [production]
23:10 <thcipriani@tin> Synchronized portals/prod/wikipedia.org/assets: SWAT: [[gerrit:319654|Bumping portals to master (T146807)]] (duration: 00m 51s) [production]
22:53 <bd808> Testing stashbot in #wikimedia-bot-gerrit (third time is a charm) [tools.lolrrit-wm]
22:51 <bd808> Testing stashbot in #wikimedia-bot-gerrit [tools.lolrrit-wm]
22:48 <bd808> Testing stashbot in #wikimedia-bot-gerrit []
22:47 <bd808> Restarted to pick up config change for https://github.com/bd808/tools-stashbot/issues/27 [tools.stashbot]
22:16 <ejegg> updated CiviCRM from 4ff64afd1ac10643f1f2c91c4aa7a5535512c33e to bdc2786ddaf09e9f412f97406e3cffb13fcc96a [production]
22:06 <paladox> deploying https://gerrit.wikimedia.org/r/#/c/319705/ to fix bot crashing [tools.lolrrit-wm]
20:52 <Krenair> fixed puppet on 'appservice' instance by 'apt-get install --only-upgrade' on the exim packages [services]
20:43 <Krenair> fixed puppet in 'citoid' instance by removing /var/lib/puppet/state/agent_catalog_run.lock from March [services]
20:33 <urandom> T133395: Enabling unchecked_tombstone_compaction and setting tombstone_threshold = .6 on "local_group_wikipedia_T_parsoid_html".data [production]
20:26 <bblack> codfw cache_text - all nodes v4 and pooled - T131503 [production]
20:10 <bblack> codfw cache_text - all pooled nodes are v4 (2x still depooled-but-upgraded) - T131503 [production]
20:04 <ejegg> enabled donations queue consumer [production]
20:02 <ejegg> disabled donations queue consumer [production]
20:01 <twentyafterfour@tin> rebuilt wikiversions.php and synchronized wikiversions files: all wikis to 1.29.0-wmf.1 [production]
19:32 <ejegg> updated CiviCRM from 954bab421fa3435c5dd1a80f59f657407764b620 to 4ff64afd1ac10643f1f2c91c4aa7a5535512c33e [production]
19:31 <mobrovac> change-prop deploying f107669 [production]
19:28 <twentyafterfour@tin> Synchronized php-1.29.0-wmf.1/extensions/PageImages/includes/ApiQueryPageImages.php: T149849 (duration: 00m 47s) [production]
19:23 <mobrovac> restbase restarting to re-include wikidata domains for T149114 [production]
19:17 <Krenair> <twentyafterfour> !log In order to unblock the train for group2: deploying https://gerrit.wikimedia.org/r/#/c/319643/ refs T149059, T149849 [production]
19:17 <Krenair> restarted [tools.stashbot]
18:46 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:319644|Fix comment refs (T148327)]] (duration: 00m 47s) [production]
18:39 <thcipriani@tin> Synchronized wmf-config: SWAT: [[gerrit:319605|LABS: Enable Map (GeoJSON) data on Commons (T149548)]] (housekeeping only sync) (duration: 00m 50s) [production]
18:33 <thcipriani@tin> Synchronized php-1.29.0-wmf.1/extensions/Kartographer/includes/ApiQueryMapData.php: SWAT: [[gerrit:319622|Fix warning (T149923)]] (duration: 00m 47s) [production]
18:26 <ema> repooling cp2016 (T131503) [production]
18:21 <thcipriani@tin> Synchronized php-1.28.0-wmf.23/extensions/EventBus/EventBus.php: SWAT: [[gerrit:319586|Log more EventBus HTTP request/response context for HTTP errors (T148251)]] (duration: 00m 52s) [production]
18:19 <thcipriani@tin> Synchronized php-1.29.0-wmf.1/extensions/EventBus/EventBus.php: SWAT: [[gerrit:319587|Log more EventBus HTTP request/response context for HTTP errors (T148251)]] (duration: 00m 49s) [production]
18:02 <hashar> Added security rule for "puppet3-diffs" labs project to allow ssh connection from contint1001 instead of gallium [production]
17:36 <halfak> manually ran "sudo mkdir /srv/log; sudo mkdir /srv/log/ores; sudo service celery-ores-worker restart" on ores-worker-(05|06|07|08|09|10) [ores]
17:23 <halfak> deployed ores-wmflabs-deploy:ffb5dbb [ores]
17:16 <halfak> deployed ores-wmflabs-deploy:ffb5dbb to staging (fixes logging bug) [ores]
17:04 <halfak> deployed ores-wmflabs-deploy:74699db to staging [ores]
16:20 <jynus> stopping and upgrading labsdb1009,10,11 (also disabling temporarily puppet) [production]
16:16 <papaul> OS install on labstore2001 [production]
16:13 <mutante> mw1205 - service hhvm restart [production]
15:59 <jynus@tin> Synchronized wmf-config/db-eqiad.php: mariadb: Reduce db1051 load, it has hardware issues (duration: 00m 47s) [production]
15:41 <moritzm> installing memcached security updates on graphite hosts [production]
15:39 <mobrovac> scb in eqiad enabled puppet back [production]
15:26 <mobrovac> scb in eqiad disabling puppet [production]