7151-7200 of 10000 results (35ms)
2016-07-07 §
02:43 <MaxSem> started redis-server on deployment-stream [releng]
01:14 <bd808> Restarted logstash on deployment-logstash2 [releng]
01:12 <MaxSem> Leaving my hacks for the night to collect data, if needed revert with cd /srv/mediawiki-staging/php-master/vendor && sudo git reset --hard HEAD && sudo chown -hR jenkins-deploy:wikidev . [releng]
00:50 <bd808> Rebooting deployment-logstash3.eqiad.wmflabs; console full of hung process messages from kernel [releng]
00:27 <MaxSem> Initialized ORES on all wikis where it's enabled, was causing job failures [releng]
00:13 <MaxSem> Debugging a fatal in betalabs, might cause syncs to fail [releng]
2016-07-06 §
20:30 <hashar> beta: restarted mysql on both db1 and db2 so it takes in account the --syslog setting T119370 [releng]
20:08 <hashar> beta: on db1 and db2 move the MariaDB 'syslog' setting under [mysqld_safe] section. Cherry picked https://gerrit.wikimedia.org/r/#/c/296713/3 and reloaded mysql on both instances. T119370 [releng]
14:54 <hashar> Image ci-jessie-wikimedia-1467816381 in wmflabs-eqiad is ready T133779 [releng]
14:47 <hashar_> attempting to refresh ci-jessie-wikimedia image to get librdkafka-dev included for T133779 [releng]
2016-07-05 §
21:54 <hasharAway> CI has drained the gate-and-submit queue [releng]
21:37 <hasharAway> Nodepool: nodepool delete a few instances that would never spawn / have been stuck for ~ 40 minutes [releng]
2016-07-04 §
18:58 <hashar> Upgrading arcanist on permanent CI slaves since xhpast was broken T137770 [releng]
12:50 <yuvipanda> migrating deployment-tin to labvirt1011 [releng]
2016-07-03 §
13:10 <paladox> phabricator Update phab-01 and phab-05 (phab-02) and phab-03 to fix a security bug in phabricator (Did the update last night but forgot to log it) [releng]
12:04 <jzerebecki> reloading zuul for 7e6a2e2..13ea50f [releng]
2016-07-02 §
13:37 <jzerebecki> reloading zuul for 15127b2..7e6a2e2 [releng]
2016-06-30 §
10:31 <hashar> Deleting integration-slave-trusty-1015 . Can not bring up mysql T138074 and the ssh slave connection would not hold anyway. Must be broken somehow [releng]
10:04 <hashar> Attempting to refresh Nodepool image for Jessie ( ci-jessie-wikimedia ). Been stall for 284 hours (12 days) [releng]
09:36 <hashar> Trusty is missing the package arcanist ... :( [releng]
09:35 <hashar> Attempting to refresh Nodepool image for Trusty ( ci-trusty-wikimedia ). Been stall for 283 hours (12 days) [releng]
2016-06-28 §
21:33 <halfak> deploying ores beec291 [releng]
21:15 <halfak> deploying ores 6979a98 [releng]
2016-06-27 §
22:32 <eberhardson> deployment-prep deployed gerrit.wikimedia.org/r/296279 to puppetmaster to test kibana4 role [releng]
19:41 <bd808> Rebooting deployment-logstash3.eqiad.wmflabs via wikitech. Console log full of blocked kworker messages, ssh non-responsive, and blocking logstash records being recorded. [releng]
18:20 <thcipriani> deployment-puppetmaster.deployment-prep:/var/lib/git/labs/private modules/secret/secrets/keyholder keys conflicts resolved [releng]
18:09 <bd808> Git repo at deployment-puppetmaster.deployment-prep:/var/lib/git/labs/private is behind upstream due to multiple modules/secret/secrets/keyholder local files that would be overwritten by upstream changes. [releng]
2016-06-24 §
15:04 <hashar> switch apps-android-wikimedia-* jobs to Jessie T138506 [releng]
14:07 <James_F> Killed https://integration.wikimedia.org/ci/job/pywikibot-core-tox-nose-jessie/556/console (stuck for 90 minutes) [releng]
09:54 <hashar> T138506 Adding a JDK installation "Debian - OpenJdk 8" in Jenkins global configuration with JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 [releng]
2016-06-23 §
13:58 <Krinkle> Reloading Zuul to deploy https://gerrit.wikimedia.org/r/295691 [releng]
12:13 <hashar> Deleting integration-saltmaster and recreating it with Jessie T136410 [releng]
10:14 <hashar> T137807 Upgrading Jenkins TAP Plugin [releng]
08:55 <hashar> integration: rebased puppet master by dropping a conflicting/obsolete patch [releng]
08:28 <hashar> fixing puppet cert on deployment-cache-text04 [releng]
2016-06-17 §
10:35 <jzerebecki> offlined integration-slave-trusty-1015 T138074 [releng]
10:06 <hashar> Refreshed Nodepool Trusty image [releng]
10:02 <hashar> Refreshed Nodepool Jessie image [releng]
2016-06-14 §
14:22 <hashar> T136971 on tin MediaWiki 1.28.0-wmf.6, from 1.28.0-wmf.6, successfully checked out. Applying security patches [releng]
11:21 <hashar> T137797 Created Gerrit repository operations/debs/geckodriver to package https://github.com/mozilla/geckodriver [releng]
2016-06-13 §
21:11 <hashar> https://integration.wikimedia.org/ci/computer/integration-slave-trusty-1015/ put offline. Jenkins cant ssh / pool it for some reason [releng]
20:07 <hashar> beta: update.php / database update finally pass! [releng]
19:55 <hashar> T137615 deployment-db2, **eswiki** > CREATE INDEX echo_notification_event ON echo_notification (notification_event); [releng]
19:22 <hashar> T137615 deployment-db2, enwiki > CREATE INDEX echo_notification_event ON echo_notification (notification_event); [releng]
10:37 <hashar> Restarted puppetmaster on integration-puppetmaster (memory leak / can not fork: no memory) [releng]
10:35 <hashar> T137561 salt -v '*trusty*' cmd.run "cd /root/ && dpkg -i firefox_46.0.1+build1-0ubuntu0.14.04.3_amd64.deb" [releng]
10:23 <hashar> Hard reboot integration-slave-trusty-1015 [releng]
08:30 <hashar> Beta: `mwscript extensions/Echo/maintenance/removeInvalidTargetPage.php --wiki=enwiki` for T137615 [releng]
2016-06-10 §
15:49 <jzerebecki> reloading zuul for 8c048fb..272d1ec [releng]
15:29 <jzerebecki> T137561 integration-puppetmaster:/var/lib/git/operations/puppet# git reset --hard 1e1ff12b13b73b5c5e2015a72f51561f10b305d0 [releng]