5801-5850 of 10000 results (28ms)
2016-10-13 §
14:22 <gilles> Resetting to 61a9cd1f47c5aec8ded92f2486ce43309b9e3e03 on deployment-puppetmaster [releng]
13:42 <gilles> Cherry picking https://gerrit.wikimedia.org/r/#/c/315248/ on deployment-puppetmaster [releng]
2016-10-12 §
13:37 <elukey> upgraded memcached on deployment-memc04 to 1.4.28-1.1+wmf1 as part of a perf experiment (T129963) - rollback: wipe https://wikitech.wikimedia.org/wiki/Hiera:Deployment-prep/host/deployment-memc04, apt-get remove memcached on deployment-memc04, puppet run [releng]
2016-10-11 §
21:39 <hasharAway> Force pushed Zuul patchqueue 5628f95...fc6a118 HEAD -> patch-queue/debian/precise-wikimedia [releng]
14:37 <hashar> Mysql was down on Precise slaves. Apparently rebooted 17 days ago and I guess mysql does not spawn on boot. Restarted mysql on all Precise via: salt -v '*slave-precise*' cmd.run 'start mysql' [releng]
09:35 <godog> reboot deployment-imagescaler01 to enable memory cgroup [releng]
08:29 <hashar> Reloading Zuul to deploy https://gerrit.wikimedia.org/r/#/c/313387/ Filter out refs/meta/config from all pipelines T52389 [releng]
2016-10-10 §
21:41 <Krenair> restarted keyholder-proxy on -tin to make check_keyholder happy with the extra key that was active but unconfigured [releng]
21:11 <Krenair> fixed puppet on -restbase01/-restbase02 by setting up deployment of cassandra/twcs on deployment-tin [releng]
20:56 <Krenair> fixed puppet on -tin/-mira by restarting puppetmaster for base_path scap change [releng]
15:45 <dcausse> deployment-prep deployment-elastic0[5-8]: reduce the number of replicas to 1 max for all indices [releng]
15:44 <dcausse> deployment-elastic0[5-8]: reduce the number of replicas to 1 max for all indices [releng]
2016-10-07 §
20:10 <hashar> Created repository.integration.eqiad.wmflabs to play/Test Sonatype Nexus [releng]
20:10 <hashar> rebooting integration-puppetmaster01 [releng]
07:55 <hashar> Upgrading Nodepool image for Jessie [releng]
2016-10-06 §
14:45 <hashar> deployment-mira disarmed/rearmed keyholder in an attempt to clear a Shinken alarm [releng]
12:16 <hashar> Jenkins slave deployment-tin.eqiad , removing label "deployment-tin.eqiad" it has "BetaClusterBastion" and all jobs are bound to it already [releng]
2016-10-05 §
19:33 <andrewbogott> removing mediawiki::conftool from deployment-mediawiki04, deployment-mediawiki06, deployment-mediawiki05 [releng]
2016-10-04 §
19:43 <andrewbogott> removed contint::slave_scripts and associated files from deployment-sca01 and deployment-sca02 [releng]
16:22 <bd808> Restarted puppetmaster process on deployment-puppetmaster [releng]
16:19 <bd808> deployment-puppetmaster: removing cherry-pick of https://gerrit.wikimedia.org/r/#/c/305256/; conflicts with upstream changes [releng]
15:01 <godog> shutdown deployment-poolcounter02, replaced by deployment-poolcounter04 - T123734 [releng]
09:02 <hashar> Regenerating configuration of all Jenkins job due to https://gerrit.wikimedia.org/r/#/c/313306/ [releng]
01:14 <twentyafterfour> New scap command line autocompletions are now installed on deployment-tin and deployment-mira refs T142880 [releng]
2016-10-03 §
22:40 <thcipriani> manual rebase on deployment-puppetmaster:/var/lib/git/operations/puppet [releng]
22:05 <thcipriani> reapplied beta::deployaccess to mediawiki servers [releng]
21:42 <cscott> updated OCG to version 0bf27e3452dfdc770317f15793e93e6e89c7865a [releng]
21:36 <cscott> starting OCG deploy [releng]
15:40 <Krenair> upgraded cache-upload04 to varnish4. hieradata is set on the prefix deployment-cache-upload [releng]
13:43 <hashar> Added integration-slave-trusty-1014 back in the pool [releng]
13:41 <hashar> Tip of the day: to reboot an instance and bypass molly-guard: /sbin/reboot [releng]
13:39 <hashar> integration-slave-trusty-1014 upgrading packages, clean up and rebooting it [releng]
13:37 <hashar> marked integration-slave-trusty-1014 offline. Cant run job / get stuck somehow [releng]
10:21 <godog> add role::prometheus::node_exporter to classes in hiera:deployment-prep T144502 [releng]
2016-10-01 §
09:41 <hashar> beta: shutdown deployment-db1 and deployment-db2 . Databases have been migrated to other hosts T138778 [releng]
2016-09-29 §
15:43 <hashar> logstash-beta: refreshed the field list via https://logstash-beta.wmflabs.org/app/kibana#/settings/indices/logstash [releng]
13:52 <hashar> Restarted jobrunner / jobchron on deployment-jobrunner02 . Were no more logging to /var/log/mediawiki/ somehow [releng]
10:50 <legoktm> deploying https://gerrit.wikimedia.org/r/313384 [releng]
10:28 <hashar> Upgrading Jenkins plugins with zeljkof :] [releng]
2016-09-28 §
23:56 <MaxSem> Deleted varnish cache files on deployment-cache-upload04 to free up space, disk full [releng]
22:33 <Krenair> Rebooting deployment-ms-be01 - T146947, T141673 [releng]
21:48 <hasharAway> deployment-tin: service nscd restart [releng]
21:42 <hasharAway> beta cluster update database is broken :/ Filled T146947 about it [releng]
21:25 <hasharAway> deployment-tin: sudo -H -u www-data php5 /srv/mediawiki-staging/multiversion/MWScript.php update.php --wiki=commonswiki --quick [releng]
21:18 <hasharAway> https://integration.wikimedia.org/ci/view/Beta/job/beta-update-databases-eqiad/ is broken for unkwnon reason :( [releng]
20:48 <hasharAway> Deleted deployment-tin02 via Horizon. Replaced by deployment-tin [releng]
20:19 <hasharAway> restarted keyholder on deployment-tin [releng]
20:11 <hasharAway> Switch Jenkins slave deployment-mira.eqiad to deployment-tin.eqiad [releng]
20:09 <hasharAway> deployment-tin: keyholder arm [releng]
20:08 <hasharAway> deployment-tin for instance in `grep deployment /etc/dsh/group/mediawiki-installation`; do ssh-keyscan `dig +short $instance` >> /etc/ssh/ssh_known_hosts; done; [releng]