1-50 of 917 results (12ms)
2017-09-13 §
15:34 <bd808> Running inbound message purge via clush to @tools-exec [tools]
15:15 <bd808> Running outbound message purge via clush to @tools-exec [tools]
13:57 <bd808> apt-get install nginx-common on tools-static-1[01] [tools]
13:31 <bd808> static down due to apparent nginx package upgrade/config change [tools]
02:10 <bd808> Really disabled puppet on tools-mail [tools]
01:51 <bd808> Nuked all messages in the exim spool on tools-mail [tools]
01:09 <bd808> Removed user WiktCAPT from project [tools]
00:55 <bd808> Archived and then purged /var/spool/exim4/input on tools-mail [tools]
00:47 <bd808> Archived and then purged /var/spool/exim4/msglog on tools-mail [tools]
00:43 <bd808> Stopped exim on tools-mail [tools]
00:43 <bd808> Disabled puppet on tools-mail [tools]
00:15 <chasemp> forced to clean out exim queue as the filesystem used up all inodes [tools]
2017-08-31 §
20:33 <madhuvishy> Updated certs and ran puppet, restarted nginx on tools-proxy-* and tools-static-* (T174611) [tools]
20:25 <madhuvishy> Merging new cert https://gerrit.wikimedia.org/r/#/c/374873/ (T174611) [tools]
20:24 <madhuvishy> Disabling puppet on tools-proxy-* and tools-static-* for star.wmflabs.org SSL cert update (T174611) [tools]
20:23 <madhuvishy> Disabling puppet on tools-proxy-* and tools-static-* for star.wmflabs.org SSL cert update [tools]
2017-08-24 §
19:59 <bd808> restarted nslcd and nscd on tools-bastion-03 [tools]
19:59 <bd808> restarted nslcd and nscd on tools-bastion-02 [tools]
2017-08-22 §
19:20 <andrewbogott> deleted tools-puppetmaster-02, it was replaced a month ago by -01 [tools]
2017-08-12 §
18:38 <chasemp> retart admin webservice [tools]
2017-08-11 §
16:09 <chasemp> qdel -f -j 7441503 [tools]
2017-08-10 §
14:59 <chasemp> 'become stimmberechtigung && restart' && 'become intersect-contribs && restart' [tools]
2017-08-09 §
17:28 <chasemp> webservices restart tools.orphantalk [tools]
2017-08-03 §
00:47 <bd808> tools-bastion-03 not usably responsive to interactive commands; will reboot [tools]
00:00 <bd808> Restarted kube-proxy service on bastion-03 [tools]
2017-08-02 §
16:59 <bd808> Force deleted 6 jobs suck in 'dr' state [tools]
2017-07-31 §
15:28 <chasemp> remove python-keystoneclient from bastion-03 [tools]
2017-07-27 §
23:27 <bd808> Killed python procs owned by sdesabbata on tools-login that were stealing all cpu/io [tools]
21:16 <bd808> Disabled puppet on tools-proxy-01 to test nginx proxy config changes [tools]
16:27 <bd808> Enabled puppet on tools-static-11 [tools]
16:10 <bd808> Disabled puppet on tools-static-11 to test https://gerrit.wikimedia.org/r/#/c/357878 [tools]
2017-07-26 §
22:33 <chasemp> hotpatching an hiera value on tools master to see effects [tools]
2017-07-20 §
19:48 <bd808> Clearing all Eqw state jobs in all queues with: qstat -u '*' | grep Eqw | awk '{print $1;}' | xargs -L1 qmod -cj [tools]
13:54 <andrewbogott> upgrading apache2 on tools-puppetmaster-01 [tools]
04:00 <chasemp> tools-webgrid-lighttpd-1402:~# service nslcd restart && service nscd restart [tools]
03:57 <chasemp> tools-exec-1428:~# service nslcd restart && service nscd restart [tools]
03:57 <bd808> Redtarted cron, nscd, nslcd on tools-cron-01 [tools]
03:45 <chasemp> tools-puppetmaster-01:~# service nslcd restart && service nscd restart [tools]
03:44 <chasemp> tools-puppetmaster-01:~# service nslcd restart && service nscd restart [tools]
03:37 <bd808> Restarted apache on tools-puppetmaster-01 [tools]
2017-07-19 §
23:52 <bd808> Restarted cron on tools-cron-01; toolschecker job showing user not found errors [tools]
21:19 <valhallasw`cloud> Restarted nslcd on tools-bastion-03 (=tools-login); logins seem functional again. [tools]
21:18 <bd808> Forced puppet run and restarted nscd, nslcd on tools-bastion-02 [tools]
2017-07-18 §
19:51 <andrewbogott> enabling puppet on tools-proxy-02. I don't know why it was disabled. [tools]
2017-07-17 §
01:43 <bd808> Uncordoned tools-worker-1020 after it deleted pods with local storage that were filling the entire disk [tools]
01:36 <bd808> Depooling tools-worker-1020 [tools]
2017-07-13 §
21:59 <bd808> Elasticsearch cluster upgraded to 5.3.2 [tools]
21:25 <bd808> Upgrading ElasticSearch cluster for T164842. There will be service interruptions [tools]
17:59 <bd808> Puppet is disabled on tools-proxy-02 with no reason specified. [tools]
17:09 <bd808> Upgraded nginx-common on tools-proxy-02 [tools]