9801-9850 of 10000 results (57ms)
2015-12-07 §
09:13 <jynus> es1013 maintenance (mysql restart, upgrade, possible reboot) [production]
08:27 <_joe_> uploaded etcd 2.2 package from stretch to jessie-wikimedia [production]
04:24 <bd808> The ip address in jenkins for ci-jessie-wikimedia-10306 now belongs to an instance named future-wikipedia.reading-web-staging.eqiad.wmflabs (obviously the config is wrong) [releng]
04:12 <bd808> ci-jessie-wikimedia-10306 down and blocking many zuul queues [releng]
03:56 <l10nupdate@tin> ResourceLoader cache refresh completed at Mon Dec 7 03:56:49 UTC 2015 (duration 1h 32m 22s) [production]
02:24 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.7) (duration: 09m 59s) [production]
2015-12-06 §
21:48 <ori> krypton unresponsive, nothing on console. shutting down, increasing instance ram from 2 to 4g, and rebooting. [production]
21:01 <Luke081515> Enable rcm-5, try to replicate phabricator update issue with puppet [rcm]
21:00 <Luke081515> deleted rcm-3 (Not needed) [rcm]
18:49 <legoktm> reset auth token for User:QuimGil [production]
10:29 <YuviPanda> did webservice start on tool 'derivative', was missing service.manifest [tools]
05:50 <mutante> silver gzip /var/log/nutcracker.log.1 [production]
05:40 <mutante> silver: apt-get clean for disk space [production]
03:57 <l10nupdate@tin> ResourceLoader cache refresh completed at Sun Dec 6 03:57:02 UTC 2015 (duration 1h 31m 41s) [production]
02:25 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.7) (duration: 10m 04s) [production]
2015-12-05 §
18:30 <gwicke> started nodetool decommission on restbase1008 [production]
11:35 <reedy@tin> Synchronized wmf-config/CommonSettings.php: Disable common password password policy to come in wmf.8 (duration: 00m 28s) [production]
11:23 <reedy@tin> Purged l10n cache for 1.27.0-wmf.5 [production]
11:22 <reedy@tin> Synchronized php-1.27.0-wmf.7/extensions/WikimediaMaintenance/refreshMessageBlobs.php: Less waiting for slaves (duration: 00m 28s) [production]
11:13 <reedy@tin> Synchronized docroot and w: Add jobqueue-labs to noc (duration: 00m 28s) [production]
08:59 <bblack> offlined db1019 megacli disk 32:11 [production]
06:09 <l10nupdate@tin> ResourceLoader cache refresh completed at Sat Dec 5 06:09:07 UTC 2015 (duration 3h 44m 18s) [production]
02:24 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.7) (duration: 09m 59s) [production]
2015-12-04 §
21:44 <andrewbogott> disabling puppet on labcontrol1002 for ldap testing [production]
21:36 <ori@tin> Synchronized php-1.27.0-wmf.7/includes/Hooks.php: Iba0138a: Don't install a custom error handler for hooks (T117553) (duration: 00m 28s) [production]
20:28 <ori@tin> Synchronized wmf-config/jobqueue-eqiad.php: Idee6a1980: job queue: use instances on port 6378 as aggregators (duration: 00m 30s) [production]
19:33 <Coren> switching master role to tools-grid-master [tools]
19:24 <MaxSem> bumped portals [releng]
19:21 <ori> krypton: updated Grafana to 2.6.0-beta1 for bug fix for issue 3422 [production]
15:52 <Jeff_Green> add mx record for donate.wikimedia.org [production]
15:33 <godog> ms-be2019 rebooted by itself, ilo event log shows "Uncorrectable Machine Check Exception (Board 0, Processor 2, APIC ID 0x00000038, Bank 0x00000003, Status 0xFE000040'00020135, Address 0x00000000'FEB82F63, Misc 0x00000000'00002285)" [production]
09:15 <hashar> salt --show-timeout '*' cmd.run 'rm -fR /mnt/jenkins-workspace/workspace/mwext-qunit/src/skins/*' ( https://phabricator.wikimedia.org/T120349 ) [releng]
08:52 <godog> reimage restbase1009 [production]
05:59 <gwicke> ran systemctl mask cassandra on restbase1009; it is important that this node does not start up. [production]
05:53 <gwicke> moved /var/lib/cassandra out of the way in an attempt to stop puppet restarting cassandra on decommissioned restbase1009 [production]
05:49 <l10nupdate@tin> ResourceLoader cache refresh completed at Fri Dec 4 05:49:46 UTC 2015 (duration 3h 21m 36s) [production]
04:42 <YuviPanda> disabled puppet on tools-puppetmaster-01 because everything sucks [tools]
04:09 <bd808> Cherry-picked https://gerrit.wikimedia.org/r/#/c/256618 to tools-puppetmaster-01 [tools]
02:28 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.7) (duration: 10m 19s) [production]
02:15 <ori> CirrusSearch-common.php sync was for I826d000ca: Turn off backoff throttling of CirrusSearch jobs [production]
02:15 <ori@tin> Synchronized wmf-config/CirrusSearch-common.php: (no message) (duration: 00m 29s) [production]
01:33 <bd808> Updated scholarships.wikimedia.org to af73bf6 [production]
00:35 <catrope@tin> Synchronized php-1.27.0-wmf.7/extensions/CentralNotice: SWAT (duration: 00m 32s) [production]
2015-12-03 §
23:53 <marxarelli> Reloading Zuul to deploy If60f720995dfc7859e53cf33043b5a21b1a4b085 [releng]
23:39 <jzerebecki> reloading zuul for c078000..f934379 [releng]
23:11 <wikibugs> Updated channels.yaml to: 74f9c1e0e07d47abc0ca706040faaf90b1ea585d Add PAWS to pywikibot and labs channels [tools.wikibugs]
23:09 <bblack> restarting pybal (w/ BGP enabled) on lvs100[123] (newly-installed w/ jessie) [production]
22:59 <ori@tin> Synchronized php-1.27.0-wmf.7/includes/jobqueue/JobRunner.php: temporarily disable job throttling (duration: 00m 29s) [production]
22:08 <bd808> Removed zirconium.wikimedia.org from Trebuchet minions list for scholarships/scholarships [production]
22:04 <bd808> Updated scholarships.wikimedia.org to cb94319 plus local i18n filtering [production]