|
2015-06-22
ยง
|
| 22:45 |
<gwicke> |
restarting Cassandra on restbase1005 to get the metrics back |
[production] |
| 22:37 |
<gwicke> |
restarting Cassandra on restbase1004 to get the metrics back |
[production] |
| 22:33 |
<gwicke> |
restarting Cassandra on restbase1003 to get the metrics back |
[production] |
| 22:24 |
<gwicke> |
restarting Cassandra on restbase1002 to get the metrics back |
[production] |
| 22:23 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/219603 |
[releng] |
| 22:19 |
<bd808> |
scap error "@ERROR: access denied to common from localhost (127.0.0.1)" from mw2187 and mw2080 on sync-file test. |
[production] |
| 22:17 |
<bd808> |
Synchronized README: Testing sync-file after scap update (duration: 00m 12s) |
[production] |
| 22:08 |
<RoanKattouw> |
Deployed patch for T103054 |
[production] |
| 21:59 |
<godog> |
reboot restbase1008 |
[production] |
| 21:58 |
<andrewbogott> |
re-enabling puppet on deployment-videoscaler01 because no reason was given for disabling |
[releng] |
| 21:56 |
<bd808> |
updated scap to 81b7c14 (Move dsh group file names to config) |
[production] |
| 21:55 |
<bd808> |
trebuchet checkout for scap/scap failed on 23 hosts: mw1104, mw1222, mw2009, mw2011, mw2021, mw2028, mw2031, mw2034, mw2069, mw2076, mw2080, mw2086, mw2095, mw2099, mw2120, mw2127, mw2131, mw2136, mw2170, mw2187, mw2189, mw2197, virt1000 |
[production] |
| 21:50 |
<bd808> |
trebuchet fetch for scap/scap failed on mw2086.codfw.wmnet, mw1222.eqiad.wmnet and virt1000.wikimedia.org |
[production] |
| 21:47 |
<bd808> |
scap emitting soft failures due to missing python-netifaces on deployment-videoscaler01; should be fixed by a current puppet run |
[releng] |
| 21:41 |
<gwicke> |
restarting Cassandra on restbase1001 to get the metrics back |
[production] |
| 21:37 |
<bd808> |
Updated scap to 81b7c14 (Move dsh group file names to config) |
[releng] |
| 21:20 |
<ori> |
Depooled mw1170-mw1175 and mw1270-mw1275 for testing Idddcfe46 |
[production] |
| 21:07 |
<chasemp> |
rebooting mw1101 the hard way |
[production] |
| 20:42 |
<cscott> |
updated OCG to version b482144f5bd8b427bcc64a3dd287247195aa1951 |
[releng] |
| 20:28 |
<cscott> |
updated Parsoid to version d488783e |
[production] |
| 19:34 |
<akosiaris> |
delete pad:ips from etherpad |
[production] |
| 19:01 |
<jynus> |
rebooting es1002 |
[production] |
| 18:52 |
<ori> |
Synchronized php-1.26wmf10/includes/OutputPage.php: I0e5f2d3b2: Construct clean canonical URLs for wiki pages, ignoring request URL (T67402) (duration: 00m 14s) |
[production] |
| 18:01 |
<legoktm> |
live-hacking mw1017 to debug T103053 |
[production] |
| 17:49 |
<mutante> |
Bugzilla has left the building |
[production] |
| 16:31 |
<jynus> |
reseting wikitech-static mysql contents to improve fragmentation |
[production] |
| 16:26 |
<jynus> |
Synchronized wmf-config/db-eqiad.php: Repool es1001, depool es1002 (duration: 00m 14s) |
[production] |
| 16:13 |
<andrewbogott> |
shutting down virt1000 |
[production] |
| 16:08 |
<andrewbogott> |
disabling puppet on virt1000 |
[production] |
| 16:07 |
<ottomata> |
deploying eventlogging 0.9. This includes changes for arbitrary eventlogging URIs in all eventlogging stages, as well as support for schema based kafka topic URIs. |
[production] |
| 15:24 |
<thcipriani> |
Synchronized php-1.26wmf10/extensions/WikiEditor: SWAT: Reduce 'Edit' EventLogging schema sampling rate to 6.25% (1/16th) [[gerrit:219837]] (duration: 00m 13s) |
[production] |
| 15:04 |
<thcipriani> |
Synchronized wmf-config/InitialiseSettings-labs.php: SWAT: Default wmgUseWikibaseQuality on beta to true. [[gerrit:219630]] (duration: 00m 14s) |
[production] |
| 14:58 |
<hashar> |
disabled sshd MAC/KEX hardening on beta (was https://gerrit.wikimedia.org/r/#/c/219828/ ) |
[releng] |
| 14:32 |
<hashar> |
restarting Jenkins |
[releng] |
| 14:32 |
<hashar> |
restarting Jenkins |
[production] |
| 14:30 |
<hashar> |
Reenable sshd MAC/KEX hardening on beta by cherry picking https://gerrit.wikimedia.org/r/#/c/219828/ |
[releng] |
| 13:26 |
<jynus> |
rebooting es1001 for regular maintenance |
[production] |
| 13:17 |
<moritzm> |
activated firejail service containment for graphoid, citoid and mathoid in deployment-sca |
[releng] |
| 12:08 |
<paravoid> |
powercycled ms-be1002, stuck at console |
[production] |
| 11:12 |
<jynus> |
Synchronized wmf-config/db-eqiad.php: Depool es1001 (duration: 00m 13s) |
[production] |
| 11:07 |
<hashar> |
fixing puppet on integration-zuul-server |
[releng] |
| 11:06 |
<_joe_> |
restarting hhvm on the low-memory appservers (main and api) |
[production] |
| 10:29 |
<hashar> |
rebooted deployment-kafka02 to get rid of /home NFS share |
[releng] |
| 10:25 |
<hashar> |
fixed puppet.conf on deployment-urldownloader |
[releng] |
| 10:20 |
<hashar> |
enabled puppet agent on deployment-urldownloader |
[releng] |
| 10:05 |
<hashar> |
removing puppet lock on deployment-elastic07 ( rm /var/lib/puppet/state/agent_catalog_run.lock ) |
[releng] |
| 09:40 |
<hashar> |
fixed puppet certificates on integration-lightslave-jessie-1002 by deleting the SSL certs |
[releng] |
| 09:31 |
<hashar> |
cant reach integration-lightslave-jessie-1002 , probably NFS related |
[releng] |
| 09:23 |
<hashar> |
upgrading Jenkins gearman plugin from 0.1.1 to latest master (f2024bd). Restarting Jenkins. |
[production] |
| 09:22 |
<hashar> |
upgrading Jenkins gearman plugin from 0.1.1 to latest master (f2024bd). |
[releng] |