2451-2500 of 10000 results (55ms)
2018-06-07 §
12:54 <jynus> stop, clone and reimage db1091 [production]
12:52 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1091 (duration: 00m 57s) [production]
12:46 <mutante> planet1001/puppetmaster: revoke old cert, sign new cert request, initial puppet run, reinstalled, will turn service active-active again once done (T168490) [production]
12:26 <mutante> planet1001 - schedule downtime, boot to PXE, reinstall with stretch (ganeti) (T168490) [production]
12:15 <moritzm> repooled mw1280 after hardware maintenance (T195734) [production]
11:31 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1085 after alter table (duration: 00m 57s) [production]
10:29 <moritzm> installing openssl security updates [production]
08:50 <marostegui> Deploy schema change on db1085 with replication, this will generate lag on labsdb for s6 section - T191316 T192926 T195193 T89737 [production]
08:49 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1085 for alter table (duration: 00m 56s) [production]
08:49 <akosiaris> slow reboot of all ganeti eqiad VMs (except bohrium, puppetdb1001, poolcounter1001, mx1001) for kernel upgrades and picking up spec-ctrl cpu flag [production]
08:38 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1093 after alter table (duration: 00m 55s) [production]
08:34 <marostegui> Stop replication on db1102:3316 and db1125:3316 to update triggers for archive table - T192926 [production]
08:15 <jynus> running ANALYZE on db2091 T196526 [production]
07:46 <marostegui> Deploy schema change on db1093 - T191316 T192926 T195193 T89737 [production]
07:46 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1093 for alter table (duration: 00m 56s) [production]
07:40 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1098:3316 after alter table (duration: 00m 57s) [production]
07:09 <moritzm> installing git security updates on trusty (Debian already fixed) [production]
06:55 <jynus> relaxing write consistency on db2048 due to ongoing maintenance (sync_binlog,flush_log) [production]
06:26 <marostegui> Deploy sanitarium events on db1125 - T190704 [production]
06:24 <jynus> phabricator maintenance finished [production]
06:10 <jynus> start database maintenance on phabricator- brief interruptions could happen [production]
05:15 <marostegui> Deploy event_sanitarium on codfw sanitariums - T190704 [production]
05:12 <marostegui> Deploy schema change on db1098:3316 - T191316 T192926 T195193 T89737 [production]
05:11 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1098:3316 for alter table (duration: 00m 56s) [production]
05:05 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1096:3316 after alter table (duration: 00m 58s) [production]
04:01 <eileen> civicrm revision changed from 1aaa798e9b to 69091d8b5f, config revision is c60375be8d [production]
03:05 <l10nupdate@deploy1001> ResourceLoader cache refresh completed at Thu Jun 7 03:05:05 UTC 2018 (duration 10m 19s) [production]
02:54 <l10nupdate@deploy1001> scap sync-l10n completed (1.32.0-wmf.7) (duration: 07m 02s) [production]
02:30 <l10nupdate@deploy1001> scap sync-l10n completed (1.32.0-wmf.6) (duration: 11m 24s) [production]
02:25 <bsitzmann@deploy1001> Started deploy [mobileapps/deploy@a07af40]: log [production]
02:00 <paravoid> starting exim4 and reenabling puppet on mx1001, due to T196598 [production]
01:12 <ejegg> disabled fundraising mailing statistics fetch jobs [production]
01:00 <ejegg> updated CiviCRM from 7a06a6a387 to 1aaa798e9b [production]
00:51 <mholloway-shell@deploy1001> Finished deploy [mobileapps/deploy@a07af40]: (no justification provided) (duration: 01m 02s) [production]
00:50 <mholloway-shell@deploy1001> Started deploy [mobileapps/deploy@a07af40]: (no justification provided) [production]
00:33 <ejegg> restarted fundraising jobs [production]
00:25 <legoktm@deploy1001> Finished scap: Preference for responsive MonoBook, plus set mobile width cutoff to 550px ([[gerrit:437875]], [[gerrit:437814]]) (duration: 64m 01s) [production]
2018-06-06 §
23:51 <urandom> upgrade Cassandra to 3.11.2, restbase2012-{a,b,c} - T178905 [production]
23:49 <eileen> civicrm revision changed from ce960c0642 to 7a06a6a387, config revision is b7bc5dc31f [production]
23:43 <eileen> civicrm revision changed from ac13914d03 to ce960c0642, config revision is b7bc5dc31f [production]
23:23 <urandom> upgrade Cassandra to 3.11.2, restbase2009-{a,b,c} - T178905 [production]
23:21 <legoktm@deploy1001> Started scap: Preference for responsive MonoBook, plus set mobile width cutoff to 550px ([[gerrit:437875]], [[gerrit:437814]]) [production]
23:19 <eileen> civicrm revision changed from 0b97f1f5b2 to ac13914d03 [production]
23:07 <cwd> disabled process-control for civi update [production]
22:22 <mholloway-shell@deploy1001> Finished deploy [mobileapps/deploy@0346959]: Update mobileapps to 5ea008c (duration: 05m 33s) [production]
22:16 <mholloway-shell@deploy1001> Started deploy [mobileapps/deploy@0346959]: Update mobileapps to 5ea008c [production]
20:47 <ebernhardson> sighup logstash on logstash100[789] to reload config for gerrit.wikimedia.org/r/437657 [production]
20:42 <urandom> upgrade Cassandra to 3.11.2, restbase2005-{a,b,c} - T178905 [production]
20:19 <bearND> rolled back mobileapps deploy [production]
20:18 <bsitzmann@deploy1001> Finished deploy [mobileapps/deploy@a07af40]: Update mobileapps to 3bf9be5 (T196402 T195948) (duration: 08m 37s) [production]