1451-1500 of 10000 results (51ms)
2018-07-09 §
06:01 <marostegui> Deploy schema change on s1 codfw master (db2048) with replication, this will generate lag on s1 codfw - T146591 T197891 T196379 [production]
05:55 <marostegui> Deploy schema change on s2 primary master (db1066) - T146591 T197891 T196379 [production]
05:53 <marostegui> Deploy schema change on db1076 - T146591 T197891 T196379 [production]
05:41 <marostegui> Optimize bgwiki itwiki svwiki zhwiki wbc_entity_usage on s2 codfw master with replication - lag will happen on s2 codfw - T187521 [production]
05:31 <marostegui> Optimize {itwiki,enwiktionary,nlwiki}.logging on db1090 T197459 [production]
05:31 <marostegui> Deploy schema change on db1090 - T146591 T197891 T196379 [production]
05:29 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1074 after alter table (duration: 00m 51s) [production]
05:11 <marostegui> Deploy schema change on db1074 with replication, this will generate lag on s2 on labs hosts - T146591 T197891 T196379 [production]
05:04 <marostegui> Optimize {itwiki,enwiktionary,nlwiki}.logging on db1074 with replication, this will generate lag on labs hosts T197459 [production]
05:02 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1074 for alter table (duration: 00m 52s) [production]
02:44 <l10nupdate@deploy1001> ResourceLoader cache refresh completed at Mon Jul 9 02:44:19 UTC 2018 (duration 10m 23s) [production]
02:33 <l10nupdate@deploy1001> scap sync-l10n completed (1.32.0-wmf.10) (duration: 13m 33s) [production]
2018-07-08 §
20:37 <krinkle@deploy1001> Synchronized wmf-config/InitialiseSettings.php: I81d566ba860 (duration: 00m 51s) [production]
20:30 <krinkle@deploy1001> Synchronized wmf-config/CommonSettings.php: Id94ca5f55c2c6 (duration: 00m 53s) [production]
19:10 <chasemp> disable puppet on labstore1007 to turn down ratelimits for nginx (load is rising and rising) [production]
11:27 <elukey> restart rsyslog on lithium - in:imtcp thread stuck at 99% cpu usage [production]
2018-07-07 §
23:25 <krinkle@deploy1001> Synchronized wmf-config/CommonSettings.php: Icbbccf495899 (duration: 00m 50s) [production]
23:23 <krinkle@deploy1001> Synchronized wmf-config/InitialiseSettings.php: I001f68a1b39 (duration: 00m 53s) [production]
23:18 <krinkle@deploy1001> Synchronized wmf-config/CommonSettings.php: I1b42c260b5ee3 (duration: 01m 00s) [production]
13:02 <_joe_> rebooting lvs2001, panic logs from the ethernet card module [production]
2018-07-06 §
18:08 <foks> reset 2FA for User:Howcheng [production]
16:06 <chasemp> labcontrol1003:~# /sbin/reboot T198950 [production]
13:36 <moritzm> installing openldap security updates on trusty [production]
13:22 <marostegui> Optimize {itwiki,enwiktionary,nlwiki}.logging on db1103:3312 - T197459 [production]
13:22 <marostegui> Deploy schema change on db1103:3312 - T146591 T197891 T196379 [production]
13:05 <moritzm> installing bouncycastle security updates [production]
13:00 <moritzm> installing mercurial security updates [production]
12:57 <hashar> Restarting Zuul [production]
12:45 <mobrovac@deploy1001> Finished deploy [restbase/deploy@c42c048]: Update restbase-mod-table-cassandra to v1.1.0 (duration: 15m 32s) [production]
12:38 <marostegui> Optimize {itwiki,enwiktionary,nlwiki}.logging on db1105 and db1122 - T197459 [production]
12:33 <marostegui> Deploy schema change on db1105:3312 - T146591 T197891 T196379 [production]
12:30 <marostegui> Deploy schema change on dbstore1002:s2 and db1122 T146591 T197891 T196379 [production]
12:29 <mobrovac@deploy1001> Started deploy [restbase/deploy@c42c048]: Update restbase-mod-table-cassandra to v1.1.0 [production]
12:18 <marostegui> Deploy schema change on s2 codfw master (db2035) with replication, this will generate lag on s2 codfw T146591 T197891 T196379 [production]
11:51 <marostegui> Optimize {itwiki,enwiktionary,nlwiki}.logging on dbstore1002:s2 - T197459 [production]
11:15 <marostegui> Optimize {itwiki,enwiktionary,nlwiki}.logging on db2035 (codfw s2 master), this will generate lag on s2 codfw - T197459 [production]
11:09 <marostegui> Optimize shwiki.logging on s3 eqiad hosts (one by one) T197459 [production]
11:08 <marostegui> Optimize shwiki.logging on db2043 (codfw s3 master), this will generate lag on s3 codfw - T197459 [production]
11:04 <marostegui> Optimize frwiki.logging on db1061 (s6 primary master) - T197459 [production]
11:02 <marostegui> Deploy schema change on db1061 (s6 primary master) T146591 T197891 T196379 [production]
11:01 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1088 after alter table (duration: 00m 50s) [production]
10:49 <marostegui> Optimize frwiki.logging on db1088 - T197459 [production]
10:48 <marostegui> Deploy schema change on db1088 T146591 T197891 T196379 [production]
10:48 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1088 for alter table (duration: 00m 50s) [production]
10:40 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1093 after alter table (duration: 00m 51s) [production]
10:02 <marostegui> Optimize frwiki.logging on db1093 - T197459 [production]
10:01 <mobrovac> restbase depool restbase2001 to test the cassandra node driver v3.5.0 - T169009 [production]
10:00 <marostegui> Deploy schema change on db1093 T146591 T197891 T196379 [production]
10:00 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1093 for alter table (duration: 00m 51s) [production]
09:55 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1085 after alter table (duration: 00m 51s) [production]