701-750 of 10000 results (47ms)
2018-02-20 §
14:03 <zfilipin@tin> Synchronized wmf-config/throttle.php: SWAT: [[gerrit:412606|throttle: add new rule for Wikidata edit-a-thon (T187655)]] (duration: 00m 56s) [production]
13:29 <marostegui> Upgrade kernel and reboot db1113 and db1114 [production]
13:23 <marostegui> Stop MySQL and reboot db1111 for kernel and mariadb upgrade [production]
13:17 <marostegui> Stop MySQL and reboot db1112 for kernel and mariadb upgrade [production]
13:03 <moritzm> installing libav security updates [production]
12:11 <_joe_> upgrading conftool to 1.0.0~beta2 on scb* [production]
11:24 <jynus> upgrding mariadb-client on neodymium and sarin [production]
11:09 <marostegui> Deploy schema change on labtestweb2001 - T153182 T185128 T187089 [production]
11:00 <marostegui> Deploy schema change on s2 codfw master (db2035) with replication, this will generate lag on codfw - T187089 T185128 T153182 [production]
11:00 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Remove db2037 and db2044 (duration: 00m 55s) [production]
10:58 <jynus@tin> Synchronized wmf-config/db-codfw.php: Remove db2037 and db2044 (duration: 00m 53s) [production]
10:49 <jynus@tin> Synchronized wmf-config/db-codfw.php: Depool db2037 and db2044 (duration: 00m 55s) [production]
10:20 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Remove db2030 from config - T187768 (duration: 00m 55s) [production]
10:18 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Remove db2030 from config - T187768 (duration: 00m 56s) [production]
10:13 <volans> unified python-requests-mock packages in apt.wikimedia.org jessie-wikimedia to be 1.3.0-3~wmf1, removed binaries for 1.3.0-3 [production]
09:49 <marostegui> Deploy schema change on s6 primary master db1061 - T185128 T153182 [production]
09:49 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1088 after alter table (duration: 00m 55s) [production]
09:16 <marostegui> Data checks for db2037 before removing it from s4 - T187722 [production]
09:14 <elukey> restart zookeeper on druid1001 (follower) to verify that the last changes are no-op [production]
09:12 <marostegui> Deploy schema change on db1088 - T187089 T185128 T153182 [production]
09:12 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1088 for alter table (duration: 00m 55s) [production]
09:04 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Fully repool db1096:3316 and db1085 (duration: 00m 55s) [production]
09:03 <oblivian@puppetmaster2001> conftool action : set/val=false; selector: scope=eqiad,name=ReadOnly [production]
09:03 <oblivian@puppetmaster2001> conftool action : set/val=false; selector: scope=eqiad,name=ReadOnly [production]
09:02 <oblivian@puppetmaster2001> conftool action : set/val=false; selector: scope=eqiad,name=ReadOnly [production]
09:01 <oblivian@puppetmaster2001> conftool action : edit; selector: scope=codfw [production]
08:56 <oblivian@puppetmaster2001> conftool action : edit; selector: scope=codfw [production]
08:51 <oblivian@puppetmaster2001> conftool action : edit; selector: scope=common [production]
08:32 <_joe_> uploading conftool 1.0.0~beta1 on stretch [production]
08:26 <_joe_> uploading conftool 1.0.0~beta1 to jessie [production]
08:25 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1085 (duration: 00m 55s) [production]
08:09 <godog> powercycle ganeti1006 [production]
08:08 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1085 (duration: 01m 10s) [production]
07:48 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1085 (duration: 00m 55s) [production]
07:27 <marostegui> Deploy schema change on db1096:3316 - T187089 T185128 T153182 [production]
07:27 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1096:3316 for alter table (duration: 00m 56s) [production]
07:13 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Slowly repool db1085 (duration: 00m 55s) [production]
06:58 <marostegui> Upgrade mariadb and kernel on db1085 [production]
06:26 <marostegui> Deploy schema change on db1085 (with replication - this will generate lag on labs hosts) - T187089 T185128 T153182 [production]
06:26 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1085 for alter table (duration: 00m 56s) [production]
04:56 <krinkle@tin> Synchronized docroot/mediawiki/keys/: Ie26638ed0c - rm old 2009 keys file (duration: 00m 56s) [production]
04:27 <krinkle@tin> Synchronized w/extract2.php: Ib6d77e863b - clean up MW_LANG indirection (duration: 00m 55s) [production]
03:40 <krinkle@tin> Synchronized wmf-config/CommonSettings.php: Ie4c7879f8ac - Clean up TemplateSandboxEditNamespaces config (duration: 00m 57s) [production]
03:37 <Krinkle> It seems 'scap pull' on mwdebug1002 is acting weird (prompt doesn't return until 3-5 minutes after last line of "Finished rsync common") [production]
02:24 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.21) (duration: 05m 50s) [production]
2018-02-19 §
23:21 <eileen> re-enable omnirecipient jobs - process-control config revision is 8c7ce87207 [production]
22:03 <volans> uploaded cumin_3.0.1-1_amd64.deb to apt.wikimedia.org jessie-wikimedia [production]
20:03 <volans> uploaded cumin_3.0.0-1_amd64.deb to apt.wikimedia.org jessie-wikimedia [production]
19:29 <volans> uploaded python3-requests-mock, python-requests-mock and python-requests-mock-doc for version 1.3.0-3~wmf1 to apt.wikimedia.org jessie-wikimedia [production]
18:52 <volans> disabled all notifications on Icinga for db2030 [production]