6551-6600 of 10000 results (77ms)
2019-01-18 §
10:23 <vgutierrez> restarting pybal in lvs2005 - T214072 [production]
10:02 <marostegui> Add dbstore1003:3315 to zarcillo - T210478 [production]
09:58 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1113:3315 - T210478 (duration: 00m 45s) [production]
09:57 <marostegui> Add dbstore1003:3315 to tendril - T210478 [production]
09:52 <marostegui> Deploy schema change on db2089 - T210713 [production]
09:35 <marostegui> Deploy schema change on db2067 - T210713 [production]
09:29 <_joe_> uploading python{,3}-pygerrit2 to stretch-wikimedia, T214149 [production]
09:23 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Add migrated wikis from s3 to s5 to codfw config T184805 (duration: 00m 45s) [production]
09:01 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1113:3316 after mysql upgrade (duration: 00m 46s) [production]
08:12 <godog> depool and take snapshots of prometheus data on prometheus2003 to test v2 conversion - T187987 [production]
07:31 <moritzm> rolling restart of AQS to pick up OpenSSL security updates for nodejs [production]
07:30 <marostegui> Stop MySQL on db1113:3315 and db1113:3316 to clone dbstore1003 and for mysql and kernel upgrade [production]
07:29 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1113:3316 for mysql upgrade (duration: 00m 45s) [production]
07:24 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1113:3315 - T210478 (duration: 00m 46s) [production]
07:16 <moritzm> installing OpenSSL security updates [production]
06:54 <marostegui> Drop table tag_summary from s7 - T212255 [production]
06:46 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1075 and db1103 after DC hw maintenance (duration: 00m 44s) [production]
06:46 <marostegui> Deploy schema change on dbstore1002:s3 - T85757 [production]
06:29 <marostegui> Deploy schema change on db1075 - T85757 [production]
06:29 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool DBs on A2 rack T213748 (duration: 00m 47s) [production]
00:00 <ejegg> updated payments-wiki from c455bbc6bb to 7d4cd165d9 [production]
2019-01-17 §
23:02 <bsitzmann@deploy1001> Finished deploy [mobileapps/deploy@6b344ca]: Update mobileapps to 258d76b page summary changes, 2nd try (duration: 02m 03s) [production]
23:00 <bsitzmann@deploy1001> Started deploy [mobileapps/deploy@6b344ca]: Update mobileapps to 258d76b page summary changes, 2nd try [production]
20:06 <dduvall@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.33.0-wmf.13 [production]
19:29 <catrope@deploy1001> Synchronized php-1.33.0-wmf.13/extensions/GrowthExperiments/: Make welcome survey C unescapable (T213958) (duration: 00m 52s) [production]
19:16 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Update groupOverrides for Serbian wikis (T213055, T213059, T213063, T213065, T213679, T213680, T213681, T213682, T213684, T213685, T213686, T213687, T213824, T213825, T213826, T213827, T213828, T213829, T213830, T213832) (duration: 00m 53s) [production]
19:02 <ppchelko@deploy1001> Finished deploy [restbase/deploy@f24d681]: Update recommendation api endpoints (duration: 20m 26s) [production]
18:42 <ppchelko@deploy1001> Started deploy [restbase/deploy@f24d681]: Update recommendation api endpoints [production]
18:22 <vgutierrez> running ipvsadm -D -t 10.2.1.29:1968 in lvs2003 - T214041 [production]
18:19 <vgutierrez> running ipvsadm -D -t 10.2.1.29:1968 in lvs2006 - T214041 [production]
18:18 <bmansurov@deploy1001> Finished deploy [recommendation-api/deploy@5ba7582]: Update to I25c97ed81f763a0c8fe56466cce50219ba707ea0 (duration: 05m 36s) [production]
18:12 <bmansurov@deploy1001> Started deploy [recommendation-api/deploy@5ba7582]: Update to I25c97ed81f763a0c8fe56466cce50219ba707ea0 [production]
17:52 <elukey> re-enable eventlogging mysql clients and db1108's el replication after db1107 maintenance [production]
17:38 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: ConstraintsCheckJobs on wikidatawiki (5% of edits) T204031 (duration: 00m 52s) [production]
17:25 <dcausse> restarting mjolnir services on all elastic* nodes [production]
17:19 <dcausse@deploy1001> Finished deploy [search/mjolnir/deploy@85aec7a]: fix multi-instances support (duration: 03m 42s) [production]
17:15 <dcausse@deploy1001> Started deploy [search/mjolnir/deploy@85aec7a]: fix multi-instances support [production]
16:57 <jforrester@deploy1001> Synchronized php-1.33.0-wmf.12/extensions/VisualEditor/modules/ve-mw/: T213922: Revert 48db45df7602 for wmf.12 (duration: 00m 52s) [production]
16:56 <jforrester@deploy1001> Synchronized php-1.33.0-wmf.13/extensions/VisualEditor/modules/ve-mw/: T213922: Revert 48db45df7602 for wmf.13 (duration: 00m 51s) [production]
16:46 <dcausse@deploy1001> Finished deploy [search/mjolnir/deploy@42414ca]: add support for multi-instances setup (duration: 04m 59s) [production]
16:45 <paravoid> updating ps1-a3-eqiad's SNMP communities to the new ones [production]
16:41 <dcausse@deploy1001> Started deploy [search/mjolnir/deploy@42414ca]: add support for multi-instances setup [production]
16:28 <fsero> uncordoned kubernetes1001 [production]
16:27 <fsero@puppetmaster1001> conftool action : set/pooled=yes; selector: name=kubernetes1001.eqiad.wmnet [production]
16:19 <moritzm> rebooting roentgenium (failoid node in eqiad) to enable SSBD-enabled qemu [production]
16:18 <cmjohnson1> ps1-a2-eqiad removing redundant power from side A to replace blown fuse [production]
16:16 <moritzm> rebooting tureis (failoid node in codfw) to enable SSBD-enabled qemu [production]
15:12 <moritzm> rebooting archiva1001 (archiva.wikimedia.org) to enable SSBD-enabled qemu [production]
14:49 <moritzm> rebooting darmstadtium (docker registry) to enable SSBD-enabled qemu [production]
14:36 <jbond42> rolling out update for debdeploy 0.0.99.6-1 -> 0.0.99.7-1 T207845 [production]