201-250 of 10000 results (51ms)
2018-12-20 ยง
19:27 <kaldari@deploy1001> Synchronized wmf-config/InitialiseSettings.php: syncing InitialiseSettings for SWAT deployment (duration: 00m 46s) [production]
19:03 <elukey> restart hdfs namenode on an-master1002 with new heap settings (currently standby, 8->12G) [production]
18:30 <elukey> remove hdfs journalnode config+packages from analytics10(28|35) - not used anymore - T209929 [production]
18:29 <elukey> restart hdfs namenode on an-master1001 with new heap settings (currently standby, 8->12G) [production]
18:06 <mutante> doc1001 - meged gerrit:480881 and then manually moved the entire /srv/org/wikimedia/doc/ structure into /srv/docroot/srv/org/wikimedia/ and deleted the old dirs T137890 [production]
17:53 <arturo> updating puppet compiler facts: `PUPPET_COMPILER=compiler1002.puppet-diffs.eqiad.wmflabs modules/puppet_compiler/files/compiler-update-facts` [production]
17:49 <arturo> updating puppet compiler facts: `PUPPET_COMPILER=compiler1001.puppet-diffs.eqiad.wmflabs modules/puppet_compiler/files/compiler-update-facts` [production]
17:05 <XioNoX> add 208.80.155.88/29 to cloud-in4 term icmp - T207663 [production]
17:02 <XioNoX> configure additional 208.80.155.88/29 IPs on cloud-instance-transport1-b-eqiad - T207663 [production]
16:59 <zfilipin@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.33.0-wmf.9 [production]
16:51 <zfilipin@deploy1001> Synchronized php-1.33.0-wmf.9/extensions/Wikibase: SWAT: [[gerrit:480978|Revert "Fail hard if an entity namespace is not configured." (T212427)]] (duration: 01m 17s) [production]
16:31 <elukey> remove two journal nodes from the Analytics hadoop cluster - T209929 [production]
14:53 <moritzm> installing nodejs security updates on maps* (was tested via T211419) [production]
14:41 <moritzm> restarted etherpad for nodejs security updates [production]
14:39 <elukey> add two journal nodes to the Analytics Hadoop cluster - T209929 [production]
14:30 <moritzm> installing libdap updates from stretch point release [production]
14:26 <moritzm> rearmed keyholder on netmon1002 after reboot [production]
14:22 <moritzm> rebooting netmon1002 for kernel security update [production]
13:09 <moritzm> installing xapian-core updates from stretch point release [production]
12:53 <arturo> T209616 installing cloudvirt1030, icinga downtime for 1 day [production]
12:48 <kartik@deploy1001> Finished deploy [cxserver/deploy@16f65cb]: Update cxserver to 803baa4 (T210581, T211889, T144467, T209473) (duration: 04m 42s) [production]
12:47 <moritzm> installing libxcursor security updates [production]
12:43 <kartik@deploy1001> Started deploy [cxserver/deploy@16f65cb]: Update cxserver to 803baa4 (T210581, T211889, T144467, T209473) [production]
12:31 <moritzm> installing fuse updates from stretch point release [production]
12:09 <jdrewniak@deploy1001> Synchronized portals: Wikimedia Portals Update: [[gerrit:478659| Bumping portals to master (T128546, T202497)]] (duration: 00m 52s) [production]
12:08 <jdrewniak@deploy1001> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:478659| Bumping portals to master (T128546, T202497)]] (duration: 00m 53s) [production]
12:02 <moritzm> draining restbase1016 for eventual reboot for kernel security update [production]
11:46 <moritzm> draining restbase1015 for eventual reboot for kernel security update [production]
11:34 <moritzm> powercycling restbase1014, similar EFI ASSERT error to T212305 [production]
11:34 <moritzm> powercycling restbase1014, similar EFI ASSEER error to T212305 [production]
11:21 <moritzm> draining restbase1014 for eventual reboot for kernel security update [production]
10:59 <banyek> executing schema change on db1068 (s4 master) - T85757 [production]
10:58 <banyek@deploy1001> Synchronized wmf-config/db-eqiad.php: repool db1121 after schema change - T85757 (duration: 00m 52s) [production]
10:53 <banyek> repooling db1121 after schema change T85757 [production]
10:45 <moritzm> draining restbase1013 for eventual reboot for kernel security update [production]
10:44 <banyek> stopping replication on db1121 - T85757 [production]
10:40 <banyek@deploy1001> Synchronized wmf-config/db-eqiad.php: depool db1121 for schema change - T85757 (duration: 00m 52s) [production]
10:35 <banyek> depooling db1121 for schema change T85757 [production]
10:33 <banyek> executing schema change on dbstore1002 - T85757 [production]
10:22 <banyek> executing schema change on db1102 - T85757 [production]
10:20 <banyek@deploy1001> Synchronized wmf-config/db-eqiad.php: repool db1081 after schema change - T85757 (duration: 00m 51s) [production]
10:19 <moritzm> draining restbase1012 for eventual reboot for kernel security update [production]
10:15 <banyek> repooling db1081 after schema change T85757 [production]
10:10 <banyek@deploy1001> Synchronized wmf-config/db-eqiad.php: depool db1081 for schema change - T85757 (duration: 00m 51s) [production]
10:05 <banyek> depooling db1081 for schema change T85757 [production]
10:00 <banyek@deploy1001> Synchronized wmf-config/db-eqiad.php: repool db1103:3314 after schema change - T85757 (duration: 00m 52s) [production]
09:56 <banyek> repooling db1103:3314 after schema change T85757 [production]
09:49 <banyek@deploy1001> Synchronized wmf-config/db-eqiad.php: depool db1103:3314 for schema change - T85757 (duration: 00m 51s) [production]
09:46 <banyek> depooling db1103:3314 for schema change T85757 [production]
09:45 <banyek@deploy1001> Synchronized wmf-config/db-eqiad.php: repool db1097:3314 after schema change - T85757 (duration: 00m 51s) [production]