6601-6650 of 10000 results (112ms)
2019-05-21 §
11:58 <mobrovac> started frwiki dumps - T215956 [production]
11:46 <mobrovac> started enwiki dumps - T215956 [production]
11:27 <Amir1> EU SWAT is done [production]
11:27 <ladsgroup@deploy1001> Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:511658|Revert "Switch off php7 for investigation of production instabilities"]] (duration: 00m 50s) [production]
11:23 <hashar> Depooling integration-slave-docker-1055 and integration-slave-docker-1056 : CPU is too slow # T223971 [releng]
11:20 <volans> restarting Icinga on icinga2001 (passive server) to pick up new open file limits [production]
11:18 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:17 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:17 <jbond42> reboot wtp1025.eqiad.wmnet [production]
11:10 <ladsgroup@deploy1001> Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:505816|Define wmgUseEntitySchema (T221651)]], part II (duration: 00m 49s) [production]
11:09 <mobrovac@deploy1001> Finished deploy [restbase/deploy@cf00120]: Switch Parsoid to simple k/v bucket - T215956 (duration: 25m 50s) [production]
11:08 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:505816|Define wmgUseEntitySchema (T221651)]], part I (duration: 00m 50s) [production]
11:07 <godog> swift codfw-prod: remove ms-be201[345] - T221068 [production]
10:59 <_joe_> rolling restart of php7.2-fpm across the fleet to pick up a config change [production]
10:43 <mobrovac@deploy1001> Started deploy [restbase/deploy@cf00120]: Switch Parsoid to simple k/v bucket - T215956 [production]
10:39 <jijiki> updating prometheus-mcrouter-exporter on mw* servers [production]
10:26 <godog> pool new restbase hosts - T219404 [production]
10:20 <filippo@puppetmaster1001> conftool action : set/pooled=yes; selector: name=restbase1019.eqiad.wmnet [production]
09:49 <moritzm> updated buster netboot image to daily image from 20190521 [production]
09:26 <moritzm> reimaging graphite2001 to buster for some d-i tests [production]
08:58 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Repool db2104 as candidate master and as API (duration: 00m 51s) [production]
08:56 <marostegui> Stop MySQL on db2041 as it will be decommissioned T223950 [production]
08:24 <hashar> Updated phan jobs to no more install mediawiki development dependencies (potentially conflicting with the extensions code) https://gerrit.wikimedia.org/r/#/c/integration/config/+/511447/ # T223397 [releng]
07:29 <legoktm> deployed https://gerrit.wikimedia.org/r/511627 [releng]
07:10 <legoktm> manually rebuilding mediawiki-core-code-coverage-docker with 5 hour timeout [releng]
06:59 <oblivian@deploy1001> Synchronized wmf-config/CommonSettings.php: Turning off php7 sampling for investigation in T223952 (duration: 00m 53s) [production]
06:55 <elukey> reboot of stat100[4,5,6,7] and notebook100[3,4] for kernel upgrades [production]
06:31 <marostegui> Stop mariadb on db2104 to convert it to s2 candidate master [production]
06:30 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Depool db2104 (duration: 00m 51s) [production]
06:28 <elukey> chown analytics:analytics /user/hdfs/salts/eventlogging_sanitization on HDFS [analytics]
05:50 <marostegui> Remove db2041 from tendril and zarcillo - T223950 [production]
05:43 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Remove db2041 for decommissioning T223950 (duration: 00m 51s) [production]
05:42 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Remove db2041 for decommissioning T223950 (duration: 00m 51s) [production]
05:16 <marostegui> Stop MySQL on db2040 [production]
05:16 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Depool db2040 (duration: 00m 50s) [production]
05:14 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Pool db2114 into s6 - T222772 (duration: 00m 50s) [production]
05:13 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Pool db2114 into s6 - T222772 (duration: 00m 51s) [production]
03:36 <urandom> bootstrapping restbase1027-c -- T219404 [production]
00:47 <urandom> bootstrapping restbase1027-b -- T219404 [production]
00:05 <aaron@deploy1001> Synchronized php-1.34.0-wmf.5/includes/libs/objectcache/APCUBagOStuff.php: 982299d635623279 (duration: 00m 54s) [production]
2019-05-20 §
21:07 <ejegg> updated payments-wiki from 8397ccf9cc to d5ef5ad067 [production]
19:19 <mobrovac> bootstrap restbase1027-a - T219404 [production]
19:01 <wm-bot> <jeanfred> Restart uwsgi with 10 workers rather than the default of 4 [tools.integraality]
19:00 <wm-bot> <jeanfred> --help [tools.integraality]
18:55 <krinkle@deploy1001> Synchronized php-1.34.0-wmf.5/includes/Linker.php: T222857 / Iecc2140fabd3 (duration: 00m 54s) [production]
17:25 <arturo> T223923 dropped compat-network config from /etc/network/interfaces in eqiad1/codfw1dev neutron nodes [admin]
17:22 <arturo> T223923 dropped br-compat bridges and vlan interfaces (1102 and 2102) in eqiad1/codfw1dev neutron nodes [admin]
17:17 <elukey> chown -R analytics:analytics /tmp/DataFrameToDruid on HDFS [analytics]
17:07 <arturo> T223923 dropped compat-network configuration from the neutron database in eqiad1 [admin]
16:55 <arturo> T223923 dropped compat-network configuration from the neutron database in codfw1dev [admin]