51-100 of 10000 results (48ms)
2018-11-29 §
16:10 <anomie@mwmaint1002> Running Wikibase/populateSitesTable.php and cleanupUsersWithNoId.php on more wiktionaries, incubatorwiki, and sourceswiki for T210732 [production]
15:54 <papaul> shutting down ms-be2047 for maintenance [production]
15:35 <gtirloni> T196507 downtimed and powercycled cloudvirt1019 [production]
15:32 <anomie@mwmaint1002> Running Wikibase/populateSitesTable.php and cleanupUsersWithNoId.php on several other wiktionaries for T210732 [production]
15:29 <gehel> activating multiple elasticsearch instances on cirrus / eqiad - T207918 [production]
15:18 <$WHO> Running Wikibase populateSitesTable.php on eswiktionary for T210732 [production]
14:31 <hashar@deploy1001> rebuilt and synchronized wikiversions files: Revert all wikis to 1.33.0-wmf.6 [production]
14:29 <hashar@deploy1001> scap failed: average error rate on 11/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) [production]
14:17 <hashar@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.33.0-wmf.6 [production]
14:10 <hashar> test stashbot [production]
14:05 <hashar@deploy1001> rebuilt and synchronized wikiversions files: wikidatawiki to 1.33.0-wmf.6 [production]
14:03 <moritzm> uploaded nodejs 6.11.0~dfsg-1+wmf3 to apt.wikimedia.org/stretch-wikimedia (backporting the current security fixes) [production]
13:45 <hashar@deploy1001> Synchronized php-1.33.0-wmf.6/extensions/Wikibase: feature flag for globe coordinator formatter using kartographer - T184933 T210617 (duration: 01m 18s) [production]
13:40 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Clarify parsercache keys section (duration: 00m 53s) [production]
13:39 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Clarify parsercache keys section (duration: 00m 52s) [production]
13:17 <moritzm> rebooting certcentral1001 to pick up SSBD-enabled qemu/kernel update [production]
13:14 <moritzm> rebooting certcentral2001 to pick up SSBD-enabled qemu/kernel update [production]
13:12 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Pool pc1009 in pc3 - T208383 (duration: 00m 53s) [production]
13:05 <marostegui> Upgrade pc3 tendril topology - T208383 [production]
13:00 <mobrovac@deploy1001> Started restart [eventstreams/deploy@07033d4]: Restart ES on scb1004 due to possible memory leak (again) [production]
12:49 <dcausse> EU swat done [production]
12:48 <dcausse@deploy1001> Synchronized php-1.33.0-wmf.6/extensions/TwoColConflict/: Fix unescaped HTML injected into conflict resolution interface (duration: 00m 53s) [production]
12:30 <jynus> run puppet on notebook1004, people1001, rutherfordium to fix failures [production]
12:13 <dcausse@deploy1001> Synchronized dblists/cirrussearch-big-indices.dblist: T210381: [cirrus] multi-instance: add cirrussearch-big-indices.dblist (duration: 00m 53s) [production]
12:09 <dcausse@deploy1001> Synchronized wmf-config/CirrusSearch-production.php: T210381: [cirrus] Use normal config for labswiki (duration: 00m 55s) [production]
12:01 <banyek> repooling labsdb1010 after upgrades - T209517 [production]
10:17 <elukey> remove zookeeper's crontabs from conf100[1-3] to fix cronspam [production]
10:16 <arturo> T209626 icinga downtime labvirt1011 for 1 month to avoid bogus pages [production]
10:01 <banyek> depooling labsdb1010 due of maintenance - T209517 [production]
09:55 <gehel> restarting prometheus-elasticsearch-exporter-9200 on all elastic cirrus nodes [production]
09:11 <akosiaris> increase nofile of process to 20k and maxclients to 15k to account for the backlog of ores scorings [production]
08:48 <_joe_> restarting uwsgi-ores on ores1003 [production]
08:04 <vgutierrez> replacing TLS certificates in gerrit - T207050 [production]
06:59 <marostegui> Stop MySQL on pc1006 to clone pc1009 - T208383 [production]
06:59 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool pc1006 - T208383 (duration: 00m 53s) [production]
06:36 <marostegui> Deploy schema change on db1061 (s6 master) - T202167 [production]
06:35 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1088 T202167 (duration: 00m 53s) [production]
06:31 <marostegui> Deploy schema change on db1088 - T202167 [production]
06:31 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1088 T202167 (duration: 00m 56s) [production]
06:15 <reedy@deploy1001> Synchronized php-1.33.0-wmf.6/extensions/OATHAuth: revert logging (loldeployingfromaplane) (duration: 00m 59s) [production]
06:11 <marostegui> Deploy schema change on s6 primary master - T86338 [production]
04:08 <ejegg> updated fundraising internal dashboard from 5e9fb9a3ef to 1e4dd2a9ec [production]
03:30 <ejegg> updated payments-wiki from 42283c73d0 to 34250e80b5 [production]
00:55 <catrope@deploy1001> Synchronized php-1.33.0-wmf.6/includes/: Add block notice stats on EditPage (T201718) (duration: 01m 14s) [production]
00:08 <catrope@deploy1001> Synchronized wmf-config/throttle.php: T210681 (duration: 01m 04s) [production]
2018-11-28 §
23:23 <tzatziki> changing a few passwords for compromised accounts [production]
21:35 <mutante> gnt-instance reboot proton1001.eqiad (stopped working, no SSH) [production]
21:28 <arlolra> Updated Parsoid to 18a98af (T209236, T210437, T184755, T187142, T208470, T207286, T206777, T205710, T205546, T204477) [production]
21:26 <mutante> rebooting proton1002 [production]
21:19 <herron> restarted nagios-nrpe-server on proton1002 [production]