2351-2400 of 10000 results (16ms)
2020-10-22 ยง
18:56 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
18:56 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
18:54 <mutante> applying deployment_server role to new server deploy1002 - might show up in monitoring but is not prod yet, deploy1001 still is [production]
18:34 <mutante> adding mcrouter cert for deploy1002.eqiad.wmnet T265963 [production]
18:12 <dpifke@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Expand to group1 (T123582) (duration: 00m 56s) [production]
18:12 <volans> cumin 'A:dns-rec' 'rec_control wipe-cache wikimedia.org$' - T258729 [production]
18:07 <chaomodus> Updating eqiad public network DNS to automation [production]
17:50 <volans> cumin 'A:dns-rec' 'rec_control wipe-cache eqiad.wmnet$' - T258729 [production]
17:49 <elukey> add thirdparty/bigtop14 to buster-wikimedia [production]
17:46 <chaomodus> Updating eqiad private network DNS to automation [production]
17:21 <bd808@cumin1001> END (PASS) - Cookbook wmcs.wikireplicas.add_wiki (exit_code=0) [production]
17:21 <bd808@cumin1001> Added views for new wiki: smnwiki T264900 [production]
17:07 <bd808@cumin1001> START - Cookbook wmcs.wikireplicas.add_wiki [production]
16:46 <pt1979@cumin2001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:42 <pt1979@cumin2001> START - Cookbook sre.dns.netbox [production]
14:56 <moritzm> installing remaining mariadb-10.3 updates for buster (as packaged in Debian, not the wmf-mariadb package) [production]
14:47 <ayounsi@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
14:33 <ayounsi@cumin1001> START - Cookbook sre.dns.netbox [production]
14:13 <andrewbogott> upgrading mariadb on cloudcontrol1003, 1004, 1005 [production]
14:05 <ottomata> bump camus version to wmf12 for all camus jobs. should be no-op now. - T251609 [production]
14:00 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: wgEventStreams: Enable canary events for all eventgate-analytics-external bound streams - T251609 (duration: 01m 02s) [production]
13:55 <moritzm> depooling ldap-eqiad-replica01/ldap-eqiad-replica02 T264388 [production]
13:41 <moritzm> pooling ldap-replica1001/1002 T264388 [production]
13:10 <moritzm> depooling ldap-replica2001/2002 T264388 [production]
13:04 <liw@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.36.0-wmf.14 [production]
13:01 <moritzm> pooling ldap-replica2004 T264388 [production]
12:24 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: wgEventStreams: Enable canary events for 3 eventgate-analytics bound streams - T251609 (duration: 01m 05s) [production]
12:10 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 52ad2d4df1164dced684231c12aa64bd028b8ac9: Do not log logins at loginwiki via CU (T253802) (duration: 01m 06s) [production]
12:03 <Urbanecm> [urbanecm@deploy1001 /srv/mediawiki-staging (master * u=)]$ sudo /usr/local/sbin/fix-staging-perms [production]
11:59 <Lucas_WMDE> EU backport&config window done [production]
11:58 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/Wikibase.php: Config: [[gerrit:635762|Enable propagatePageDeletion on Test Wikidata]], 2/2 (duration: 01m 04s) [production]
11:57 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:635762|Enable propagatePageDeletion on Test Wikidata]], 1/2 (duration: 01m 02s) [production]
11:54 <Urbanecm> Start of `mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log` in a tmux session updateVarDumps at mwmaint2001 (wiki=huwiki; T246539) [production]
11:39 <moritzm> restarting nginx on acmechief*, debmonitor*, schema*, puppetdb* to pick up freetype update [production]
11:38 <marostegui> Compare s1-s8 tables - T261914 [production]
11:33 <aborrero@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:31 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/InterwikiSortOrders.php: Config: [[gerrit:635813|Add ary, avk, awa, lld, shy and smn to InterwikiSortOrders.php]] (duration: 01m 08s) [production]
11:31 <aborrero@cumin2001> START - Cookbook sre.hosts.downtime [production]
11:25 <moritzm> restarting apache and smokeping* on netmon* to pick up freetype update [production]
11:21 <moritzm> correction: installing freetype security updates for buster (stretch TBD) [production]
10:43 <moritzm> installing freetype security updates for stretch/buster [production]
10:33 <volans@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
10:27 <volans@cumin1001> START - Cookbook sre.dns.netbox [production]
09:38 <arturo> merging https://gerrit.wikimedia.org/r/c/operations/puppet/+/634050 change to network data yaml [production]
08:31 <kormat> enabling replication from eqiad to codfw T261914 [production]
08:23 <filippo@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
08:23 <filippo@cumin1001> START - Cookbook sre.hosts.downtime [production]
07:52 <godog> swift codfw-prod: bump object weight for ms-be2057 - T261633 [production]
03:37 <eileen> civicrm revision changed from 4dce7bf535 to bb7c08bf6d, config revision is 9a522d03dd [production]
03:13 <eileen> civicrm revision changed from 3c3dcf80ae to 4dce7bf535, config revision is 9a522d03dd [production]