401-450 of 10000 results (25ms)
2020-10-22 §
11:25 <moritzm> restarting apache and smokeping* on netmon* to pick up freetype update [production]
11:21 <moritzm> correction: installing freetype security updates for buster (stretch TBD) [production]
10:43 <moritzm> installing freetype security updates for stretch/buster [production]
10:33 <volans@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
10:27 <volans@cumin1001> START - Cookbook sre.dns.netbox [production]
09:38 <arturo> merging https://gerrit.wikimedia.org/r/c/operations/puppet/+/634050 change to network data yaml [production]
08:31 <kormat> enabling replication from eqiad to codfw T261914 [production]
08:23 <filippo@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
08:23 <filippo@cumin1001> START - Cookbook sre.hosts.downtime [production]
07:52 <godog> swift codfw-prod: bump object weight for ms-be2057 - T261633 [production]
03:37 <eileen> civicrm revision changed from 4dce7bf535 to bb7c08bf6d, config revision is 9a522d03dd [production]
03:13 <eileen> civicrm revision changed from 3c3dcf80ae to 4dce7bf535, config revision is 9a522d03dd [production]
01:12 <ryankemper@deploy1001> Finished deploy [wdqs/wdqs@870829c]: 0.3.52 (duration: 09m 07s) [production]
01:04 <ryankemper> Tests passing on canary `wdqs1003`, proceeding with wdqs deploy for rest of fleet [production]
01:03 <ryankemper@deploy1001> Started deploy [wdqs/wdqs@870829c]: 0.3.52 [production]
2020-10-21 §
23:16 <catrope@deploy1001> Synchronized php-1.36.0-wmf.14/extensions/GrowthExperiments/: T266033 (duration: 01m 05s) [production]
23:14 <catrope@deploy1001> Synchronized php-1.36.0-wmf.13/extensions/GrowthExperiments/: T265751 T265754 (duration: 01m 08s) [production]
21:38 <mutante> testreduce1001 assigned 2 more GBs of RAM - rebooting (T257940, T257906) [production]
19:44 <Amir1> end of foreachwikiindblist wikidataclient extensions/Wikibase/lib/maintenance/populateSitesTable.php --force-protocol https (T264963) [production]
19:15 <Amir1> start of foreachwikiindblist wikidataclient extensions/Wikibase/lib/maintenance/populateSitesTable.php --force-protocol https (T264963) [production]
18:13 <Urbanecm> Morning B&C window done [production]
18:12 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 45312d359442d274e83deb7be80f86e12fb9e864: [WikibaseMediaInfo] Fix concept chips array nesting structure (T256431) (duration: 01m 05s) [production]
18:12 <mepps> updated payments-wiki-staging from db03677b2d to 5fdd29bc16 [production]
18:09 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: d94e33ff39b300c74fcaf08d1746c089fb1af783: cirrus: Hardcode more_like to codfw cirrus cluster (duration: 01m 05s) [production]
17:56 <XioNoX> configure FB PNI in eqdfw [production]
17:43 <ppchelko@deploy1001> Synchronized php-1.36.0-wmf.14/skins/WikimediaApiPortal: Backport gerrit:635329, T266021 (duration: 01m 06s) [production]
17:34 <ppchelko@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Switch ParserCache to JSON on testwiki gerrit:635382 (duration: 01m 05s) [production]
17:24 <ppchelko@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable ParserCache logger for warn+, gerrit:635071 (duration: 01m 08s) [production]
17:21 <ppchelko@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable ParserCache logger for warn+, gerrit:635071 (duration: 01m 06s) [production]
17:13 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
17:13 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:58 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:57 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:57 <mutante> scandium - disabling puppet so that Parsoid team can make some tests on testreduce1001 today [production]
16:46 <effie> restart php-fpm and pool mw2252 and mw2328 [production]
15:58 <Lucas_WMDE> Deployed patch for T260349 [production]
15:34 <ppchelko@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'api-gateway' for release 'production' . [production]
15:33 <ppchelko@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'api-gateway' for release 'production' . [production]
15:31 <ppchelko@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . [production]
15:28 <moritzm> updating prometheus-openldap-exporter to 0+git20171128-3 to buster-wikimedia [production]
15:23 <jbond42> upgrade puppetlabs-stdlib to 6.5.0 https://gerrit.wikimedia.org/r/c/operations/puppet/+/634278 [production]
15:07 <moritzm> imported prometheus-openldap-exporter 0+git20171128-3 to buster-wikimedia T264388 [production]
15:02 <otto@deploy1001> Finished deploy [analytics/refinery@e4d16f0] (hadoop-test): deploying with updated camus to test cluster (duration: 02m 56s) [production]
15:01 <crusnov@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:00 <otto@deploy1001> Started deploy [analytics/refinery@e4d16f0] (hadoop-test): deploying with updated camus to test cluster [production]
14:56 <crusnov@cumin1001> START - Cookbook sre.dns.netbox [production]
14:44 <reedy@deploy1001> Synchronized wmf-config/wikitech.php: Set CURLOPT_RETURNTRANSFER true in gerrit handler T242554 (duration: 01m 07s) [production]
14:34 <dcausse> restarting blazegraph on codfw servers (T263952) [production]
13:21 <moritzm> pooling ldap-replica2003 T264388 [production]
13:04 <liw@deploy1001> Synchronized php: group1 wikis to 1.36.0-wmf.14 (duration: 01m 04s) [production]