1701-1750 of 10000 results (66ms)
2020-02-24 §
08:33 <marostegui@deploy1001> Synchronized wmf-config/etcd.php: Add es4 and es5 (unused new external store sections to etcd - T245806 (duration: 00m 58s) [production]
08:29 <marostegui> Temporary put es1020 (es4) and es1023 (es5) on RO on a mysql level - T245806 [production]
08:28 <marostegui@cumin1001> dbctl commit (dc=all): 'Add instances to es5 codfw - T245806', diff saved to https://phabricator.wikimedia.org/P10491 and previous config saved to /var/cache/conftool/dbconfig/20200224-082848-marostegui.json [production]
08:07 <marostegui@cumin1001> dbctl commit (dc=all): 'Add instances to es4 eqiad - T245806', diff saved to https://phabricator.wikimedia.org/P10490 and previous config saved to /var/cache/conftool/dbconfig/20200224-080708-marostegui.json [production]
08:01 <marostegui@cumin1001> dbctl commit (dc=all): 'Add instances to es4 codfw - T245806', diff saved to https://phabricator.wikimedia.org/P10489 and previous config saved to /var/cache/conftool/dbconfig/20200224-080128-marostegui.json [production]
07:31 <cdanis> dbctl: edit es4/es5 sections in eqiad (flavor & master & min_replicas fields) T245806 [production]
07:30 <cdanis> dbctl: (and min_replicas field) T245806 [production]
07:29 <cdanis> dbctl: edit es4/es5 sections in codfw (flavor & master fields) T245806 [production]
07:12 <marostegui@cumin1001> dbctl commit (dc=all): 'Pool db1107 for 10.4 testing in special slaves group with weight 10 - T242702', diff saved to https://phabricator.wikimedia.org/P10488 and previous config saved to /var/cache/conftool/dbconfig/20200224-071201-marostegui.json [production]
07:03 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1107 for 10.4 testing in main and API - T242702', diff saved to https://phabricator.wikimedia.org/P10487 and previous config saved to /var/cache/conftool/dbconfig/20200224-070337-marostegui.json [production]
06:40 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1101:3318 after removing partitions - T239453', diff saved to https://phabricator.wikimedia.org/P10486 and previous config saved to /var/cache/conftool/dbconfig/20200224-064044-marostegui.json [production]
06:32 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1101:3318 after removing partitions - T239453', diff saved to https://phabricator.wikimedia.org/P10485 and previous config saved to /var/cache/conftool/dbconfig/20200224-063258-marostegui.json [production]
06:22 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1101:3318 after removing partitions - T239453', diff saved to https://phabricator.wikimedia.org/P10484 and previous config saved to /var/cache/conftool/dbconfig/20200224-062226-marostegui.json [production]
06:01 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1101:3318 after removing partitions - T239453', diff saved to https://phabricator.wikimedia.org/P10483 and previous config saved to /var/cache/conftool/dbconfig/20200224-060118-marostegui.json [production]
05:57 <marostegui> Repool labsdb1011 - T245797 [production]
2020-02-23 §
16:52 <elukey> powercycle mw1372 - no mgmt console, no ssh [production]
15:17 <Urbanecm> mwscript importImages.php --wiki=commonswiki --comment-ext=txt --user='𐰇𐱅𐰚𐰤' /home/urbanecm/T245950 (T245950) [production]
2020-02-22 §
03:41 <dzahn@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
03:37 <dzahn@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
02:17 <dzahn@cumin1001> START - Cookbook sre.ganeti.makevm [production]
02:16 <dzahn@cumin1001> START - Cookbook sre.ganeti.makevm [production]
02:13 <mutante> ganeti - removing instances apt1001/apt2001 again, starting over [production]
01:53 <mutante> starting new ganeti VMs apt1001 and apt2001 for OS install (WIP, not prod) [production]
01:03 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
01:01 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
00:45 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
00:43 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
00:41 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
00:39 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
00:21 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
00:19 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
00:18 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
00:15 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
2020-02-21 §
23:26 <dzahn@cumin1001> START - Cookbook sre.ganeti.makevm [production]
23:24 <dzahn@cumin1001> START - Cookbook sre.ganeti.makevm [production]
23:05 <andrewbogott> updated (?) wikitech-static to 1.34.0 [production]
22:01 <sbassett@deploy1001> Finished scap: Deploy security fix for T232932 (duration: 05m 35s) [production]
21:56 <sbassett@deploy1001> Started scap: Deploy security fix for T232932 [production]
21:53 <andrew@deploy1001> Finished deploy [horizon/deploy@a8f2ea9]: added a warning about the public git history to the hiera edit panel -- take two (duration: 03m 41s) [production]
21:49 <andrew@deploy1001> Started deploy [horizon/deploy@a8f2ea9]: added a warning about the public git history to the hiera edit panel -- take two [production]
21:45 <andrew@deploy1001> Finished deploy [horizon/deploy@13ca90a]: added a warning about the public git history to the hiera edit panel (duration: 00m 11s) [production]
21:45 <andrew@deploy1001> Started deploy [horizon/deploy@13ca90a]: added a warning about the public git history to the hiera edit panel [production]
21:23 <mutante> LDAP - added ldickinson to wmf [production]
21:23 <mutante> LDAP - added dduvall to archiva-deployers [production]
21:22 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
21:20 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
21:15 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
21:12 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
21:00 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
20:58 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]