551-600 of 10000 results (39ms)
2024-08-07 ยง
17:31 <brennen@deploy1003> brennen, bd808: Continuing with sync [production]
17:30 <milimetric@deploy1003> Started deploy [analytics/refinery@0d25645] (thin): Syncing browser general script, and refinery-source 0.2.45 apparently [production]
17:29 <brennen@deploy1003> brennen, bd808: Backport for [[gerrit:1060468|Revert "Drop writeapi flag from siteinfo API" (T115414 T294397 T371977)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
17:29 <milimetric@deploy1003> Finished deploy [analytics/refinery@0d25645]: Syncing browser general script, and refinery-source 0.2.45 apparently (duration: 54m 21s) [production]
17:27 <brennen@deploy1003> Started scap sync-world: Backport for [[gerrit:1060468|Revert "Drop writeapi flag from siteinfo API" (T115414 T294397 T371977)]] [production]
17:25 <greg-g> added thcipriani as owner of jenkins@wikimedia.org google group, removed myself [releng]
17:19 <wmbot~dcaro@urcuchillay> START - Cookbook wmcs.ceph.wait_for_rebalance [admin]
17:17 <brett> stop pybal on lvs1019 for server reboot [production]
17:14 <brett> start pybal on lvs2014 [production]
17:11 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host lvs2014.codfw.wmnet [production]
17:08 <brett@cumin2002> START - Cookbook sre.hosts.reboot-single for host lvs2014.codfw.wmnet [production]
17:07 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker1296.eqiad.wmnet with OS bullseye [production]
17:07 <wmbot~dcaro@urcuchillay> END (PASS) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=0) [admin]
17:06 <wmbot~dcaro@urcuchillay> START - Cookbook wmcs.ceph.osd.undrain_node [admin]
17:06 <wmbot~dcaro@urcuchillay> END (PASS) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=0) [admin]
17:05 <wmbot~dcaro@urcuchillay> START - Cookbook wmcs.ceph.osd.undrain_node [admin]
17:05 <wmbot~dcaro@urcuchillay> END (FAIL) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=99) [admin]
17:04 <wmbot~dcaro@urcuchillay> START - Cookbook wmcs.ceph.osd.undrain_node [admin]
17:03 <wmbot~dcaro@urcuchillay> END (FAIL) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=99) [admin]
17:03 <wmbot~dcaro@urcuchillay> START - Cookbook wmcs.ceph.osd.undrain_node [admin]
17:03 <wmbot~dcaro@urcuchillay> END (FAIL) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=99) [admin]
17:02 <wmbot~dcaro@urcuchillay> START - Cookbook wmcs.ceph.osd.undrain_node [admin]
17:02 <wmbot~dcaro@urcuchillay> END (FAIL) - Cookbook wmcs.ceph.osd.drain_node (exit_code=99) [admin]
16:56 <wmbot~dcaro@urcuchillay> END (ERROR) - Cookbook wmcs.ceph.wait_for_rebalance (exit_code=97) [admin]
16:50 <wmbot~dcaro@urcuchillay> START - Cookbook wmcs.ceph.osd.drain_node [admin]
16:50 <wmbot~dcaro@urcuchillay> END (FAIL) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=99) [admin]
16:49 <wmbot~dcaro@urcuchillay> START - Cookbook wmcs.ceph.osd.undrain_node [admin]
16:46 <wmbot~dcaro@urcuchillay> END (FAIL) - Cookbook wmcs.ceph.osd.drain_node (exit_code=99) [admin]
16:45 <wmbot~dcaro@urcuchillay> START - Cookbook wmcs.ceph.osd.drain_node [admin]
16:42 <brett> stop pybal on lvs2014 for server reboot [production]
16:40 <wmbot~dcaro@urcuchillay> END (FAIL) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=99) [admin]
16:39 <wmbot~dcaro@urcuchillay> START - Cookbook wmcs.ceph.osd.undrain_node [admin]
16:39 <wmbot~dcaro@urcuchillay> END (FAIL) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=99) [admin]
16:38 <wmbot~dcaro@urcuchillay> START - Cookbook wmcs.ceph.osd.undrain_node [admin]
16:38 <wmbot~dcaro@urcuchillay> END (FAIL) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=99) [admin]
16:37 <mutante> puppetserver1002 systemctl start dump_ip_reputation [production]
16:36 <wmbot~dcaro@urcuchillay> START - Cookbook wmcs.ceph.osd.undrain_node [admin]
16:35 <wmbot~dcaro@urcuchillay> END (FAIL) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=99) [admin]
16:34 <milimetric@deploy1003> Started deploy [analytics/refinery@0d25645]: Syncing browser general script, and refinery-source 0.2.45 apparently [production]
16:34 <wmbot~dcaro@urcuchillay> START - Cookbook wmcs.ceph.osd.undrain_node [admin]
16:34 <wmbot~dcaro@urcuchillay> END (FAIL) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=99) [admin]
16:33 <wmbot~dcaro@urcuchillay> START - Cookbook wmcs.ceph.osd.undrain_node [admin]
16:32 <wmbot~dcaro@urcuchillay> END (FAIL) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=99) [admin]
16:31 <wmbot~dcaro@urcuchillay> START - Cookbook wmcs.ceph.osd.undrain_node [admin]
16:31 <wmbot~dcaro@urcuchillay> END (FAIL) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=99) [admin]
16:30 <wmbot~dcaro@urcuchillay> START - Cookbook wmcs.ceph.osd.undrain_node [admin]
16:30 <milimetric> deploying refinery to sync hql [analytics]
16:28 <wmbot~dcaro@urcuchillay> END (FAIL) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=99) [admin]
16:28 <wmbot~dcaro@urcuchillay> START - Cookbook wmcs.ceph.osd.undrain_node [admin]
16:27 <brett> start pybal on lvs2013 [production]