1301-1350 of 10000 results (49ms)
2018-03-14 ยง
12:53 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1074 (duration: 01m 14s) [production]
12:39 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1074 (duration: 01m 15s) [production]
12:22 <kartik@tin> Finished deploy [cxserver/deploy@c204d9c]: Update cxserver to c355d0c (duration: 03m 12s) [production]
12:19 <kartik@tin> Started deploy [cxserver/deploy@c204d9c]: Update cxserver to c355d0c [production]
12:14 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Slowly repool db1074 (duration: 01m 14s) [production]
11:45 <marostegui> Stop db1074 for kernel upgrade [production]
11:44 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1074 for data checks and kernel upgrade (duration: 01m 14s) [production]
11:36 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Restore original weight for es1018 after kernel and mariadb upgrade (duration: 01m 15s) [production]
11:02 <moritzm> rebooting einsteinium / icinga.wikimedia.org for kernel security update [production]
10:54 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Slwoly repool es1018 after kernel and mariadb upgrade (duration: 01m 14s) [production]
10:37 <marostegui> Stop mariadb on es1018 for kernel and mariadb upgrade + change socket location [production]
10:35 <moritzm> rebooting hydrogen for kernel security update [production]
10:35 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool es1018 for kernel and mariadb upgrade (duration: 01m 14s) [production]
10:23 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool pc2006 after kernel and mariadb upgrade (duration: 01m 14s) [production]
10:22 <jynus> dropping testotrs from m2 [production]
10:16 <jynus> archiving and dropping bugzilla_testing from m2 [production]
10:10 <marostegui> Stop mariadb on pc2006 for kernel and mariadb upgrade + change socket location [production]
10:09 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool pc2006 for kernel and mariadb upgrade (duration: 01m 14s) [production]
10:07 <jynus> archiving and dropping testblog from m2 [production]
10:03 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool pc2005 after kernel and mariadb upgrade (duration: 01m 15s) [production]
09:50 <marostegui> Stop mariadb on pc2005 for kernel and mariadb upgrade + change socket location [production]
09:50 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool pc2005 for kernel and mariadb upgrade (duration: 01m 14s) [production]
09:44 <moritzm> installing samba security update (just the client side libraries) [production]
09:40 <marostegui> Stop mysql on es2015 to upgrade socket path [production]
09:37 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool pc2004 after kernel and mariadb upgrade (duration: 01m 14s) [production]
09:34 <marostegui> Stop mysql on es2014 to upgrade socket path [production]
09:23 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool pc2004 for kernel and mariadb upgrade (duration: 01m 14s) [production]
09:23 <marostegui> Stop mariadb on pc2004 for kernel upgrade [production]
09:13 <marostegui> Stop mysql on es2013 to upgrade socket path [production]
09:08 <marostegui> Stop mysql on es2012 to upgrade socket path [production]
08:57 <ema> cp3041: restart varnish-be [production]
08:55 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Fully repool es1013 after kernel and mariadb upgrade (duration: 01m 15s) [production]
08:28 <ema> cp3040: restart varnish-be [production]
08:21 <hashar> Restarting the CI Jenkins [production]
07:45 <marostegui> Reboot es2004 for kernel upgrade [production]
07:45 <marostegui> Reboot es2003 for kernel upgrade [production]
07:34 <marostegui> Reboot es2002 for kernel upgrade [production]
07:21 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Slowly repool es1013 after kernel and mariadb upgrade (duration: 01m 14s) [production]
07:03 <marostegui> Stop mariadb on es1013 for mariadb and kernel upgrade [production]
06:59 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool es1013 for kernel and mariadb upgrade (duration: 01m 14s) [production]
06:45 <marostegui> Deploy schema change on db1064 with replication (this will generate lag on s4 on labs hosts) - T187089 T185128 T153182 [production]
06:39 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1064 for alter table (duration: 01m 14s) [production]
06:30 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1097:3314 after alter table (duration: 01m 15s) [production]
03:13 <mutante> bacula is working again - restored missing file set (https://gerrit.wikimedia.org/r/419341 ) [production]
02:49 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.24) (duration: 05m 40s) [production]
02:44 <Jamesofur> deleted 46 archived files [production]
02:18 <mutante> helium - running bacula-dir with -f in foreground revealed: ERROR TERMINATION at parse_conf.c:485 - Config error: Could not find config Resource mysql-srv-backups - line 7, col 33 of file /etc/bacula/jobs.d/bohrium.eqiad.wmnet-mysql-predump-piwik-Weekly-Wed-production.conf [production]
02:17 <mutante> helium - bacula director process failed (Bacula interrupted by signal 11: Segmentation violation), icinga alerted. attempted to restart it. then: bacula-dir - the configtest failed! [production]
00:01 <reedy@tin> Synchronized wmf-config/InitialiseSettings.php: crwiki logo (duration: 01m 15s) [production]
00:00 <reedy@tin> Synchronized static/images/project-logos/crwiki.png: (no justification provided) (duration: 01m 14s) [production]