page_title: Dropbox-2016-04-04 page_touched: 20160408002411 old_text: ===Monday=== * Configure foreman to support xenial builds * Build whm-zoot3 with xenial Use stock puppet Potential problems with starting the splunkforwarder ** Remove obsolete open-vm-dkms modules * Work on building wallet * Label cables to the stack-2 systems * Build stack-2-1 as xenial * Upgrade keddie to stretch
===Tuesday=== * Update DHCP server at sfo4 to only hand out SJC DNS servers * Install dropbox arcanist
mkdir arc
cd arc
git clone ssh://repo@tails.corp.dropbox.com/diffusion/DBARC/dropbox-arcanist.git arcanist
git clone ssh://repo@tails.corp.dropbox.com/diffusion/DBLIBPHUTIL/dropbox-libphutil.git libphutil
ln -s /home/whm/arc/arcanist/bin/arc /home/whm/bin/arc
Try and figure out why arc is failing after upgrade to stretch
/home/whm/arc/arcanist/bin/arc queue-status PHP CONFIGURATION ERRORS You need to install the cURL PHP extension, maybe with 'apt-get install php5-curl' or 'yum install php53-curl' or something similar.Install php7.0-curl to fix the problem with arc
Find stuck puppet systems
select id, name, last_compile, updated_at from hosts where updated_at < '2015-10-30' and updated_at > '2015-10-27' order by nameWork on stuck puppet systems it-git-02 - read only file system, rebooted ipmanager - read only file system, reboot does not fix the problem corpmon9 - old lock file, remove file and run oneshot aus-netsrv-02 (172.17.8.18) - delete from foreman, update DNS snc-it-munki-03.corp.dropbox.com - archived by sre, not changed snc-cron-01 - read only file system, reboot and oneshot santosh-vm - read only file system, reboot and oneshot zviad3-vm - remove lock file and oneshot jklai-vm - read only file system, reboot onehot jesse-vm - remove lock file and oneshot jdubie-vm - remove lock file and oneshot hanz-vm (bn-vm) - oneshot, stange name shift ** bryan2-vm - read only file system, reboot and oneshot
===Wednesday=== * Disable Anton's access * Update puppet support for xenial
===Thursday=== * Build us-sfo5-stack-3/4 * Rename the reset of the stack systems twice * Land diff for xenial reprepro update * Land diff with common packages for all systems and for servers * Create ipmi dhcp diff changes * Submit ticket for port changes to support ipmi on the netsrv's at brannan
?DropboxLogs 394. row