Experimenting with btrfs in production.

  data_storage geek_porn hardware howto leandra btrfs libreops exocortex

EDIT - 20201206 @ 2216 UTC-7 - Added how to remove a hard drive and replace it with a bigger one to upgrade. EDIT - 20200311 @ 1859 UTC-7 - Added how to replace a dead hard drive in a btrfs pool.

EDIT - 20191104 @ 2057 UTC-7 - Figured out how long it takes to scrub 40TB of disk space.  Also did a couple of experiments with rebalancing btrfs and monitored how long it took.

A couple of weeks ago while working on Leandra I started feeling more and more dissatisfied with how I had her storage array set up.  I had a bunch of 4TB hard drives …

Read more...

Organizing a data hoard with YaCy.

  configuration data exocortex leandra search yacy library

 It should come as little surprise to anyone out there that I have a bit of a problem with hoarding data.  Books, music, and of course files of all kinds that I download and read or use in a project for something.  Legal briefs, research papers (arXiv is the bane of my existence), stuff people ask me to review, the odd Humble Bundle... So much so that a scant few years ago I rebuilt Leandra to better handle the volume of data in my library.  However, it's taken me this long to both figure out and get around to making …

Read more...

Life and times.

  busy life mental_health rant work arch_linux lvm raid weird leandra howto

Long time readers are probably wondering where I've been lately.  The answer is kind of long and is worth a post all on its own.  The short version of the story is, work's been eating me alive lately.  This is our busiest time of year and it's been all hands on deck for a couple of weeks now.  In point of fact, last week was our quarterly all-hands meeting, where everybody on my team was flown into town for a solid week of meetings.  All day, every day.  Most of my visible activity lately took the form of parts of …

Read more...

Home IT fail.

  backups commute computers fail fml gonzo hardware home leandra life magick network work

As you no doubt have observed I've been conspicuously absent for the past couple of weeks, at least since returning from a long-overdue vacation with Lyssa in lovely Portland, Oregon. Much of my time has been spent at work doing the things that bastards like me get paid to do: run and fix backups, install software, patch systems, run audits, and generally keep things chugging along smoothly for the folks who do everything else. Due to the weather in the DC metroplex taking a turn for the rainy and cold (as it's wont to do every Samhain) my commute has …

Read more...

Network update: Leandra back online.

  announcement hard_drives howto leandra linux lvm procedure raid storage the_network

Maintenance on Leandra is finished. I took her offline around 2100 ESET5EDT on Saturday night to remove a dead DVD-ROM drive, remove a pair of 512GB memory modules that weren't doing anything, and swap out her 250 GB hard drive for a 500 GB drive. The RAID array has had 250 GB added to it; specifically, the logical volume holding everything but the /boot and / partitions has had 250 GB added to it. 15 GB from the free pool was added to /usr (so that more software could potentially be installed) and the rest of the free disk space was …

Read more...

Sorry 'bout the downtime, folks.

  apache computers configs dammit gentoo leandra portage stuff upgrades

A good bit of yesterday was spent monitoring Leandra as she upgraded her systemware and applications, which amounted to watching the output of various compilation batches (thank you, Portage) and making sure that nothing went horribly wrong. However, something did, in the form of a major change between revisions of the Apache web server, which had the net effect of making all of the config files obsolete and unusable. I discovered it last night while watching Leandra boot back up, but was too tired after work to do anything about it.

It appears that service is restored to all of …

Read more...