My ultimate MythTV whole house setup.

April 1, 2008

Upgrading my Front Ends

Filed under: Front Ends — tjscientist @ 5:48 pm

OK, time to make some changes / upgrades; I am going to start with Gonzo (My Master Bedroom Front End).

The motherboard is a VIA EPIA M10000G with 1 Gig RAM and a 1 Gig CF (used to be an old Laptop HD). I want to try running either MiniMyth or KnoppMyth from the CF. I found tutorial for running MiniMyth from the CF, but I would rather stick with something I know and that is knoppix. SO… I am holding out for a KnoppMyth solution.

Additionally, this box has a Microsoft (It was the cheapest, so give me a frickin break!)  USB IR receiver and remote and a USB 802.11G wireless network Adapter.
A lot of people allow their systems to boot over the network and although that does have some really cool implications, I do not think it is right for me. To begin with, this system is running on the wireless network (802.11G). Second, these (ITX) systems are also in the kid’s rooms and they use them for email, IM, web surfing, etc. and I want them to be able to run even if the backend is down (which is not very often but…).

I asked about CF installation of the KnoppMyth on their message board but did not get any responses (yet). That being the case, I am going to try to do this myself. 

I am going to take a closer look at KnoppMyth to see just how closely it resembles the original Knoppix. In particular, does it still contain the ability (cheat code) to have a persistent home directory and save config information. If it does, I will just do a “standard” CF install of KnoppMyth and configure the home and config directories.

If it does not, I will add those features back into a remastered version and then have what I need.

More to come…

March 17, 2008

Disappointment…

Filed under: Hardware — tjscientist @ 10:29 pm

I am somewhat disappointed. It seems that even though I have this really cool RAID card that allows “on the fly” addition of disk drives, it really is not working for me.

It seems that after a new disk is added, the file system does not know what to do with the “raw” space. FreeBSD is reporting the added space, but I can not grow the file system to utilize it.

I really hope that this is just a lack of knowledge on my part and someone can offer suggestions. I have exhausted all of my resources (FreeBSD forums, FreeNAS forums, RocketRAID forums) and not found an answer except to save my data and reformat… Not what I was hoping for.

Any ideas? Anyone? Anyone? Bueller?

February 11, 2008

Storage topology rearrangement

Filed under: Storage, Topology — tjscientist @ 11:06 pm

With the New NAS on the way (see previous post) I have decided to make a couple changes.

First, I am going to remove MP3 and photo storage from the MythTv boxes and move them to the NAS boxes where the data is more secure.

Second, I am considering adding a “working server” as I call it. This box will be a pretty high end system in my office running Fedora and replacing my current system on port 14. Other than giving me a bit more power, this system will do transcoding tasks for the MythTV boxes. Right now, there is so much new stuff getting recorded on to the network that the transcoding tasks are getting way behind. This should help alleviate that problem.

Additionally, I should be able to use the old MB in my new NAS box so I don’t have to buy a new one.

New rack mount NAS box

Filed under: Storage — tjscientist @ 10:54 pm

Well, believe it or not, I am once again out of room. That means I will be adding another NAS to the system but wait…

With the price of hard drives falling like a rock and a new (at least to me) RAID controller from HighPoint, I am going to diverge a bit from the past. Here is my plan…

NAS Beta (the NAS connected to switch port 3) is currently a tower case with only 1.15 TB. I will back this up to NAS Alpha (port 2) and use some of it’s parts for a new rack mount NAS Beta.

The parts for this will be as follows:

1 - Intel PCIe (4x) Gigabit Ethernet
1 - HEC RA251C00F 2u rack chassis
1 - 450 Watt power supply (from old box)
1 - New Mother Board with at least 2 PCIe (4x minimum) slots (less than $50.00 with CPU at newegg)
1 - PCIe 2U riser (this has been the hardest thing to find so far, arrrrrg!)
1 - 500 Meg RAM (from old box)
1 - 1 Gig IDE CF card (from old box)
1 - SATA to IDE connector
1 - Highpoint RocketRAID 2320 (hardware RAID 5 with up to 8 SATA-II drives)
4 - 1 TB Western Digital HDs (future upgrades to eight)

Of course the FreeNAS OS will be on the CF. The HighPoint RAID card allows hot swap online capacity extension which (I believe) means I can add 1 TB drives as needed until the max capacity of the card is reached (8 drives). This means that I should have 3 TB usable initially and be able to increase this box to 6 TB usable (wow!!!).

As for the power supply, I am going to mount it on a metal plate that mounts behind the chassis to keep the chassis cooler, allow better airflow for the PS itself, and allow more room for HDs.

I thought about moving the HDs to a separate chassis, but I am still thinking about it. I plan on doing these mods this weekend so hopefully I can take some pix to post as well.

More to come…

October 23, 2007

Cameras

Filed under: Hardware — tjscientist @ 7:15 pm

I had a question about cameras and thought I would talk about picking good cameras for the job at hand.

More to come…

The Hardware…

Filed under: Hardware — tjscientist @ 5:57 pm

Below is a link that will open a new window and show a spreadsheet of all my hardware. I have not been keeping it up-to-date very well but it at least gives you an overview. I will try to update it this weekend so it is a more accurate representation of my hardware.

Link to Hardware spreadsheet

The main Backend server (Dragonfire)

Filed under: Uncategorized — tjscientist @ 5:34 pm

I am going to talk about this box specifically as it was my experimental box for many years and this is where I try new things out.

More to come…

Network Attached Storage (NAS)

Filed under: Storage — tjscientist @ 4:14 pm

I really like having the NAS for several reasons. First and foremost, it takes the drives out of the servers and allows them to be administered independently. Next, I can split up media across the different NAS devices to reduce the load on a particular server. For instance…

I know that all of my security cameras will want to talk to their respective storage boxes on a consistent 24/7 basis. To keep this from interfering with someone watching movies, I simply assign one NAS to security and the network switch keeps the bandwidth usage to the security back ends and their respective NAS. I also separate music and photos to a separate NAS as these are relatively low bandwidth and can benefit from having their own shared NAS. Last, I keep the kids videos and non-kid videos on separate NAS boxes to alleviate bandwidth problems when let’s say two of my teens are watching two different shows, two of my under 10 kids are watching two separate videos, and me and my wife are watching separate videos. Now this situation does not happen too often but as you can see, the system can be serving 6 independent videos, recording videos from the security cameras and recording shows from the satellite systems with very little overall network bandwidth.

Each Network Attached Storage (NAS) device is an “old box” running the open source FreeNAS server. For instance, my NAS RAID 5 on port 4 consists of the following:

a - An old Pentium 333 MHz MoBo.

b - Three 128 Meg SIMMs for RAM.

c - An IDE to CF converter (~$9.00) and a 1 Gig CF (~$14.00) for the OS and associated files.

d - A RAID 5, 4 port, SATA II 3GB/Sec PCI card.

e - A 10/100/1000 PCI Intel Network Adapter.

f - Four 1 TB Western Digital SATA drives.

With all the above hardware, I have about $1000.00 invested. Try to find a commercial unit for anything close to that price!!! When I started making my NAS systems, I simply put in one HD at a time as money would allow and slowly built up from there.

Here is a good place to talk about a few essentials that most people do not think about in this day and age… How to save processor cycles and speed up data flow.

First off let’s talk about the Hard drive controller. You can get a cheap (less than $20.00) controller and use software RAID to handle the drives but this is at the expense of CPU cycles and data throughput. It also puts a heavy load on the PCI bus slowing things down even further. If however, you spend a little extra and buy a HD controller that has hardware RAID (I use RAID 5) built in, you save all that overhead.

Why do I use RAID 5? For me it seems like the best trade offs. If you use RAID 0/1 striping and mirroring, you only get half your “bought for” storage space (e.g. four 1 TB drives yields 2 TB storage). If you use no RAID (JBOD or the like) you get no data backup or safety net. RAID 5 allows you to get 3/4 your “bought for” storage (e.g. four 1 TB drives yields about 3 TB of storage) and you get data backup through parity. If one drive fails, replace it and the RAID 5 card will rebuild the failed drive… No data lost. It takes a bit of time, but I think it is worth it.

Now let’s talk a bit about the network card. This conversation goes much like the one above. If you buy a cheap (sub $20.00) network card, you simply get what you pay for. The reason the card is cheap is because there is very little processing hardware on the card, most of the processing happens via the loaded driver and thus the burden is on the system CPU.

Now, if you buy a bit more expensive cards, I like the $49.99 Intel cards myself, you keep most of the processing on the card and away from the main CPU. This also reduces bus traffic as each packet does not have to be analyzed and processed by the system CPU, and increases network throughput.

This same philosophy carries right on through to video and video capture cards which can be extremely system CPU intensive. This is why capture cards with MPEG encoding are imperative (IMHO).

‘nough said.

My Network Topology

Filed under: Topology — tjscientist @ 3:34 pm

 Please click on the picture below for a full size (and better resolution) view.

Network Topology

I have a spreadsheet I will upload that details each of the pieces delineated on the above drawing.

An introduction.

Filed under: Uncategorized — tjscientist @ 3:32 pm

Over the past several years I have been slowly building up my “whole house” entertainment, security, and controls systems. I used to (and still do) drool at the multi-thousand dollar systems the rich put in their homes and do my best to get the same performance with less than 1/10th the cost. So far I have been doing quite well, if I do say so myself.

The reason I am starting this Blog is simply due to the number of questions I get from people who have seen my setup. A lot of people want to know how to put one of their own together, they want to know how mine is different, how my network is configured, and what hardware I am using.

Catching everyone up to date on my current system may take a bit of time but I will start off with a topology drawing and work my way up from there. I will not go into the specifics of initial setup as that has been covered many times on many other sites. Instead, I will talk about my overall system, how I expanded on the original idea, and where I see things going in the future.

For the most part (at least right now) this blog will serve as a place to keep notes on my current system and to write down my thoughts on expansion.

Blog at WordPress.com.