genderindex.org

Birdhouse Hosting is pleased to welcome genderindex.org, which is actually two related sites running on two related platforms. genderindex.org runs on Drupal, while my.genderindex.org runs on Django.

The Social Institutions and Gender Index (SIGI) is a new composite measure of gender discrimination based on social institutions. It measures gender inequality in five areas: Family Code, Physical Integrity, Son Preference, Civil Liberties and Ownership Rights in 102 non-OECD countries.

zip vs. tar + gzip

Just had the need to create an archive of a folder containing 91 large text files, totaling 370MBs. Decided to pit zip against tar + gzip in a little speed test, using these commands:

tar cvzf awstats.tgz awstats
zip -9ry awstats.zip awstats

On the server in question, these were the elapsed times to accomplish this very similar task:

zip: One minute, 21 seconds
tar: 41 seconds

This is, in part because tar only has to compress once, after concatenating all the bits together (but that’s not the full story). In contrast, zip has to compress each file individually. And resulting archive sizes?

-rw-r--r-- 1 cdt cdt 141877473 Mar 8 10:31 awstats.tgz
-rw-r--r-- 1 cdt cdt 140081519 Mar 8 10:29 awstats.zip

So zip did have a slight advantage in the output size. But wait.. no fair! We used the “-9” option with zip for maximum compression. To make it more fair, let’s use the “-9” flag with gzip as well. Unfortunately, to do that we’ll need to run two consecutive commands:

$ tar cvf awstats.tar awstats ; gzip -9 awstats.tar

This caused the compression time for gzip to go way up; that command took 1:17 to run. But now the filesizes are approaching identical:

-rw-r--r-- 1 cdt cdt 140090837 Mar 8 10:42 awstats.tar.gz
-rw-r--r-- 1 cdt cdt 140081519 Mar 8 10:29 awstats.zip

Of course these kinds of things are very circumstantial – doing a similar test on a folder full of pre-compressed files like MP3s would yield very different results (in that case you’d be way better off just using tar without gzip, and definitely not zip). But the upshot is that when trying to decide whether to use zip or tar + gzip, compression times and output sizes are close enough to just not matter in general usage.

Update: I did end up doing a later test on the same dir with bzip2. Result: significantly smaller file size:

-rw-r--r-- 1 cdt cdt 104698994 Mar 8 14:17 awstats.tar.bz2

but at the expense of much longer compression times. If I use gzip and bzip2 side by side on the same 370MB tar file, I get these times:

gzip: 41 seconds
bzip2: 1 minute 36 seconds

Making bzip2 almost twice as slow as gzip (though it does generate smaller output files).

Four Eyes

I’m in alien territory here. Over the past few months my vision has become increasingly blurry, both when reading and when reading signs at a distance. I’ve been lucky enough to have enjoyed a life of perfect vision so far, but those days are gone. I’m officially old. Had my first encounter with an optometrist yesterday, went through the whole dilation and eyeball pressure gizmo thing, and walked away with a prescription.

Now I’m about to join the “other” half of society and think about frames.  No idea which way to go. Took some shots in a glasses store today. I think some of these are downright goofy, but I’ll let you be the judge of that. Any of these look halfway decent, or should I keep shopping? Refer to row/column if you have opinions.

And yes, I’ve always wanted a monocle, but doesn’t seem like that’s going to be practical this time around.

Click through for pix.
Continue reading “Four Eyes”

Home Backup to the Cloud

Four years ago, long before Time Machine and the wide availability of cloud storage, I purchased a RAID/NAS for home backups. It’s done its job admirably, and has given us the confidence to back up the whole family without fear of drive failure. Even went as far as drilling holes in the floor and threading CAT-5 under the house so I could keep the Infrant in the closet, where it would make less noise.

It’s worked well, but the big problem it didn’t solve is the fire/flood/theft scenario. One good earthquake and all those images and videos of our child’s early years would be Gone Daddy Gone. Plus, my backup system was based on rsync. That worked fine, but was a bit too manual, and I had had occasional problems getting backups to complete to the non-Mac filesystem on the Infrant.

This problem had been hovering in the back of my mind for quite a while, when a dad at the local park mentioned that he had had  success with Backblaze. For $5/month, you get hands-off unlimited backup of your entire system to their data center. Drive space is dirt cheap these days, so it’s tempting to rely on purchased drives, but let’s do the math. Let’s say you spend $100 for a 500GB drive.  That’s the equivalent of  20 months of Backblaze service. If you go for the one-year commitment, you get the service for $4/month, so let’s say two years for the drive you just bought “cheap” to pay for itself. And you still haven’t got fire/flood/theft insurance. Seemed like a no-brainer to me, so I went for it.

My starter data set was 300 GBs – a healthy pile of bytes. Backblaze noted that the initial backup could take a couple of weeks, but in my case, the initial backup took more than three weeks, even over a fast broadband connection. After the initial backup  is complete, incrementals happen quickly, with no  interaction required.

Installation and backup management takes place through a preference pane on the Mac. It’s elegant, but I did have some problems along the way. At a certain point, halfway through the initial backup period, the pref pane informed me that the backup was complete, even though it wasn’t. It continued to report this for the next 10 days, even though I could see the bztransmit process chugging away in the background. The pref pane  provides a count of the number of files and their total size; to get this to update, I’d have to unmount and remount my external data drive, then wait 3-4 hours for the process to rescan volumes and report new information.

At this point,  I’ve made it through the initial backup and have added 150MBs of new data  to the external drive. The preference pane does not report any change to the totals, even though I have confirmed that the newly added files are available on Backblaze servers. I also had a number of instances where the bztransmit process would swell to consume very large (> 2GBs) amounts of memory. In some cases, the process memory would eventually come back down on its own. In others I had to manually kill all bz* processes and restart the backup process. It’s as if the backup process is running fine, but the preference pane is  unaware of what those processes are actually doing. Annoying, but not a deal-breaker.

I corresponded with Backblaze tech support during the process, and found them super-responsive, and not afraid to share detailed technical analysis of the process. They weren’t able to answer all of my questions about why the pref pane didn’t seem to know what the backup process was actually doing, but they were super detailed and quick, and I appreciate that.

Despite these glitches, my test restores have all gone well.

There is one little financial  hitch in my plan: That $4/month is only for one machine. I’ll have to spend more to be able to back up other computers in the house. I’m still mulling that one. In any case, it feels great to know that my backups are complete, even if disaster hits the home some day. And now that the glitches of the initial backup period have passed, it should be pretty smooth sailing ahead.

There are other cloud backup systems for the home out there, like CrashPlan and Amazon S3 with S3Hub. I haven’t tried them. If you have, what have your experiences been like?

Beyond the Bayou Auction and Soiree

Miles attends the most excellent co-op elementary in Richmond, CA. Very strong parent participation, rich involvement in music and the arts, strong emphasis on science and the environment, loving teachers, etc. But the school struggles to make ends meet. Every year we host a public auction/soiree’. Local businesses donate products and services, great food comes out of the woodworks, hot bands play.

This year the auction night will be Bayou themed, and we’re really looking forward to it. Live in the Bay Area? This is a night not to be missed, especially if you’re looking for a fantastic elementary school. But even if you aren’t, there are great deals to be found on everything from days at the Chabot Science Center to bottles of absinthe. I’m donating a year of Plan B web hosting.  Pre-bidding on items starts at biddingforgood, with additional bidding continuing at the event.

It’ll be a great night out. Interested? Contact me, or see the school’s auction page for more info.

delicious word cloud

wordle.net not only lets you generate tag clouds out of any chunk of text (which can be great for doing things like figuring out which keywords a politician emphasizes the most in a speech), it can also scan your delicious bookmarks to give you a weighted view of the kinds of things you keep track of. Kind of a zeitgeist snapshot of the inside of your head. It appears that I bookmark work-related/tech stuff almost exclusively. I do have a lot of non-tech bookmarks in delicious as well, but they’re drowned out in the frequency ranking by webdev stuff.

Sundry Images, Feb 2010

Just returned from the most amazing rain walk with Miles. Two full hours in the drizzle, revisiting haunts and trails we’ve enjoyed since he was three. Came to grab some of the images from the day and realized I hadn’t downloaded images from the iPhone for a very long time. Here’s a sundry collection of fun stuff from the past six months. Visit the Flickr Set to see these with captions.

Flickr Set

Mundus Journalism and More

A ton of excellent new sites maintained by journalists and artists have been added to the Birdhouse Hosting roster over the past couple of months, including:

angelajbass.com
Angela highlights issues related to women, girls and people of color in the Bay Area and abroad, and groups that have been historically misrepresented by the media.

annavictoriabloom.com
Bloom began working in journalism as a newspaper reporter in Park City, Utah, covering everything from the Sundance Film Festival to skiing to town hall politics.

exactcenter.net
As a science teacher, I have the special privelage of getting to know my students and enjoy every one of them for what they teach me as well as what I might teach them. The values of their parents and the raw culture of our society greet me each day as plain as the eye can see when I walk into every class.

good4uproductions.com/raisetheroof
Raise The Roof is a free iPhone app with one simple goal in mind: to get you to dance with your iPhone and have a little fun. The app gives meaning to that infamous dance move “raise the roof.”

greentuliphandmade.com
Green Tulip designs for textiles, T-shirts and the Web are truly handcrafted one by one. The look of each design is original because each design is made from scratch. Green Tulip designs are made from materials that feel good in the hands: paper, scissors, glue. Each design is defiantly non-digital to ensure a handcrafted feel even online.

kimbennett.net
Kim Bennett is an artist and writer based in the San Francisco Bay area.

mundusjournalism.com
An international consortium of universities and media outlets work closely together to run the Mundus Journalism programme.

noahbuhayar.com
I am currently a candidate for a master’s in journalism at the University of California, Berkeley. Before graduate school, my background was mostly in print journalism. Now, I am focusing more on producing multimedia features for the Web, particularly on business topics.

sethrf.com
“My undergraduate thesis, which began with a summer at the Hebrew University in Jerusalem, was on connections between the Unique Games Conjecture and semidefinite programming-based approximation algorithms.”

All sites also listed at the ever-growing list of Birdhouse Hosting Sites.