How many times have you found something at work that’s not quite how it should be? Perhaps you’ve got a server with “Green” drives in? Or a cheap unmanaged switch somewhere. Or something with a self-signed SSL certificate. Or a linux box instead of a router. Or a desk fan propped up behind a server, because otherwise it overheats. Or something with a big label above that states in large, unfriendly letters **“Do not unplug....

I’ve had enough interviews over the last few years to realise that there’s a few different styles of interviewing out there, and they all suck. There’s the “impossible question” style - Like The Barometer Question . There’s the shocking “group interview”. There’s the Phone Interview - where I usually end up going off on tangents, and talking for 50-90 minutes. There’s the technical challenge interview, which vary between awesome and terrible, depending on how they’ve been implemented....

I thought I’d have a play with AWS’s latest offering “OpsWorks”, and see if they’ve done us all out of a job. Well, kinda. OpsWorks is interesting. It’s basically hosted chef, with EC2 integration. The immediate “drawbacks” to some are that there’s only two supported distributions, Ubuntu 12.04 LTS and Amazon Linux. It’s also incredibly rough around the edges. It’s easy to sign up to, and it adds a service to the AWS management console....

Do not use any of the defaults shown below. I would no longer recommend a security group rule for port 22 to 0.0.0.0/0 This has been roughly adapted from this ServerFault question for the case when it gets removed/deleted/closed. The question was about how to configure a Flash game server on Linux, but on EC2. I had a good look around, but didn’t find any true step-by-step EC2 tutorials for proper beginners....

This is the brief story of how PDFTribute.net came to be, and survived being linked to from some of the top world news sites. My good friend, Patrick Socha, so moved by the outpouring of data associated with the twitter hashtag #pdftribute set up a quick and dirty twitter archive, extracting tweets containing links. I had a look at this, realised it looked awful on mobile (I was on a bus at the time!...

2012: A year in review. So.. 2012.. What can I say.. Quite a lot, actually. When I last wrote an annual retrospective, it was 2011 going into 2012, and I’d just started at Baseblack, one of many Soho-based VFX studios. I had a good 12-odd months there, before the credit crunch hit the entire London VFX industry, and I was made redundant in October. Over my time there I wrote a lot of puppet manifests, built a render farm based on Dell Blade servers, undertook a Hitachi HNAS administrator course, learned how to use Maya, Realflow, Nuke, Shake, PFTrack, Silhouette, and a whole bunch of other VFX packages too numerous to mention....

“John, I can’t get Jurassic Park back on line without Dennis Nedry.” Words you never want to hear uttered. Unless you work for InGen, it’s highly unlikely. Although there is the remaining problem of the Human Single Point of Failure (HSPOF). After you’ve spent the last year or two eliminating the single points of failure from your computational infrastructure, you realise that you’re the only one who knows which cronjobs run when, and on which servers....

So.. it transpires that I have a friend who studied Physics at Imperial College, and as a part of that, was taught how to use C++ “As a tool to help with computational physics”. - His words, not mine. As a result, he has no explicit knowledge of some of the finer points of C++ programming, no idea how a binary search algorithm works, why you’d use a Deque and when you’d use a Vector....

I get easily tired of doing the same thing over and over again, and will, wherever possible, script or automate it to make life easier for myself. This could be in the form of a lightweight webapp/REST api for stuff, or in this case, I used Jenkins. So on one server, we sometimes need to reload apache. As we don’t like developers randomly executing shells on live servers, it’s better to just allow access to a few specific commands, in this case, a wrapper script on the target server’s /usr/local/bin that just wraps “/etc/init....

Interesting thing of the day: Milo, Ron, et al. “Network motifs: simple building blocks of complex networks.” Science Signalling 298.5594 (2002): 824. Fulltext available from Google Scholar: - http://bit.ly/YAstgD It occurs to me that in scalable systems engineering (the sort of thing I do for a living), you only tend to see Bi-fan networks and Bi-parallel ones. Bi-fan is rougly equivalent to a cross-connected core switch whereas Bi-parallel is a good representation of a Virtual IP with Load balancer....