70cities blog

Thoughts on Scalecamp

2009-12-13T10:18:00.000Z

The other Friday I attended Scalecamp, one of these 'unconference' jobbies - organised by the Guardian. I'm not a very conference-y person, but given that I'm in the big data game and have come up against (and overcome) many a scaling problem in the past, I thought it'd be good to pop along and see what was happening.

It was certainly very well-organised, with everyone knowing what they were doing - obviously quite a few of the organisers/attendees had done this sort of thing before, whereas I hadn't. I enjoyed a few of the talks and sessions, particularly the ones that touched on Hadoop and Memcached, because they're very useful/interesting to us. Quite a lot of NoSQL data warehousing dogma floating around the industry already, which I did my best to puncture - I probably had my most interesting discussions here.

I was also quite taken aback at how few Perl hackers I met there. Bar one or two exceptions, most of whom I knew or I've worked with already, it's all about Python, Ruby, PHP and Java these days. I felt about 5,000 years old.

Any negatives? Not really - I had to skip out when the talks had finished and so missed the sponsored beers, which was a bit of a pain. Also, some nerds really need to find where their shower is. Seriously - it's not difficult. BO is very much the elephant in the room (almost literally) at any gathering of geeks. In fact, I might do a lightning talk on it at some point in the future*.

In other news, I'm worried that I've developed an allergy to certain premium brand lagers. No, really..

* This is a joke.

It's a numbers game

2009-11-28T10:37:00.002Z

I seldom talk/blog/tweet/etc about work directly, mostly because I never have the time, but I'm feeling quite proud that I can point out a couple of things I've been directly involved in in one way or another:

Jo Hamilton, Head of Audience Measurement writes on the BBC Internet Blog and shares a data pack with insights about BBC iPlayer's usage in October 2009 - a record month across all platforms.

And John Linwood (BBC FM&T CTO, AFAIK) has been sharing similar traffic and audience statistics with a great infographic.

All of the audience-oriented statistics are derived from the internal iStats data collation, warehousing and analytics system I designed, built and now product manage as part of my role in the BBC's Future Media & Technology division.

The public release of this data above is, hopefully, a step in the direction of sharing more data about how iPlayer's content gets consumed. I'd expect more data to be trickling out soon if the thirst is there.

One day I might sit down and write an 'official' blog on the detail of the system and how it works.. if anyone's interested, that is.

Note: this is a personal blog and my views aren't necessarily those of the BBC, or anyone else for that matter. Ahem.

Twonk

2009-11-19T00:45:00.004Z

I like Twitter. I find it more useful now than I imagined when I signed up for it three years or so ago. For me, its usefulness began when a few close friends of mine, and some of my family, started using it in earnest. Then it became a tool for just working out where people were and what they were up to, as much as it was for stalking celebrities, getting news feeds, discovering links and feeling plugged into the zeitgeist. As nonentities and companies started flooding the service, I stayed resolutely private and felt isolated from it all, because I had my 30 or so followers who I also followed and who largely all followed each other too. More broadcast-y than instant messaging and less arduous than blogging, Twitter's always had an IRC channel vibe for me, which I really like.

(Incidentally, I dumped Facebook three or four months ago. Best move I've ever made)

Recently, though, I started wondering if I've been missing out on the other ways of using it and consuming the nonsense it could potentially push to me, so I renamed by private account and created a public account as well, so I could use that to follow the few public figures and news bots I'm vaguely interested in, and possibly start talking about non-whingey work stuff in a more involved way. The private account remains for all necessary cathartism and gossiping.

So what do I make of the wider Twitter universe, outside of my imposed bubble? Well, first impressions aren't necessarily good. I see a lot of:

Self-appointed 'social media expert' types, grinning out from their avatars in a state of perpetual self-satisfaction, waiting for the gravy train to pull in at the next stop
Comedians continually whoring out their latest non-hilarious endeavours
Spates of irritating hashtag trends - #movieswithunemployedpeople, etc
Masses and masses of linkspam, which is what tumblr is bloody for
General pushy careerist types being quite mean and rude about other people

And so on. The linkspam thing is the most interesting one, though. I've seen it happen every time a new fad comes along - users just leap on it and funnel everything they want to say, share or play with through it. Maybe Twitter is just too simple, too useful to people to stay within its original constraints, and an inevitable part of mass acceptance are the antipatterns above (and more).

Notes on making iTunes play nicely with an Airport Disk and Airtunes

2009-07-26T23:00:00.000+01:00

OK, so six months later, along comes another post. This time it's practical, and a result of the experiences I had recently in trying to downsize my CD collection and shift all of my music onto a shared NAS drive. As it happens, our network at home is already based around an Airport Extreme sase station that supports the attachment and sharing of USB disks as network drives - so I purchased a cheap-arse Western Digital 1TB USB external drive, formatted it as HFS+ (non-journalled), shoved it into the back of the AEBS and away I went..

Setup: iTunes 8.2, Macbook 2nd Gen, OS X Tiger 10.4.11, Airport Extreme, Airport Express with Airtunes.

1. Telling iTunes what to do

Changing the location of the iTunes Library in the preferences and then using 'Consolidate Library..' is by far the easiest option for physically moving all your songs. See Apple's official guide here. All your metadata is preserved and it all Just Works. One pain - you have to copy over the network, so ideally, connect your Mac to the base station using a network cable rather than using wireless for this move as it'll be much, much quicker.

An alternative, do-it-yourself approach that gets you more control over where your music lives is manually editing the paths in the iTunes Music Library.xml file using a text editor. You still have to delete the actual library database and re-import the XML file into iTunes. This way you can connect the eventual NAS drive to your Mac's USB port, copy all the music across, connect it to the AEBS and hammer iTunes into doing the right thing by changing the paths in the XML file. However, for novices or people without much time on their hands, I wouldn't recommend this approach. YMMV.

2. Don't put everything on the NAS

Keeping your album art & iTunes databases on your Mac's local disk seems to be the smart option regardless of how you migrate your music (the Consolidate Library method works this way). You can't shove the whole of iTunes' working files on the NAS and expect that to be speedy - or, even worse, assume that you can share a single library between two instances of iTunes in this way. This is because iTunes continually updates its database files as it's working.

3. Check your wireless network

The performance of your wireless network is by far the biggest factor in making iTunes not suck donkey's balls with this setup. Connected via wired Ethernet, you should find day-to-day performance (including CD ripping) pretty much on par with having the library on local disk, with maybe a second or two of lag occasionally.

Over Airport, though, it's a different story. If your Airport network is not performing well - something you might not usually realise if all you ever do is access and download files from the Internet, as your Internet connection will always be much slower than the speed your wireless network ought to be capable of.

When iTunes attempts to play a file, it will buffer a certain amount of the file into memory before it starts playing it, so achieving low network latency is essential for this process to appear snappy enough to not be annoying - nothing's going to irritate you more than iTunes beachballing every time it moves from track to track.

Things to check:

Your wifi mode - 802.11b/g/n ?
Interference from nearby networks - use iStumbler or a similar wireless network tool to see if certain channels are crowded with networks, and move your network to a less busy channel.
Overall signal strength - is your AEBS positioned optimally? Are all wireless clients getting a good signal? Use the statistics function of Airport Utility (hidden away in the 'Advanced' tab of 'Manual Setup') to see how your Airport network is performing and be prepared to move the base station(s) around to achieve better speeds/less interference.

4. Airtunes bumpiness

Solving point 3 should also solve any AirTunes performance issues you might be having. AirTunes works by streaming a losslessly-encoded version of the music stream to the Airport Express base station, which in itself should not tax a modern 802.11g (or better) network but a weak signal can increase drop-outs and stuttering. By moving the AEBS a little higher and the Express a little nearer to get the best signal-to-noise ratio, I've had it working pretty seamlessly.

An edge case to be aware of is if you have any music encoded in any non-iTunes native codecs - that is, any other than MP3, AIFF or AAC - it cannot be sent over AirTunes. Even through iTunes can play Ogg Vorbis, etc via Quicktime - it can't send files encoded in these formats over AirTunes, which is annoying when files such as these show up in playlists. Even more annoying is that if it's streaming to a set of remote speakers and encounters such a track, iTunes doesn't just skip it - it'll play it out loud on the local computer, whilst the remote speakers go silent! This is annoying, and I can't help wondering if it's more of a 'feature' to get you to migrate all your music into Apple's own formats rather than free, open-source codecs like Ogg Vorbis. That said, if I was that much of a militant open-sourcer I wouldn't be using iTunes in the first place, so I can't get too righteous about it.

5. Some things are just going to take longer

Wireless just isn't as good as wired for some things. With the convenience of sending data around wirelessly comes certain trade-offs. iTunes may feel less snappy when navigating your library and jumping between songs, as it waits for the wireless disk to catch up. This will annoy you for a week or two, but then the great adaptive nature of the human brain kicks in and you'll just get used to it.

Anyway, I hope that's of use to some people struggling to get this sort of setup working. It's still a little way off being the perfect wireless-music-anywhere nirvana I was gunning for, but it does feel like I've freed up my listening a bit.

Start

2009-01-02T17:34:00.005Z

Given how infrequently I bother posting here, I thought there'd at least be some amusement value at posting at the very beginning of the year. True to form, I'm already off by one day.

Anyway, happy 2009. Being thousands of miles away from home gives a strong feeling of dislocation, not just physically but psychologically. I lost track of the weekdays almost immediately when we arrived, irrelevant as they are when you've got nothing to do. And the fact it's a brand new year hasn't really registered yet. 2008 was difficult in many ways, so I'm not exactly sad to see the back of it and have the chance to use the division of a new year starting to attempt to try and sort out various things.

As if by chance, today marks the tenth anniversary of me starting my first professional web development job. In 1998/9, jobs that had anything to do with the internet were both rare and fuzzily defined at best - so when I landed a job as a 'Webmaster' at a forward-thinking advertising agency in Newcastle, 6 months after leaving university and kicking around in temp jobs, I was pretty excited. In retrospect, I was very lucky, in the right place at exactly the right time. To think I'd end up where I am now, doing what I'm doing, would have been certifiable insanity.

So, whilst I don't exactly yearn for the days of administering hundreds of sites being served from a tired Powermac running System 7.6 on the end of a dial-back ISDN line, and building them out of handcranked HTML, Lasso and Filemaker Pro (shudder), I'm grateful for the in-at-the-deep-end head start I got on things in my 18 months there.

We don't arrive back in the UK until Tuesday, so I've still got plenty of time to think about what happens this year. There are vague plans, and whole areas where I just haven't done the thinking yet. Meanwhile.. ten years. Blimey.

Far, far away

2008-12-21T00:07:00.004Z

The last few days were the hardest.

Never mind the months of late nights, missed deadlines, malfunctioning servers, storage constraints, crap data, uncertain roadmap, pressure, bad decisions (mostly my own), new surprises, misbehaving databases, etc etc. I work hard, I can work hard, I do work hard and I work on the kind of project that requires hard thinking, experimentation and ingenuity. So I can do all that - but once I knew that our long-since-planned break was around the corner, it got so much harder.

A week or so before we left, I half-joked to everyone that the moment we arrived, I'd get ill. It was inevitable, I said - indeed, it happened last time we came to San Francisco, like clockwork. The 11 hour plane ride - the longest stretch of time I'd spent doing nothing in several months - is the cue for my body to shut down all the defences, stop fending off all the bugs and actually get ill.

I finished up, made sure everyone knew vaguely what they had to do in my absence, worried about minor things that hadn't quite been done but were still niggling, unsure as to whether everything we'd achieved in the run up to Christmas was enough. Couldn't stop reading emails I'd already read twice, for nuances I might have missed. Then I was told in no uncertain terms to get the fuck out the office - in a nice way.

Home, pack, pizza. Sleep - fitfully. Wake, early. Rush around, ensure cat is OK, worry about cat, cab arrives. No time left.

M4, Heathrow, check in. Lounge - yay! Breakfast. Departure gate - upgrade! In your face! A good omen and a surprise which made the holiday feel that little bit extra special.

11 hours later, arrive. Tired, but excited. SFO, a greeting with antlers, cab to SoMa. Already, I can feel gunk building up at the back of my throat. Possibly just the air pressure or a reaction to something? No. It's a cold. The cold I've been putting off for months and months through adrenaline and exhaustion.

48 hours later - better. Jetlag's hit us like a hammer but staying up as late as we could and sleeping as late as we can has seen most of that off, hopefully. So nice to be back here again. Our gracious hosts are wonderful and we've rented, by accident, the world's most enormous car to dart around in. Haven't felt like drinking much due to the tiredness but I think I'll remedy that tonight. Mini-break in Sonoma hopefully sorted. Miles away - literally- from the pushing and pulling of our normal lives.

We needed this holiday and it's finally happened. Now - time to think. What's next?

Beautiful URLs

2008-12-13T13:22:00.001Z

http://service.o2.co.uk/IQ/SRVS/CGI-BIN/WEBCGI.EXE/,/?St=413,E=0000000002116867044,K=3744,Sxi=2,question=ref(User):str(Mobile),CASE=obj(12891)

Makes the heart sing, doesn't it?

Bright Lights

2008-10-11T10:20:00.003+01:00

I had yesterday off work (mostly anyway) and so spent most of the day alternating between boring-but-necessary chores and catching up on shows I'd bookmarked to watch/listen to. Bliss. In the evening, I headed out for a beer - ironically with people from work, although none of whom I actually work with, so that's OK. It's a big company, that can happen and I rather like it.

On the way to the pub I get suddenly redirected by the invitation to impromptu birthday drinks in town. I'm game, so I head to Covent Garden rather than Shepherd's Bush. It's not a hard choice to make.

I end up in a trendy basement lounge/bar arrangement - it's happy hour, and half full of local suits and fashionistas taking advantage of the half-price cocktails. The music's just one long anonymous boom-chk-boom affair, accurately blared out at the level at which it's impossible to have a reasonable conversation with anyone. I know a fair few people there who I've not seen in ages, and with whom I'd appreciate the chance to catch up with, but there's no chance of that. I sup a mojito, which took half an hour to procure and about three minutes to drink.

T, who's 8 months pregnant, shows up with her SO, who I've not met before. She introduces me as 'the smartest guy I know'. I offer a rebuttal, offering that I'm perhaps the tallest guy she knows. The half-joke gets lost in the din.

Hotpanted girls - I don't know if there's a name for them, or what their job titles could possibly be - float around and proffer test tubes full of God-knows-what. It's too loud to find out, and anyway my carefree vodka jelly days are very much over.

H and L show up, and we attempt to catch up. It's nice to see everyone but it's just not happening. Having made sure I've seen everyone for a hello, I slip quietly out and head home.

I'm hungry, so I scoff the tuna salad in the fridge, and am subsequently taken over by the spirit of Peter Rabbit. Conked out on the sofa in a rum/lettuce coma, the cat sits on my head. Zzzzz.

Iterative

2008-10-05T10:20:00.003+01:00

Well, a seven month hiatus - not bad going, really. 2008 has been the most hideously busy, stupidly packed year yet, and it's not over.

Things I've been up to:

Designed and built a highly-parallelisable log processing engine, based on Map/Reduce principles
Sweated blood in the process
Been to York for a stag weekend, and ended up spending two nights in a dreadful 80's-themed nightclub
Bought a new suit that doesn't make me look or feel like Tony Blair
Went to Newcastle and wrote off our car
Went to Scarborough for a wedding
Bought a new car (shiny!)
Spent a fantastic week in the North York Moors
Stayed in a posh apartment complex in Leeds
Struggled with being afflicted with recurring chronic sinusitus
Drank a lot of tea/coffee
Bought an iPhone
Obtained new eyesight prescription and face furniture, which allows me to drive at night at last
Waved sister-in-law and boyf off to live in San Francisco

So, not much really.

TwitterIgnore

2008-04-20T18:58:00.003+01:00

I've been playing with Greasemonkey a bit lately as I wanted to refresh my Javascript/DOM foo. I needed something to build, so I searched in my big red plastic bucket of irritations and knocked up a user script that lets you hide Twitter tweets from a definable list of users without actually unfollowing them - so you can selectively ignore people for periods of time without them being any the wiser - thus avoiding any potential awkwardness. Social networks are delicate things - they're made up of humans, after all.

(This was inspired during SXSWi, when half my Twitter follow list went and I didn't, and the endless noise about it got quite wearing - but I didn't want to unfollow anyone as my Twitter universe is generally quite lovely and interesting).

http://userscripts.org/scripts/show/25365

Mux it up

2008-03-26T12:01:00.002Z

In common with everyone else with an internet connection this week, I heart Muxtape a lot. Simple, no-nonsense, works. Here's mine, although I've no idea how often I'll ever update it. Needs RSS to track changes, perhaps? Mmm. Then I could plumb it into the uberfeed and whatnot.

In other news, since VD Day passed and I shut down all the Amazon EC2 stuff, I've been mostly working, going to the Isle of Wight, drinking beer, eating nice food, hacking around with a potentially-quite-useful Twitter hack using Greasemonkey and not having my hair cut...

Be My Anti-Valentine - a technical perspective

2008-02-16T11:30:00.011Z

After many hours of toil, Meg and myself opened the doors to this year's By My Anti-Valentine site a couple of weeks ago. Redesigned, revamped, relaunched with the hope that it won't fall over under the strain of the traffic it generates on Valentine's Day itself, as it has always done previously.

Given that my involvement in the project is one of technical architect, developer and sysadmin (Meg is the ideas, UX and design brains of the effort), it's probably worth me explaining a bit about the technology that drives the site and the problems that we came across last year and have tried to solve (or at least mitigate) this year.

By 2007, Meg had been running the VD cards site seasonally for six years, driven by a variety of successive flat-file systems and ultimately a generic PHP-based freeware card sending application (Sendcard, I think) that just about did the job but frequently caused her server to go belly-up once the traffic to the site reached its inevitable peak on the 14th February.

The problem was that the "choose card-send email to recipient" workflow was completely synchronous and linear within the application, so the emails were dispatched to the outgoing email server within the same web-spawned PHP Apache process. Naturally, once a few hundred people at a time were hitting the 'Send Card' button, the host's SMTP service would run out available connections and stop responding. Also, PHP 4's rather, ahem, unpredictable DB connection handling under load would generally explode along similar lines. Cue lots of server errors and general mayhem as the whole thing fell apart.

So, when I stepped in last year and volunteered to make the problems go away with a bespoke web app written in Perl to suit Meg's desired functionality, I made a few sensible design decisions. Over the years I've had to deal with my fair share of scaling problems and integration issues, so I built in a few tricks of the trade.

As it turned out, the site worked nicely for the few weeks before the 14th of February.. until it didn't. As it turned out, the traffic the site got was so enourmous that even moving it to its own dedicated, beefy server (kudos to Pair, Meg's hosting people, for being extraordinarily quick to do this) couldn't make it cope. Even extensive caching couldn't save the server from falling over.

So for 2008, whilst reconsidering our options, I decided to give Amazon EC2 - their Xen virtualisation cloud - a whirl. I'd heard plenty about it and had tinkered with virtualisation at work, but never gone the whole hog, and the cynic in me didn't buy the spiel that spinning up working application instances was as easy as a web service call.. but yes, by gum, it works a treat. Initial setup is a bit fiddly, but tools like the EC2 Firefox UI and S3Fox are a godsend when you're trying to do stuff quickly.

The site runs on a group of replicated server instances running a heavily customised version of Ubuntu 7.10 Gutsy, all identical with the exception of one (which I call the 'master', though not a Doctor Who homage) that also runs MySQL and the card-sending backend app. All the other instances connect to the master database when creating a new card or retrieving one for display. This is a pretty naïve architecture, but it works as the percentage of card senders against the overall site traffic is pretty small (less than 7% of visitors choose to send a card). Therefore MySQL isn't doing very much at all, and I didn't need to spin up a separate MySQL server instance to cope, which reduced the overall cost and was one less server instance to manage.
The rest of the application stack is fairly standard - Apache 2, FastCGI, Perl.

So what happened on the day itself? Well, we had a *tiny* bit of a wobble at around 13:00 GMT, when the east coast of America woke up (55% of users come from the USA), but I coped by spinning up another server instance and offloading some of the remaining site furniture onto Amazon S3 with some 302 redirects - which made a huge difference. Once the traffic started to drop off on the 15th, I was able to decommission three instances and balance the load across the remaining two, which coped admirably.

Paul's Top N Web Scalability Tips

Never maintain state on your web server. The moment you have to keep a user on a specific application instance for their state to be persisted, you lose all hope of ever scaling the sharp end horizontally. Keep state in your database (or on a shared filesystem if you're a masochist).

Decouple the web interface from backend systems. You don't send emails straight from a web-spawned process. You just don't. In fact, you shouldn't connect to anything other than a database server. Email servers are strange, unpredictable beasts and they generally need to be handled with care. Don't expose one to a process pipeline that you can't explicitly control (namely, a public web server!).

So, when a card instance is 'created' by a user on the VD site, an email object is created and stashed into a database table that effectively acts as a queue. This gets polled by a cron job at regular intervals and the emails get despatched in series. This means the email server is only ever under a constant load, which can be managed depending on what sort of performance you need.

Cache everything you can cache. If a page never changes, save it out to a cache directory on your filesystem and have the web server serve that instead of building a dynamic page on every hit. Thankfully the VD site only really needs to invoke the application when someone sends a card or retrieves one from a link they've been sent, so I took advantage of that and had easy cache-building methods that I could call to generate flat HTML pages. ('Proper' setups have caching loadbalancers like ZXTMs in front of their servers that can do this transparently, but of course I don't have that luxury and was trying to KISS). Which all leads me on to...

mod_rewrite is your friend. I can't rave about mod_rewrite enough. It's easy to get scared by URL rewriting if you're not comfortable with regexes and the general HTTP request handling mechanism in Apache, but it's actually incredibly simple to use with a bit of messing around and most modern web frameworks rely on some form of rewrite engine. The ability to abstract your URL scheme from the physical filesystem brings endless possibilities.

The VD site uses it not only to map its tidy URLs to the application endpoint (what us old-schoolers still call a CGI script), but to rewrite certain URLs to serve flat files from the cache directory but keeping the external URL the same, so turning it off has no effect on the end user. Also, with the flick of a hash character in the global .htaccess file, I can have the all the bandwidth-heavy images served from a CDN - Amazon S3 in this case - rather than the app servers.

Always use INSERT DELAYED when you don't need the row back - Class::DBI, the Perl ORM engine the VD site uses, isn't very good at this, so I had to roll my own methods here, but it was worthwhile - you save a few vital queries when you're stashing your state away and trying to get back to completing the user's request as quickly as possible.

In retrospect I wouldn't have used Class::DBI in the first place, but that's another story..

Phew! That's it over for another year, then. There's a whole bunch of other stuff I could go into (the joys of dealing with Spamcop..), but that's the story thus far. I'm chuffed at having got through a Valentine's Day without having to watch a single server helplessly grind to a halt under the weight of the traffic burst that a site like BMAV inevitably generates, and incredibly impressed that Amazon EC2 makes virtualisation accessible and affordable for projects like this. EC2 FTW!

Sad news

2008-01-20T23:06:00.000Z

Curry Hell man dies

Tragic news. I had the honour of working closely with Mr Latif back in the day when I was a jack-of-all-trades web monkey, and maintained the Rupali and Curry Hell websites. I can honestly say I've never met a man more dedicated to the twin pursuits of selling incredibly hot curry to pissed-up Geordies, and honest-to-goodness self-publicity.

A man so generous, he thought nothing of ordering me a free cab back to the office when a lunch-hour visit turned into a three-hour curry/booze fest - whereupon I fell asleep in the sofa in reception and got woken up by the marketing director of the coincidentally recently-deceased Pennine Windows, who was coming in expecting to update his web site.

He'll be sorely missed. Particularly by anyone who had a lamb phaal at his restaurant in recent days.

RIP Mr Latif. Off to his very own Curry Heaven, festooned with party hats and Cobra beer.

Gamed

2008-01-13T10:02:00.000Z

I barely ever play computer games. Consoles, whathaveyou - I've just never had much of an interest in any of it. Back in the 80's, when I was growing up and spent hours slaving over a hot ZX Spectrum, I was far more interested in learning how to write stuff and make it do interesting things than spending hours killing aliens or whathaveyou.

The games I liked then, and still do to this day, are the really simple platform/puzzle type ones. Lunar Jetman, Spellbound, Jet Set Willy, Technician Ted, the Dizzy games, Starquake. My later Atari ST, primarily a games machine much like the Amiga, spend most of its life playing simple platformers. When Driller came out and pioneered the immersive 3D worlds that everyone's used to now, I got bored pretty quickly. Later, when I had a PC, stuff like Rise of the Triads, and Sin gave way to pretty brain-dead stuff like Carmageddon. And even then only briefly. I get bored with games so easily.

In fact, in those rare times I find myself in a gamey mood, I don't reach for my non-existent PS2 or Wii and fire up World of Timewasting or whatever - I use a Spectrum emulator and play Starquake, as I have been for over 20 years (I've only finished it twice - I find the gameplay fun, not the end goal). I just don't get games, really. I just don't care.

Maybe it's the same reason I barely read any fiction or watch any films? Just writing that down makes me sound like some uncultured idiot, I know - but the truth is I get enough from current affairs, technology, comedy and music to keep me occupied for a lifetime and I sort of marvel at those who find the time to glue themselves to an Xbox 360 for hours on end or watch tons of films/boxsets. I can only conclude that I got short-changed somewhere along the line and everyone else in the world gets a thirty-hour day.

HNY

2008-01-01T23:45:00.000Z

Happy new year! Just when I was finally getting into the swing of 2007, the damn thing goes and ends.

Highlights of 2007 included:

Going to San Francisco and discovering Northern California
Doing some interesting stuff at work after a period of uncertainty
Snooker: seeing the Masters and the World Championships in Sheffield
Gadgets: new Macbook in Feb, and iPod Touch in November
Turning thirty (am fine with it now, in fact I really quite like it)
Spending lots of time with M and P and other nice people
Listening to the Beatles a lot

Lowlights included:

Project getting canned
Subsequent project floundering and getting canned
Not seeing my friends from the North nearly enough
Various worries, stresses and strains I couldn't do anything/much about
Being afflicted with weird sinusy problems as well as having a really crap hayfever year

2008? Changes afoot... hopefully.

2007-12-23T23:20:00.000Z

Finally, now I've reached the correct side of the Christmas holidays, I can relax a bit. The last few weeks have been intense really took it out of me. The physical manifestations of this have been interesting - big bags under my eyes, not having a haircut for four months (big mistake - I looked scruffy, but not the 'good' scruffy I was half-aiming for - just 'bloody awful' scruffy), etc.

Anyway, the new version of the thing I work on launched and it's all gone very well. Now to rest up for a bit and do very little for a bit, except eat cheese, drink wine and generally expand. Marvellous.

It's a test.

2007-12-20T14:57:00.000Z

Test.

Dear Santa...

2007-12-16T23:38:00.000Z

I want..

To not think about work for a few days on the trot
Much less inadvertent exposure to Russell Brand/Winehouse/Jo Brand/Spice 'Girls'
Less worry
Beatles remasters
To spend less time on buses
Last.fm to work with my iPod Touch without having to jailbreak the thing
Spend more time hanging out with M and P
To see my friends more
More sleep
A haircut
More coffee
More music
A decent suit that doesn't make me look like a Suit
A greater variety of lunch options
To learn the banjo
A house
World peace

Kthxbai!

Ding dong

2007-12-10T08:41:00.000Z

Despite being one third of the way into December, it's only just dawned on me that it's Christmas very soon. In, like, 15 days. All the music channels on telly are rotating their crappy Christmas songs playlists - which, as they've got so much airtime to fill, are at least throwing up some amusingly bad, previously forgotten festive tunes. Paul McCartney and the fucking Frog Chorus, anyone? I saw it yesterday afternoon for the first time in 25 years and remembered exactly why it's never included on cheapo Chrimbo compilation CDs - even in a genre so pant-wettingly mawkish and feeble as christmas singles, it has a level of awfulness that stands proudly alone. Shudder. Next to this, Cliff Richard's seasonal efforts are verging on a punk ethic.

Anyway, Christmas. Shit! I've barely done a thing about it, what with one thing and another. Must knuckle down and get organising. Unfortunately, this week is already stacked full of Christmas parties and a slew of work to finish off. Who in the name of God decided to put our works Xmas party on the night before a big deployment? (Maybe it's the other way around - even so, someone needs a poke in the eye with a sharp stick).

I really suck at blogging

2007-12-05T21:29:00.000Z

Let's face it, it's just not happening, is it? I still might turn this into a link/video/mp3log though. I do plenty else around the web; I just don't do much of the whole writing thing. Too many people do it better than I.

Of various things of disinterest that've been happening lately, I bought a new iPod the other day. One of those touchy ones in fact, and it's very nice. Twice the space of me old Nano, and video playback - all very nice, but those features pale into comparison compared to the multitouch interface. I'm no feverent Apple fanboy, but my word, it's a thing of beauty to use. Coincidentally, I got a new mobile recently too (a Nokia 6500) with a view to using that as a bit of a mobile video playing doodah - but despite it having the technical chops to do so, the interface is so clunky and awkward that I completely gave up after about ten minutes. Now I can catch up with the new series of the Boosh on the bus home from work. Marvellous. The future's arrived!

However, despite what Steve Jobs and other Californians might think, ubiquitous open wifi is still rather a rarity. Even in my office, where there's dozens of sniffable networks, only one is unencrypted and even then it won't give me an IP address, most likely being MAC address-restricted. And I spend half of my life on buses anyway. So for that, my phone still trumps (and actually has a fairly decent browser to be getting on with).

That's about it, though. Other than that; work, sleep. Lie around. Repeat.

2007-09-29T10:32:00.000+01:00

I've been on holiday!

Yes. Hence my silence recently. There's been a much-needed break in the wilderness, away from all things technological and busy. It's been wonderful. Now I sit in a plush hotel in Leeds, soaking up the free wi-fi as we made the sensible decision to break the journey back to London in two and meet up with some old friends - which was wonderful. I'm full of eggs benedict, good coffee and Frosties. Now it's time to hit the road and get back home.

I'm so behind on everything it's pointless trying to catch up on it all. I even gave up halfway through reading all my usual webcomics; somehow, daily content doesn't work so well when trying to read a lot of it in one go.. maybe I need to look at one of those webcomic reading apps I hear people talking about.

Applause?

2007-09-15T11:50:00.000+01:00

From an email I just received inviting me to apply for tickets to bunch of new TV shows:

"***COMING SOON*** THE KATIE PRICE & PETER ANDRE CHAT SHOW"

Arrrrrrgh! The death of reason is finally upon us. Make it stop!

2007-09-13T09:10:00.000+01:00

So the Adblock saga that's been rumbling along for a while is finally reaching a peak, with people cottoning on to the fact that it's potentially (in theory) damaging to the very revenue streams that make the Web 2.0 world so tasty, supple and pliant. So much so that you've even got mechanisms for sites to block Adblock-enabled Firefox browsers.

This is a bit nuts, no? To me it smacks of classic internet kneejerkery. Where's the evidence that all these bottom lines are being eroded? There isn't any - this is all supposition and FUD at the moment.

Adblock, and browser plugins like it, came about because web advertising had become so intrusive, disruptive and unruly that the hacker community came up with a solution. You very rarely hear anyone bitching about Google Adsense ads, as they're both textual and usefully contextual, and anyone who wants to argue that 200Kb Flash movies choking my bandwidth and sprouting both alongside, above and directly over the content users are trying to access is in any way a good idea needs their head thoroughly scrutinised. The very existence of adblocking tools should be sending a very clear message to web advertising companies - we don't want to be beaten over the head with your shit. Plus, do you really want to be engaging in a incremental bunfight with the hacker community, either side progressively defeating the other's measures? Is it really a good use of everyone's time?

Ouch

2007-09-11T23:16:00.000+01:00

Being stung on the lip by a wasp fucking hurts. I know this, because it happened to me this evening.

Thank $deity for the Internets though, because hundreds of unverified old-wives' remedies were merely a judicious Google away. It's now much better, thanks - lemon juice really is the business for just about every random problem or malady that can curse your life.

Owwwww.

I'm going to try and make more of an effort to post here, but I don't think one of those '10 ways to get more stuff done NOW!' blogs is the way to go (not least because I'm fundamentally very lazy) but I'm a senior software engineer and I ought really to have more to say about what I've encountered over the years working on the internets than I have in the past.

Then again, there's no shortage of self-appointed pundits willing to spout grindingly obvious platitudes about software and software engineering - why should I add myself to their ranks? Can I add anything of worth? Only time will tell.

What happened?

2007-08-05T08:47:00.001+01:00

Wow, I fail at blogging.

I've been busy. New jobs have that effect.

Meanwhile, here's some Neil Innes: