Gidley's Gossipings

AWS CLI and Multi Factor Authentication (MFA)

2015-10-28T09:06:00.003+00:00

Many people use AWS with MFA and also want to use the command line API. It turns out this is a bit tricky and poorly documented...
So - to use the AWS CLI with MFA enabled

Go into AWS IAM and get the MFA token identifier for your user it will look like 'arn:aws:iam::12345677890123:mfa/USERNAME'

On the console run

aws sts get-session-token --serial-number arn:aws:iam::12345677890123:mfa/USERNAME --token-code YOUR_CURRENT_MFA_TOKEN

This returns a JSON with credentials in

Edit your ~/aws/credentials file and add into it 3 lines

aws_access_key_id = XXXX
aws_secret_access_key = XXXXX
aws_session_token = XXXX

As returned from the call above.

You can now use AWS!

Apple 'new' TV - same but different

2015-09-10T06:22:00.004+01:00

The 'new' apple TV is an interesting beast - it's new, from Apple and has a great demo, but most of the concepts are out there in the market and not really new. However the same could be said of the iPod or iPhone - yet those products changed how people behave because Apple delivered a level of polish and marketing people wanted to use.
Looking over the features the initial demos shows using Siri voice search for finding content to watch with smart queries like 'show me the episode of Y with X in', or 'show me new content'. This sort of querying is old technology (I remember adding such features in Project Kangaroo (BBC/ITV/C4) in 2007!), they then added voice recognition on top of that, which again is pretty boring nowadays. This looks a lot like the solutions Google (Google TV), Amazon (Kindle Fire TV) and Microsoft (Xbox One) have already rolled out. All of them are mostly useless in the real world as the metadata to do 'interesting' queries is mostly missing from TV shows, even Amazon (owners of IMDB) struggle to find the episode with a certain actor in (they can find the series), everyone struggles to find places/locations in TV shows. I recall on Project Kanagroo the business teams want to be able to search for the 'Episode of the office where he (David Brent) does the funny dance', but in reality no computer system knew that level of detail so unless we manually tagged the show with a few key events (great for demo's) it could not be done. At some point someone (and I'd bet it will be Google) will solve this by automating analysis of the video/audio to pick out the metadata but until then this is just going to be a 'cheap' demo.
The other big thing apple showed was the 'fact' that Broadcasters/Operators are now 'apps'. This is a trend that's been going on for a while and it's slowly coming to pass. It does imply a bunch of big changes in the industry

It reduces the power of your 'one' TV supplier - you'll now have many (Netflix, your Satellite/Cable, Broadcast)
It increases competition as consumers will pick their operator nightly as they sit down to watch TV
It increases need for search/content discovery as you have a lot to pick from

This announcement will further drive TV Operators to embrace the app environment (as Sky has done with Now TV) and/or to fight it (as Sky are doing with their high end boxes) to retain control and pricing premiums.
On the security side this shows the march of the FairPlay and Widevine as the new de-facto standard DRM's. This device is not going to be easy (or sensible) to support proprietary options on. This underlines the need for a Multi DRM strategy where you use the embedded DRM in the device and use headend components that support whatever is on the consumers device. It also highlights a gap you'll need to secure your login, concurrent stream management, fingerprint/watermarking sessions on these devices and for that you'll needs tools like (shameless plug) Irdeto's ActiveCloak which can protect the business logic running on devices to create a trusted execution environment even when you can't control the hardware.
Overall the Apple TV seems an incremental improvement, but a lot will come down to price, how many apps get built for it and if it's got enough features that make the mass market pick it up over their existing Smart TV's, Game Consoles and Operator STB's.

DASH and HLS packaging

2014-08-21T15:44:00.002+01:00

One of most popular articles on this blog is one from 2011 where I document how to prep video for HLS using free tools...

So here's a follow up. For a demo I recently needed to package content in both HLS and DASH. My original commands don't quite work still so updates below.

To Transcode using ffmpeg into a range of bitrates suitable for HLS/DASH

#!/bin/bash

echo "Converting $1 into formats"
echo "Outputs are CBR 256, 512, 750, 1024, 1200, 1500, 2000, 2500 kbps"
echo "Below 750 are 512x288, above are 480p up to 1200, 720p above that"

sizes=( 256 512 750 1024 1200 1500 2000 2500 )

for size in "${sizes[@]}"
do
 if [ "$size" -lt "1024" ]
 then
  pixel=512x288
 elif [ "$size" -lt "1500" ]
 then
  pixel=768x576
 else
  pixel=1280x720
 fi

 ffmpeg -i "$1" -y -s $pixel -c:v libx264 -profile:v high -level 4.1 -x264opts bitrate=$size:keyint=30 -acodec aac -strict -2 -ab 65k $1_$size.mp4
 

done

echo "Transcoding Complete"

Then to prepare for HLS (you need mediafilesegmenter from Apple's developer site and this only works on a mac

#!/bin/bash

mkdir $1_apple
cd $1_apple

varients=( 256 512 750 1024 1200 1500 2000 2500 )

for varient in "${varients[@]}"
do
 mkdir $varient
 mediafilesegmenter -f ./${varient} -I ../$1_${varient}.mp4
 playlist+="./${varient}/prog_index.m3u8 ../$1_${varient}.plist "
done

echo variantplaylistcreator -o $1-all.m3u8 \ $playlist
 
cd ..

Finally to prepare for Dash you need http://castlabs.com/products/dash-encrypt/ and can run (you may need to change path to the jar file!)

#!/bin/bash

mkdir $1_dashj
cd $1_dashj

varients=( 256 512 750 1024 1200 1500 2000 2500 )

for varient in "${varients[@]}"
do 
 filenames+=" ../$1_${varient}.mp4" 
done

java -jar ../../dash.fragmencrypter-1.0.12-exe.jar dash $filenames -o ./
 
cd ..

Note to 'content industry' you need to give people what they want!

2014-03-13T13:55:00.005+00:00

I've been working in the Internet TV (or OTT) space since 2006 and one recurring theme has been content owners (studios, producers, broadcasters) attempting to hold back consumer demand to fit their existing business models. This is madness, in the long run the laws of supply & demand will win out and where there is demand a supply will be created, and those that supply items in ways that don't meet demand will lose out.

The forces of 'conservatism' in the content industry are strong and they use a large range of tricks to hold the tide of consumer demand back.

Content owners have been trying to use regulation, copyright (not that all copyright is bad), licensing restrictions and exclusive deals to control the demand from consumers. This is economically unsound behaviour as in the short term this encourages piracy and in the long term it will encourage alternative sources of content to arise (look at Netflix!) that meet the demand.

A great example of this issue is release windows. Traditionally movies are released to Cinema's first and then later released on other formats. Why is this? It's to ensure that Cinema's can charge a premium for tickets compared to other formats. This arrangement made sense when Cinema's were the only viable form of distribution (probably not true since 1950's) and remained due to the power (due to amount of revenue) they represent in the supply chain. As things have developed and home cinema setups are common more and more people have been watching movies at home, but only 3-6 months later. This is a demand, not being met legally, so pirates step in and pretty much every movie is available on pirate sites. Rationally a solution would be to legally provide the content - but momentum/tradition (and in some places regulation) prevent simultaneous release.

Another example is the use on a range of devices. It has been possible to economically deliver high quality video to consumers for about 10 years. The content providers have been slow to adopt this technology and business model as it does compete with their traditional business models. However this again has led to competitors emerging - pirates and CE manufacturers/retailers selling direct (e.g. Amazon, Apple, Google, Samsung). The end result has been broadcasters are now playing catch up to compete with new entrants into their market. A great example here is Ultraviolet (UV). For those not familiar UV is a format standard to allow consumers to buy a physical movie or electronic and own a digital copy and move it between devices. I predict it will be a failure. It fails for a bunch of reasons

Consumers are being told this is 'ownership' yet the rules being applied and DRM etc will result in consumers 'losing' access over time (e.g. only able to download in first year)
Services already launched by Apple, Google, Amazon, Tesco do the same thing but better. They are locked to a single retailer, but they offer a much smoother experience

Again it's been set up with industry interests at heart and not dealing with the demand. The demand as to actually 'own' content and to feel like you own content. This can be done digitally - Steam (www.steampowered.com) is a great example of how to do this.

Another example of total failure on the content industry desire to meet consumer needs is the concept of 'channel'. Channels have become brands and thus have lots of momentum, however in 90% of cases people don't watch content because of the channel it's in they watch the channel because of the content that's on it. The demand is for content, the supply is via a channel. However due to momentum the content is not available outside of the channel in many cases. Demand then builds up, piracy and other routes to market flourish, destroying the value of the channel brand.

All through this I cite piracy as source of supply meeting consumer demands. Content providers need to realize that they can compete with free. They can compete on content, on quality, on ease of use, on predictability, on lack of hassle. There is plenty of evidence people will pay for free stuff when they get those things. Looking at other industries look at Aquafina from PepsiCo. They are selling tap water, for money! (In most countries tap water is so cheap it's basically free!). They succeed as they provide service (namely a bottle) that their competitor doesn't offer.

Manifesto for success

The conclusion I draw from all this is to succeed content owners need to

Pay attention to demand in the real world
Where demand exists now and is likely to grow meet it before someone else does. This doesn't mean giving content away, it will mean disrupting the content business before someone else does!

What would the TV/Movie industry look like if content produces didn't mandate content protection

2013-07-20T10:21:00.002+01:00

I've been thinking a lot recently about how the TV/Movie industry is developing and in particular about how content protection will evolve over the next few years. I often hear the argument that content security/DRM is required because the studio's mandate it - so as a thought experiment let's consider what the market would look like if they didn't.

Download to own would thrive

In a world where content owners didn't mandate DRM on content the first thing we'd expect to find would be a thriving market for download to own content. Today download to own is a troublesome experience for consumers

DRM means that content only plays back on some devices and in specific applications - I can't easily move to any device I want. Without DRM this problem goes away.
DRM means you are still dependent on the store that sold you the content - if they go out of business you can lose your content. This has happened several times to download to own stores. Initiatives like ultra violet help with this problem but they don't solve it fully as there are still a number of limits.
DVD is effectively DRM free today, as are most Blu-Rays (with some exceptions that tend to be very short lived) they would still sell (in declining numbers) and this would probably accelerate the decline as it would be more convenient

The other-side of this coin is you'd expect lots of this content to appear on pirate networks. However that isn't that different from today. Almost all content is available on pirate networks already, no DRM/Content protection system prevents hard-core pirates from capturing it with a HD camera.

Casual piracy would also rise as people could (and would) 'lend' content to their friends/relatives.
I suspect overall effect would be a large sales in western markets and moderate sales in other markets (where piracy is more ingrained).

Rental & Subscription models would continue and still need some content protection

The next model to consider is rental and subscription - this model can work with minimal protection. For example if you simply have the user interface not let you get easily to the content if you don't pay. The vast majority of consumers are not going to hunt around for tools to download the content and keep it. Those that do, will be getting their content from pirate sites already.

Usability will be the key to such services - just like today content will be king - not just what content rights they own but the services ability to help a consumer find the content they want.
The competition from piracy would be similar to that we see today most pre-recorded content can be trivially obtained
A security service of would be required to prevent easy to use tools that grab the on demand content being widely used. However this would not necessarily have to be totally secure and merely would have to ensure it was simpler to get the content legitimately.
Live content (e.g. sports, premiers) would probably still need strong security (DRM, Watermarking, take-downs) to ensure the value of the first view window is maintained. The content distributors would want this as it is their USP! If you remove security for this content you'll get a huge number of copycat sites appearing (as we see now with Soccer!)

What does this mean for technology companies working in TV?

The content owners are mandating security to protect their business model - however I'm not sure the above looks much different that it does today. I talk to a lot of content owners and outside of the big US studios most don't mandate content protection. Overtime I predict at least one of the big studio's will try selling content without security. Pirated content is widespread and is 'normal' in many regions, content protection is valuable mainly when enabling models like subscription and rental. Therefore to succeed technology companies need to

Ensure their security offering enable business models not just prevent piracy
Work to engage consumers with better content discovery to provide a better user experience
Develop additional services such as watermarking and live take-downs to enable a premium on live content

(DISCLAIMER - I work for Irdeto who provide Multiscreen & Media Protection solutions - these are my views are not necessarily Irdeto's).

Back to pc

2013-04-20T11:22:00.001+01:00

I've been a Mac user for about 5 years and my iMac is now struggling and I was looking to upgrade it. This proved a challenge as the screen is awesome, but the innards are dated. I did look at macs but there wasn't a good option.
So I've just bought a windows tower to plug into it. I got windows 8 and am currently 'learning' metro.

Windows Mobile update

2013-03-05T19:26:00.000+00:00

I have finally given up on my Nokia Lumia 820 (after less than 4 months!) - in short it was the software.
What made me swap was less any specific weakness (though there are lots) but more playing with a LG Nexus 4. The experience is just so much more integrated.
A few issues with Windows Phone where Android beats it

Maps - These are meant to be a strength of nokia and the road mapping is ok. However places (e.g. shops, addresses) are much worse than google. It often can't find places based on the name. It is also rubbish at suggesting what is in the area.
Mail - GMail is buggy on it - the activesync mode crashes and imap takes ages
UI - although nice it is quite restrictive if you leave an app it takes more clicks than it should to get it
Apps - There are apps for most stuff, but a lot have glitches

So overall I have given it up and don't miss it. Also Android has some killer apps e.g. Ingress!

Music industry isn't doomed... Some lessons for the TV industry

2013-03-04T19:24:00.002+00:00

The news from last year is the music industry appears not to be as doomed as previously thought - in 2012 it grew revenue overall (0.3%) and digital grew 34%! This should provide some hope to those who aren't predicting the wholesale collapse of the content creation industry due to the internet.
It also provides some hope for the other industries - one of the key lessons seems a strong market in legal options reduces privacy and increases sales.
This does point to some lessons for the TV industry

Make content available in as many countries as possible in legal ways - all to often due to 'rights' content is not available in some countries or has a substantial time delay driving privacy.
Offer a range of purchase options - subscription, pay per view etc
Offer content with 'frictionless' user experience
Offer content on a range of competing delivery choices - exclusivity is common for TV but rare for music. In the internet world this is hard to maintain and further incentivises piracy.

Lumia 820 - 1.5 months in

2013-01-18T17:27:00.001+00:00

I thought one final update on the Lumia 820 was worth doing. I have now have 1.5 months and some things have changed since my previous reviews.
Firstly I am still very happy with the phone - it is one of the better phones I have owned. It works, it's easy to use and generally very functional.
The big changes I have noticed since last time

The email sync to Google Mail is flakey. It was initially set to use ActiveSync, but it kept crashing. It would stick syncing and you would have to reboot the phone. Google appear to have done me a favour by forcing a change to IMAP. I switched it to IMAP manually and it all works fine. There is no more push email but otherwise it works.
Nokia Maps - it's good, and the offline mode is nice. However the places search is a lot worse than google. A lot less places are found.
The 'other' space on the phone memory has filled up on my phone and there doesn't appear to be a way to clear it. It is unclear what is in there and lots of people have this problem. Removing some apps has helped but it is a bit annoying to have a phone complaining of running out of space all the time.
Windows Phone sync for apple has been updated and now it works on my mac without crashing. It is very slow (it took over 1 day to sync my 5000+ songs on iTunes!).

Overall I'm still happy with it - but some of the above is really annoying!

2012 Trips

2012-12-26T11:00:00.000+00:00

I have been tracking my travelling on business and decided this year to try and have a map!
The map is courtesy of Tripline which provides a neat service for tracking and mapping where you have been.
The most interesting trips of the year have been the 2 long trips I took to visit Irdeto offices in the US. In January I got to go to CES (Las Vegas), visit our Carlsbad office and our Minnesota office. A great part of the trip was driving from Las Vegas to Carlsbad and seeing a bit more of America in the middle. I didn't get to see much of Minnesota on that trip (too cold for me!), but luckily I got to go back early October when the weather was great.

The Full List

Nokia Lumia 820 - 2 weeks in

2012-12-15T17:55:00.000+00:00

I have had my Nokia Lumia 820 now for 2 weeks and I thought I should update my initial review.

A few things I have learnt

Battery life is ok but not great - I have had it totally lose battery once (but it was after a days Geo-Caching)
Geocaching.com app now works! However I did also find a second app Maaloo Geocaching which works well.
Windowsphone.com has no geo-detection so it keeps guiding me to the US store and tells me I can't buy stuff!
Nokia Maps is good but it's local database isn't anyway near as good as google's
The UI is awesome - smooth and nice to use
Skype is a bit unreliable - it often notifies days after a message has been sent - which is surprising given it's a MS app!
Camera is very nice, works well and quickly.

Overall I'm very pleased with it - it is a great phone and definitely better than recent Androids/iPhones I have used!

Synology NAS, SMB, NFS and Macs and Autofs

2012-12-14T17:52:00.003+00:00

I recently got a Synology NAS to store my videos, photos and music on and decided to try and set it up with my home iMac to store transparently my movies, videos and photos. In principle on a unix mounting a drive should be a simple thing... but in practice it turned into a bit of a mission

1) Plan A - AFP/SMB

I set up the NAS to expose a 'Music' folder via AFP and SMB and easily could see it and add it from my mac. By default you do this with finder and it mounts it under /Volumes. However I wanted it to appear in my 'Music' directory - that way iTunes can transparently use it as though it a local disk.

For that to work I need 2 things

Automatically Mount it
Permissions to look allow easy writing/reading

To make it more fun I keep my music in /User/Shared/Music so other account on the computer can see the same music so the group permissions matter otherwise other users can add music.

So I tried using autofs to mount the drive. I found a bunch of instruction sets on the net and got it all configured but the drive mounted owned by root and my user can't read it. Some googling later suggests this is an issue since Mac 10.7 - if you use autofs with AFP/SMB. I tried a range of flags to fix this and none helped :(

2) Plan B - NFS Issue

So I thought I would try NFS. I enabled this on synology and configured it via autofs. The steps are quite easy...

On the NAS

Enable NFS for the share (in the share manager)

You need to add the IP of the mac machine or you can add IP of your whole local network

Enable SSH on the NAS
SSH into the NAS as root@NAS using the 'Admin' password
cd /etc/
Edit exportfs and add 'insecure' to the flags e.g.

/volume1/Movies 192.168.0.0/255.255.255.0(rw,async,no_wdelay,root_squash,insecure,insecure_locks,anonuid=1025,anongid=20)
NOTE the insecure flag doesn't make it insecure, it just allows the mac NFS client to use ports above 1024 (which are usable by non-root processes). This is the default behaviour on mac's.
NFS in using a netmask like this is very insecure as any machine on your wifi can access the share!

On the Mac

Edit /etc/auto_master
Add a line like

/- auto_cabbage
Make sure there is an empty line at the end of the file

Create a file called /etc/auto_cabbage (cabbage is the name of my NAS)

Add a line mounting the drive e.g.
/Users/Shared/Movies cabbage.local:/volume1/Movies
Make sure there is an empty line at the end of the file

Once done cd into the folder and you should be good to go.

I then hit permission problems - I had copied my files onto the NAS via SMB so they were 'owned' by my 'ben' user on the NAS which had a group ID of 100. Whereas my Mac 'ben' user has a group ID of 20. To fix ssh onto the nas again and cd /volume1 and run 'chgrp -R 100 Music'

So end result is iTunes (and Photo's) all now transparently use the NAS and my poor overworked iMac can take a break!

1) 'insecure' flag Issue 2) 'UID/GID' mapping

Data, Three UK and it's 2G Network

2012-12-08T08:43:00.001+00:00

I have been using Three for a while now and one of the great features was they used Orange's 2G network as fallback when their network didn't have coverage. This is quite useful as their 3G coverage (although good) doesn't quite reach everywhere.
Recently I had noticed my phone had often failed to get data when it dropped to 2G. I thought it was a configuration setting (it was running custom firmware) so had ignore it. When I got a new phone (a Nokia Lumia) it thought when on 2G is was roaming and thus disabled data.

@bgidley It is roaming if it's on 2G, we don't have a 2G network. You'll be connecting to our 2G fallback network which is Orange.
— ThreeUKSupport (@ThreeUKSupport) December 5, 2012

So I asked a bit more about the settings and they said

@bgidley It's not available on 2G anymore.
— ThreeUKSupport (@ThreeUKSupport) December 6, 2012

So it appears three have decided we don't need data on 2G. Which is really annoying - there are huge chunks of the country where they only have 2G coverage. It's also annoying they have done this but a quick google of their web site suggests they don't mention it anywhere!

Nokia Lumia 820

2012-12-02T16:48:00.000+00:00

I just got a Nokia Lumia 820 Window 8 Mobile and thought I would write some of my initial impressions.

The device itself is really well made, feels substantial but not too heavy and looks nice. The soft 'shell' case looks great and fits in your pocket nicely.

The main thing about this is the Window 8 software and it is excellent. There are a few rough edges but the main experience was great.

Things I liked

The wireless charging just works
The UI is smooth, I haven't seen any glitches yet
The Gmail integration worked perfectly - email, contacts and calendar all just worked
The apps from the store are good - with the exception of music and geocaching I have found excellent apps for everything I use on Android

A couple of the glitches I noticed

The setup sequence assumed (wrongly in my case) that data would work on the card straight away so got stuck trying to log in. It didn't offer an option to set up wifi.
Lots of the Apps (even new ones like Nokia Drive) won't download stuff in the background. So I had to wait while Nokia Drive downloaded its maps.
Some of Microsoft's apps (e.g. SkyDrive) kept prompting me to login - can't they do single sign on with the Windows Live account on the phone!
For some reason a lot of the core Nokia apps aren't pre-installed, instead they have icons on the home screen that then install them from the store - why?????
Geocaching.com's app won't login it just has some error - this seems to be WP8 issue as others have noticed it.

The most disappointing thing is the Music support. Nokia music looks like a nice app, but I can't get my music onto the phone. I tried the Windows Phone for mac software (on two macs) and it just crashes when I connect my phone. The internet is full of people who have the same issue so hopefully they'll fix it soon! There also aren't apps that work with my preferred Cloud music providers (Amazon and Google). Hopefully one will appear soon. In the meantime I'll have to manually sync the phone by copying the files to a SD card and putting it in!

Overall it's a really nice phone - and a nice replacement for my ageing HTC Desire S. I mainly got this phone so I could try the Windows ecosystem and so far am happy. I'll see how easy it is to live with after a few weeks!

Walking website

2012-05-23T19:00:00.000+01:00

I grew up in Brockworth at the foot of Coopers Hill (of Cheese Rolling fame) and have always been a keen walker so know the routes in the woods up there very well. Over the years a number of circuits to/from Cranham have become favourite walks for me (often including a great pub lunch at the black horse pub).
Helen and I recently 'invented' a new route for walking around Coopers Hill/Cranham/Painswick Beacon - and I decided (after mapping all the paths on openstreetmap) to upload it a site with walking routes. However that is where I hit a flaw - I can't find a decent on!
There are a bunch of (ugly looking) sites where people upload photo's and bad maps, there are some that have ok maps but charge people to download the routes (if I give something away it should be free so won't use them), but none I could find that will let me upload my route, with a nice map (ideally openstreetmap or Ordinance Survey).
If I had more spare time I may build one... but in the meantime if anyone out there knows of one let me know...

Prior Art

2012-05-22T16:42:00.002+01:00

I have always been interested in how the law and practice regarding software patents is working out and one of thing that you often hear is that things that have already been thought of/invented have been patented. I don't have a problem with patents for genuinely new ideas, but often they seem to be minor tweaks on existing ideas...
The problem appears to be that you can patent 'non obvious' ideas, but for people who examine patents things may not look obvious that are obvious to people working in that technical area.
So I think someone (not me!) should create a website of bright ideas people have had, that should provide evidence of prior art and maybe even share some useful ideas.

Family Tree (Mk 2)

2012-01-02T12:14:00.003+00:00

I have now added in the first batch of the Gidley information that was collected by Gillian. It is online at

Gramps Web Output (for humans)
Gramps GED Output (for computers)
Relationship Graph (monster PDF which you can zoom in to see everyone)

We now have 348 people in our family tree - which isn't bad. I am pretty sure there is more information somewhere in our storage unit so will have to update it a bit more...

Family Tree (mk 1)

2011-12-31T16:37:00.001+00:00

We have had in storage a tonne of research done by my mother-in-law (Gillian Falla) into our family tree's. It is in the form of hundreds of bits of paper with notes (and I believe there is even a box with copies of source material in!), I decided as a Christmas project to start digitising it.
Initially I was going to scan in it, but when I thought about it a bit harder it struck me a more sense to put into a database of some sorts to make it easy to find stuff. So I did a quite google and found 'Gramps' online which look likely to do the job. So I started typing...

A few days later and I now have the entire 'Falla' side of the tree loaded. The Gidley side is delayed as I can't locate the paperwork to go with it right now... (the storage unit is also full of several hundred classical 78 rpm records which makes finding things quite hard).

So I thought I would upload it in case anyone else out there is tracing the family tree. Gillian got back to the 16th century which I suspect is quite a long way to get in family tree terms! Right now it has 303 people in it with the oldest being born in 1521.

We also get a chart of the most popular surnames in the tree

[Missing Surname], 7% (22)
Berry, 3% (12)
Selby, 3% (11)
Falla, 2% (8)
Hatchard, 1% (6)
Moat, 1% (5)
Mair, 1% (5)
Hall, 1% (5)
Gidley, 1% (5)
Gibbon, 1% (5)

One of the nice things Gramps does is summarise the data so I can now see that the average life span of this lot is 72.3 years (which sounds quite high to me!).

Gramps Web Output (for humans)
Gramps GED Output (for computers)
Relationship Graph (monster PDF which you can zoom in to see everyone)

I still have quite a bit to do on this including

Loading the Gidley side of the tree
Adding pictures for those I have pictures of
Fixing the geo-coding on all the places so all the maps draws (you have to look up lat/long for them!)

But it seems a good start - seeing all the effort that must have gone into gathering this information I thought it is best to get in a format people can use!

Experiment...

2011-12-31T09:09:00.001+00:00

I have recently 'upgraded' (translation fixed) my Grannies PC and as part of it I had to re-install everything and we came to to the tricky point of putting MS office on. Last time I used a license I had - but now I have moved to Mac I don't actually have any to hand, so this time we have set up Google Docs.
In general I am wary of upgrading or changing anything on the computer - as it can confuse her (she is 89 after all!) but in this case I suspect it may be better. She was taught to use MS Office by the local college (on Office XP) and if anything Google Doc's is closer to that than Office 2010.

Annual Trips Round Up

2011-12-31T09:04:00.001+00:00

This year has been a big year for travelling so I made a list for myself of all the places I had been for work!

2011/01/04 - 2011/01/07 - Newark NJ, USA
2011/01/25 - 2011/01/27 - Solana Beach, CA, USA
2011/02/01 - 2011/02/03 - Sao Paulo, Brazil
2011/02/08 - 2011/02/10 - Newark NJ, USA
2011/03/01 - 2011/04/09 - Kuala Lumpur, Malaysia
2011/06/07 - 2011/06/09 - Toronto, Canada
2011/07/05 - 2011/07/07 - Dubai, UAE
2011/07/10 - 2011/07/16 - Kuala Lumpur, Malaysia
2011/08/02 - 2011/08/04 - Warsaw, Poland
2011/10/03 - 2011/10/12 - Hoofddorp, Netherlands
2011/10/22 - 2011/10/29 - Beijing, China
2011/11/14 - 2011/11/16 - Hoofddorp, Netherlands
2011/11/22 - 2011/11/24 - Hoofddorp, Netherlands
2011/12/04 - 2011/12/07 - Johannesburg, South Africa

It's quite a list... hopefully next year will involve a bit less travelling!

IPTV DRM and the 'news' for Flash

2011-11-23T18:25:00.000+00:00

There has been quite a bit of interest and discussion about Adobe's decision to stop supporting flash plugins on mobiles (e.g. Android and RIM). A lot of people seem to be reading a lot into the announcement that I don't think and was there and also are misunderstanding the impact - especially for video delivery.

Let's start with the announcement - a lot of people have been writing stories saying 'end of flash on mobile' and similar. This is not what they are saying at all! They are saying they are focusing on app development using Flash as opposed to shipping a browser plugin. This is a big story but not as significant as people are making out. Flash on mobile has been vaguely useful, but it hasn't found a killer application so far. Many flash applications need tuning/tweaking for mobile today as the flash player shipping today doesn't support all of desktop flash's features.

I am mostly interested in how to deliver video to mobiles, pc's and tablets. Adobe has a DRM platform called Flash Access (which is not the same was the widely hacked RTMPE) which is approved by all the major US studio's which lets people deliver their content to a range of platforms. Adobe offering Flash plugin on mobile offered a possibility that within the near future (as right now the plugins don't support Flash Access) you could browse to a video website and see a premium video. Now Adobe have withdrawn this option the isn't likely to be a way to deliver premium video to mobiles and tablets, through the browser for the foreseeable future. A number of commentators have said HTML 5 is the answer - it certainly can play video, but it can't protect the content and no-one is offering a strong HTML 5 solution for protecting content via the browser. Even if someone builds one - (e.g. on Android) - there is unlikely to be one on iOS as Apple won't let anyone bypass the app store for premium content.

So where does this announcement leave us - well actually with a range of options. Adobe are still supporting 'AIR' for mobile devices which will hopefully shortly have Flash Access support. This is important a quite of lot of devices are beginning to support this - including YouView, Samsung TV's, Google TV, Android, iOS and Blackberry QNX. This should provide a way to write an application for one of these devices and relatively easily port it to the others. In theory this is all great - Adobe can now focus on making this a better environment and make it more reliable on these devices.

Adobe has better positioned themselves to sell AIR, but they are missing a big problem - AIR isn't actually that good for cross platform applications! AIR implies a standardised UI and most of these platforms have different and strong UI conventions. If you use AIR you end up ignoring them (as best) and breaking them (at worst). User experiance is critical in such applications and you can't get away with this! A skilled developer can deal with this - but it becomes easier to build all the applications natively!

If I were involved in building an IPTV solution (an oddly I am) I would look at building native applications for most of these platforms using a range of DRM's and video formats as required. Each of these devices has different stengths and weaknesses so I would build

Device	DRM	App Technology
Android	Playready via Cloakware or Authentec	Java
iOS	Playready via Cloakware or Authentec	Cocoa/Objective C
QNX	Flash Access	AIR
Samsung	Playready	HTML 5
LG	Playready	HTML 5

The key thing now is to be able to support whatever DRM and app technology the client device requires. In order to keep costs sane - the applications will end up as thin wrappers around a server side API that provides a lot of the shared logic.

Preparing files for HTTP Streaming with FFMPEG

2011-07-30T08:04:00.001+01:00

I recently wanted to do some video streaming using only 'free' tools to produce the files and deliver the streams. This is now possible as both Apple and Adobe Flash support HTTP streaming, which works with pretty much any web server.

The key steps to product video's for HTTP streaming are

Encode video to H264
Package video for HTTP streaming
Upload to web server

Annoyingly Apple and Adobe use slightly different methods for HTTP streaming so the process is different. Also generally Apple streaming is used to target iOS devices, whereas Adobe is for Android and PC's, therefore you normally want higher quality video for Adobe compared to iOS.

For both platforms you should start with a good quality original, the Adobe example below has the top bit rates at HD levels.

Adobe Packaging

The script below takes a input file (anything that ffmpeg supports) and then converts it to the relevant bits rates.

For this to work you need to install

Recent version of ffmpeg (if it says x264opts is not recognised you need a newer version)
MP4Box (part of http://gpac.wp.institut-telecom.fr/)
Adobe f4fpackager (http://www.adobe.com/products/httpdynamicstreaming/)

#!/bin/bash

echo "Converting $1 into formats"

echo "Outputs are CBR 256, 512, 750, 1024, 1200, 1500, 2000, 2500 kbps"

echo "Below 750 are 512x288, above are 480p up to 1200, 720p above that"

echo "This assumes ffmpeg, MP4Box and f4fpackager are on the path"

size=256

ffmpeg -i "$1" -y -s 512x288 -vcodec libx264 -vpre baseline -x264opts bitrate=$size:keyint=30 -acodec libfaac -ab 65k $1_512x288_256k.mp4

size=512

ffmpeg -i "$1" -y -s 512x288 -vcodec libx264 -vpre baseline -x264opts bitrate=$size:keyint=30 -acodec libfaac -ab 65k $1_512x288_512k.mp4

size=750

ffmpeg -i "$1" -y -s 512x288 -vcodec libx264 -vpre baseline -x264opts bitrate=$size:keyint=30 -acodec libfaac -ab 65k $1_512x288_750k.mp4

size=1024

ffmpeg -i "$1" -y -s 768x576 -vcodec libx264 -vpre baseline -x264opts bitrate=$size:keyint=30 -acodec libfaac -ab 65k $1_768x576_1024k.mp4

size=1200

ffmpeg -i "$1" -y -s 768x576 -vcodec libx264 -vpre baseline -x264opts bitrate=$size:keyint=30 -acodec libfaac -ab 65k $1_768x576_1200k.mp4

size=1500

ffmpeg -i "$1" -y -s 1280x720 -vcodec libx264 -vpre baseline -x264opts bitrate=$size:keyint=30 -acodec libfaac -ab 65k $1_1280x720_1500k.mp4

size=2000

ffmpeg -i "$1" -y -s 1280x720 -vcodec libx264 -vpre baseline -x264opts bitrate=$size:keyint=30 -acodec libfaac -ab 65k $1_1280x720_2000k.mp4

size=2500

ffmpeg -i "$1" -y -s 1280x720 -vcodec libx264 -vpre baseline -x264opts bitrate=$size:keyint=30 -acodec libfaac -ab 65k $1_1280x720_2500k.mp4

echo "Transcoding Complete"

MP4Box -add $1_512x288_256k.mp4 $1_512x288_256k.mp4

MP4Box -add $1_512x288_512k.mp4 $1_512x288_512k.mp4

MP4Box -add $1_512x288_750k.mp4 $1_512x288_750k.mp4

MP4Box -add $1_768x576_1024k.mp4 $1_768x576_1024k.mp4

MP4Box -add $1_768x576_1200k.mp4 $1_768x576_1200k.mp4

MP4Box -add $1_1280x720_1500k.mp4 $1_1280x720_1500k.mp4

MP4Box -add $1_1280x720_2000k.mp4 $1_1280x720_2000k.mp4

MP4Box -add $1_1280x720_2500k.mp4 $1_1280x720_2500k.mp4

echo "Reboxing Complete"

mkdir $1_packaged

cd $1_packaged

f4fpackager --input-file=../$1_512x288_256k.mp4 --bitrate=256

f4fpackager --input-file=../$1_512x288_512k.mp4 --manifest-file=$1_512x288_256k.f4m --bitrate=512

f4fpackager --input-file=../$1_512x288_750k.mp4 --manifest-file=$1_512x288_512k.f4m --bitrate=750

f4fpackager --input-file=../$1_768x576_1024k.mp4 --manifest-file=$1_512x288_750k.f4m --bitrate=1024

f4fpackager --input-file=../$1_768x576_1200k.mp4 --manifest-file=$1_768x576_1024k.f4m --bitrate=1200

f4fpackager --input-file=../$1_1280x720_1500k.mp4 --manifest-file=$1_768x576_1200k.f4m --bitrate=1500

f4fpackager --input-file=../$1_1280x720_2000k.mp4 --manifest-file=$1_1280x720_1500k.f4m --bitrate=2000

f4fpackager --input-file=../$1_1280x720_2500k.mp4 --manifest-file=$1_1280x720_2000k.f4m --bitrate=2500

cd ..

echo "Flash Conversion complete"

The steps above are

Use ffmpeg to produce a range of bit rates for http streaming. This is using 'baseline' preset from x264. You can actually use high profile for flash on PC - but it takes a bit longer so I didn't bother.
You shouldn't need to use mp4box, but due to some incompatibilities between ffmpeg and f4fpackager you need to. This simply 'fixes' the wrapper file that contains the video.
Use f4fpackager to produce a f4m file

To deliver this video you have to install the adobe http dynamic streaming apache module http://www.adobe.com/products/httpdynamicstreaming/ and point at the highest bitrate output f4m file.

Apple iOS Packaging

For Apple the process is nearly the same except you will generally use different encodes.

#!/bin/bash

echo "Converting $1 into formats"

size=128

ffmpeg -i "$1" -y -s 320x240 -vcodec libx264 -g 30 -vpre ipod320 -x264opts bitrate=$size:keyint=30 -acodec libmp3lame -ac 1 $1_lo.mov

size=256

ffmpeg -i "$1" -y -s 320x240 -vcodec libx264 -g 30 -vpre ipod320 -x264opts bitrate=$size:keyint=30 -acodec libmp3lame -ac 1 $1_med.mov

size=512

ffmpeg -i "$1" -y -s 480x320 -vcodec libx264 -g 30 -vpre ipod320 -x264opts bitrate=$size:keyint=30 -acodec libmp3lame -ac 1 $1_high.mov

The final step using mediafilesegmenter and variantplaylistcreator - this is a free tool you can download from developer.apple.com. However you do need a mac or iOS developer account. Once you have it run on a mac

#!/bin/bash

mkdir $1_apple

cd $1_apple

mkdir low

mkdir med

mkdir high

mediafilesegmenter -f ./low -I ../$1_lo.mov

mediafilesegmenter -f ./med -I ../$1_med.mov

mediafilesegmenter -f ./high -I ../$1_high.mov

variantplaylistcreator -o $1-all.m3u8 \

low/prog_index.m3u8 ../$1_lo.plist \

med/prog_index.m3u8 ../$1_med.plist \

high/prog_index.m3u8 ../$1_high.plist

cd ..

If you don't have an Apple developer account or a mac there is an opensource reimplementation of these tools http://code.google.com/p/httpsegmenter/.

The apple segmenter steps above work - if you modify them be warned

The tool cares about file extenions file.mp4 won't work, file.mov does (same file!)
You have to create the subfolders for it

To play these files just put them on any old web server and point your player at the all.m3u8 file.

Asus eee Pad Transformer TF101 Review

2011-06-11T15:23:00.000+01:00

I recently got myself an Asus eee Pad Transformer which is a Android 3 Tablet with a detachable keyboard and I thought after a couple of weeks it would be a good time to write a review.

The basics
The tablet feels well made, the first thing I noticed was the feel of the outside of the tablet which is ridged plastic and feels soft to touch. The tablet is light, but not as light as a kindle - but you can hold it comfortably in one hand. It does look nice and shiney and I think it looks as good as an iPad!
With the keyboard docked the whole unit looks like a netbook. The keyboard weigh enough to balance the device nicely. A really nice feature is the battery boost the keyboard offers, it has batteries that charge the main unit when docked. The tablet has a micro SD reader, and the dock has a full MMC/SD reader. The dock also has USB ports that work with normal USB keys!
The screen is bright and high resolution. I have found it a little dark if you leave it on 'auto' brightness - but it is easy to manually change. The touch sensitive screen is very responsive - about the same as on other devices I have used. There is a front/rear camera's both seem ok, but I haven't put them to much use.

Honeycomb (Android 3.1)
The main feature of this device is that it is Android 3.1 which is google's tablet os. It seems to be a well thought out upgrade to android. All the built in apps have been updated to take advantage of the larger screen.
Apps are essential to tablets and the market does seem to have quite a few however annoyingly there doesn't appear to be a way to see just apps optimised for tablets.

Touchdown for exchange. Provides a exchange client for the tablet. It is mostly tablet optimised but has a few glitches (e.g. if you click a notification it opens in phone mode)
Evernote - I have the beta for tablets from their website (the one in the market is for phones) - this is excellent and provides perfect note taking environments
TweetCaster HD - provides a good twitter client. I did try TweetDeck - but they haven't optimised it for tablets yet so for now this is better.

A lot of (major) apps are not yet tablet optimised, but work ok - including Skype, Four Square, Blogger, Google Reader and Facebook. It is interesting that Google themselves haven't got round to updating all their apps to support the larger screen. A few phone apps won't work at all, and others work but behave oddly due to the screen size (e.g. the BBC iPlayer app).

The browser is worth mentioning separately it is excellent. The flash support means I can use iPlayer, SeeSaw (for a little bit longer) and a range of other sites. The only annoying thing is a number of sites switch to 'mobile' mode and you have to switch back manually! I tried Opera Mobile and it is also good, but I haven't really thought of a reason to use it!

I have hit some issues

Getting files onto it - From a Mac you can't copy files onto it via USB. According the Android websites you can use a file transfer programme they supply to do this - but it doesn't work with the Asus. Asus appear to have implemented some own-brand software for PC and this has broken the built in mac support. I solved this by copying files onto a SD card - but that is a hassle!
Finding tablet optimised apps - It would be great if the market had a section/filter for this

Keyboard
The keyboard was why I bought this rather than another android tablet, now I have it I am not so sure it is needed. Even with the keyboard it isn't a great device for creating content (for example I started this blog on the tablet but gave up as the app couldn't do bullets and the web editor wouldn't work). The keyboard also has some annoying behaviors - if you are typing, fast, it seems to move the cursor up a few lines randomly. I thought originally I was knocking a key, but I have tried again and again and it keeps happening. The software keyboard on the tablet is very good, it supports 'swype' and direct typing and for most purposes it is all you need.

Overall
I think it is an great device - I went on a (business) trip to Canada last week and barely used my laptop at all. The device was invaluable on the flight back as the in-flight entertainment was broken and I could watch stuff on it! I think these are a strong competitor to the iPad and we will see the current weak selection of app's rapidly fixed.

Marmite and porridge

2011-06-05T08:03:00.001+01:00

While I was in malaysia I was missing marmite so bought some at a sumpermarket. On the back was a suggestion to try marmite on porridge!
So i tried

The result was interesting but not very nice and I love Marmite.

Adieu SeeSaw...

2011-05-29T10:15:00.000+01:00

So the news is now out - SeeSaw.com is shutting down. It has taken a lot of my time over the last few years so I thought it deserved a blog post...

I started on Project Kangaroo (then called Sherbet) in July 2007 when I joined ioko. We spent several years bouncing around different offices in February 2009 when the competition commission shut the venture down. I helped them spend several months trying to sell it, (to a range of people) and Arqiva picked it up (in August) and decided to launch the UK site. Arqiva also decided to redo the UI and it ended up launching to the public in early January (after a closed beta). Since then we have added extra features (paid content, subscriptions) and even have a range of stuff on the shelf that is ready but never got released :(.

It's quite a shame the latest release never got out as it added subscription packs and was a lot quicker. We had moved the site over to a 'nearly no SQL' architecture and it made it much more personal and responsive. We also have a revamped player that is smoother than the old one and supports newer DRM which would have let us have better content.

It has been an interesting ride, and there have been many ups and downs (and this still may not be the end for the SeeSaw tech!) - I would like to thank all the people that I have worked with on this over the years - it was a pleasure!

I have been following a couple of the press responses to the shutdown and I thought one deserved comments

Paid Content - made a number of good points but got a couple of facts wrong. SeeSaw did not inherit any content rights from Project Kangaroo - they all had to be arranged again. As a result it lost a lot of key content.
They also mock the ad-selector - this is a model that actually worked well for SeeSaw and is now proven on loads of sites (including Hulu).
I think they were correct in analysing that competing with iPlayer, 4OD, Demand 5 made it very hard to succeed.

To wrap up I have an interesting collection of fake adverts we made over the last few years for SeeSaw Testing...

This is from early 2009 and has pictures of most of the then project Kangaroo Team on it.

This is our favourite 'test' advert from the project Kangaroo phase with Ian Petzer demonstrating the (then new) logo!

And we also have one of our ever popular 'build rabbit'. It didn't last very long as it annoyed people way too much!

And finally seeing as most of the SeeSaw team know the whole thing off by heart - our favourite test programme - Big Buck Bunny (and for the record I am not the squirrel despite rumours to the contrary).