How is this better than the others?

I think it’s better than Bash because haXe is an OO language and it’s fully crossplatform (no bash in Win unless you use Cygwin). I also think it’s better than Ant because you get rid of bloody-fatty Java as a dependency.

How is this done

In a nutshell: you program in haXe, compile to Neko and then pack to a native app using Xcross. Piece of cake!

Let’s say you need to read some config file, compile your AS using MTASC and copy the output file to several places. Let’s assume a simple config file like this:

And that we pass it to our tool like this:

Now the pseudo-code:

And now compiling:

That should be it; we’ve read and parsed a config file passed as a parameter and then called MTASC handling the result. Then compiled to native Win, Mac and Linux apps.

As I said, that’s pseudo code, on a real life app you would definitely need more error handling or might have a more complex config file (maybe xml, try parsing xml in Bash!), etc., but since haXe is a really similar to Flash or JS, it feels very natural to me. Granted, you can do the same in Bash, but to my eyes is much more complicated.

Some more notes:

• From a Neko app you can call any other tool on your system. That includes SVN, Ant, GIT, grep… Whatever is there, you can call it.
• Apps created with Xcross embed the Neko VM so they have zero dependencies (unless you use any of the tools described above, of course).

We are investigating this route instead of Ant for our build scripts. You might think it’s kind of reinventing the Ant wheel, but we have the feeling that this is going to be much faster and flexible to our needs.

We’ll see : )

PS: I’ve used the xa.* package in the code, that’s a little project I’m working on to provide a simpler haXe API for backends. This is a spin-off of HippoHX and it’s not ready yet, but if you are interested you can follow the development in GitHub.

Our tools set is pretty standard: FDT, MTASC, SWFMill, PureMVC, Ant, command line scripts, haXe…

WARNING: You MUST be willing to do AS2. We know it’s a pain in the neck (tell us about it) but until FP 10.1 / FashLite 4 is a reality on mobile devices we are stuck with crappy AS2. Believe me, we would LOVE to ditch it, but that’s just not a possibility at the moment.

As for the things we do at ustwo™: a ton of Flash stuff for mobile devices, also quite a few iPhone apps, we were part of the private beta team that tested the Flash to iPhone CS5 exporter, we work with some big names, some not so well known names, we do Android apps… Check out the blog for latest info.

ustwo™ London is based in Shoreditch and we also have offices in Malmo (Sweden). We are a bunch of nice people, we put music for the whole studio (despite the occasional cheese shite played by Mills we have good music on), we play footy once a week, we have a beer fridge… but we also work our asses off and push to keep delivering awesome stuff.

So, check out ustwo™’s website and if you feel like it, get in touch.

Our current project at ustwo™ is a PureMVC-multicore application. Sounds really fancy, but it’s only a SWF loading SWFs.

To compile those SWFs we have some scripts using Ant, MTASC, SWFMill, Rhino and other tools. Updating from SVN and compiling 18 modules was taking around 90-100 seconds (that’s updating and compiling the whole project, you can compile single modules much faster).

Keep in mind that our compilation process is a little bit more than calling MTASC. We are running some pre-processing, generating exclude files and some other trickery to gain extra performance (we target mobile devices).

Anyway. Got a hint from one of our developers so I did some research to find a way to speed up compilation time. Since most of us have now dual-core machines we should be able to parallelize some of the work, right? Indeed we can.

Finding PPSS was quite easy but understanding how it to works was a little bit more complicated. I’m not going to bore you to death with the nitty-gritty, so this is the flow that adapted better to us:

* In bash parse the list of module folders and create a txt file containing the path to a script passing to it the path of the module as a parameter. One line per module:

* Feed that txt file to PPSS like this:

That’s where the magic happens. PPSS parallelizes each call to the compilation script using both CPUs. When you run it you can see they go all the way up to 80-90% usage, which is kind of the point.

We took some metrics and found a 40% speed improvement, sometimes even more. If you are a compulsive compiler like yours truly, this saves you quite some time.

Going from the serial approach to the parallel approach wasn’t straight forward. Mostly because I had to split the main script into several scripts and that caused some issues due to my bash programming limitations. This is what I learnt:

* If you execute a script from another, the child doesn’t have access to the variables defined by the parent unless you export them…
* … but arrays don’t get exported.
* Also, you can’t “escalate” exported vars from children to parents. The trick only goes from parent to children (security, I guess).

Anyway. Some more command line black magic under my belt, which is great. The console is a very, very powerful tool that can simplify and standardize daily tasks, which is a must when you are on a team of 10 devs. Not that it is the nicest programming language (actually, it’s pretty ugly), but its ubiquity makes learning it worthwhile.

Keep in mind that these guys are responsible for quite a few things that today we take for granted such us memcached, Unix, JS, Internet, Java, Firefox, etc.

One common thought is that back in the days they used to know in and out every line of code that run on their machines. Most of them spent quite a few years programming assembly and “close to the metal” (aka, the hardware), but today’s programmers “don’t know the whole thing“.

Well, they are right.

I for one have no idea of assembly, machine code or even C. Now, is that good or bad? Granted, the more you know, the better, but most of them also agree that with the level of abstractions that we programmers “enjoy” these days this doesn’t sound possible any more.

For example, think about the abstractions of the typical Flash movie:

Hardware > OS > browser > Flash player > framework of choice > your app here

Now, that’s obviously a gross overview, since we could break OS in (that I can think of, not even sure it’s the right order):

kernel > drivers > window system > graphic card

The thing is, even if you had access to ALL the code running (which most likely you don’t), who has the time and skills to look at it _and_ get job done?

With all those abstractions in place, when something fails good luck trying to figure out where the problem is. Can you be sure? Because even when we find a bug in the player, is that Adobe’s fault? Mozilla? Explorer? Linux? A combination? Very hard to tell, more so when a few of those elements are black boxes (proprietary software, you don’t have access to the code).

Most of those guys wonder about what are the best skills for programmers nowadays. When they started coding, it was a must having very good math skills because of the lack of HW power. They needed to squeeze every single CPU cycle and memory position. Either that or your program wouldn’t go anywhere. We all know that’s not true any more. Is this bad? I say it depends on your work.

If you are building compilers, 3D engines or drivers, then by all means you need to focus on performance and have those skills. But if you are doing user interfaces I bet your users appreciate a hand for design and usability. So, completely different skills needed. The fact that HW has gotten so powerful has lowered the barrier for being a programmer so people with very different skills can afford it now, and I think that’s good. The fact that a designer (and probably even the most advanced Flash “programmer” looks like a designer to them) can build an interface without having to worry about HW, graphic cards and code optimizations is pushing computers to different areas.

Even for developers, the skills you need now are not the skills you needed 40 years ago. They think most developers these days “play Lego“. They mean we build blocks with the frameworks or libraries available, but don’t do any “real” programming. They have a point. But again, is that good or bad? This is classic DRY stuff. Why would I want to code a SHA1 library if there are quite a few there already? Heck, doing so would not only be a waste of time, it’d probably be a security hole as most likely I wouldn’t get it right. Why would I want to roll my own PHP framework if there are a myriad of choices offering DB abstraction and XSS and CSRF protection out of the box?

See, I think what’s important is having the skills to roll your own code when needed and use somebody else’s when it makes sense. And that requires some skills as well. First, you need to be able to identify what’s core for you and disregard coding everything else. Then you need to be able to start using somebody else’s code without having to understand it all, many times only looking at some (often incomplete) docs or API. That require skills. A different type, but skills nonetheless.

Also, obviously with all due respect, I think they miss an important thing. They didn’t start from scratch either. Nobody does.

Standing in the shoulders of giants

For example, very, very, very few physicists question the thermodynamics laws. Very, very, very few mathematicians question Pythagoras. They take them for granted. They’ve been proved. They use them as a base to build on top. Yet, there’re those very, very, very few that do indeed question the core laws that everyone else just “use”. It’s their job challenging those laws, otherwise completely accepted, and put them to the limit and analyze them with modern eyes.

Why we don’t have similar laws or universal truths in computing? Well, for starters computers are what, 50 years old? 70 years old? 80? Physics and maths have been around thousands of years. Even if you could compare both worlds, the rules of the “computing universe” have been created by human beings whereas the rules of the Earth just are. Those rules haven’t changed since the Big Bang, what changes is our understanding of them (call it physics math. chemistry, whatever).

As I was saying, quite an interesting book. One of those you can re-read in 2, 3 or 5 years, still enjoy it and still learn from it. Go read it!

So, Google a little bit, first result takes me to CLOC.

In theory you should be able to restrict CLOC to a language only but most likely due to my incompetence with regular expressions I couldn’t get it to work the way I liked it. So doing a little bit of command line trickery, I had to create a text file containing the path of the AS files I wanted to parse and then feed that to CLOC. This is how it looks:

Then send that to CLOC:

That would be the simpler option. But because my project is made of modules (it’s a multicore PureMVC app) and the client wanted both stats per-module and global, I had to push it a little bit further. Basically create a stats file per module and then merge them together. Piece of cake:

Where “overall” is the name of the final output file (actually, 2 files are created, one per file, other per language) and “moduleReportX” files are the partial report created before for each module.

Another good thing about CLOC is that it runs in both OSX and Ubuntu at least pretty much out of the box because both come with Perl installed. However, had a little problem in Ubuntu but contacted Al Danial (the author) and he fixed it right away. If you are running Perl 5.10, go to the line 1038 of CLOC and replace “%” by “@”.

Good to go!

++ Open Script Editor and type this updating the name of the VM you want to launch:

++ Save as Application Bundle and check Run Only.

Off you go.

Thanks.

** Ubuntu (on any window):

CTRL + H (toggles on/off hidden files).

OS X, the paradigm of usability MY ARSE.

(And please don’t embarras yourself saying that Mac users don’t need to know about hidden files)

So, yesterday went to StackOverflow DevDays in London. I’ll start with the bad part:

Organization: Massive queues to pick up food or coffee. FAIL. No 10 minutes break between speakers. FAIL. Mics failing. FAIL. The chairs EPIC FAIL.

The content: I understand that FogCreek is putting some money to sponsor the events but Joel run 2 completely sales focused sessions, one about FogBugz, the other one about FogCreek. Didn’t enjoy either. Please remember that this is not a free conference. Fair enough, it’s not pricey either (£85) and I’m not sure if they cover expenses with tickets only, but it just felt too much advertising. I’m not alone, read the twits. BTW, I wonder if they got similar feeback in the US.

That’s it for the bad part, now the good part.

Joel: when not doing a sales pitch, he is very funny and a great speaker. The intro video with Jeff was a lot of fun.

Jeff: the same. It was like a live Coding Horror post, always very inspiring.

Now the GREAT part:

Jon Skeet: really funny, probably the best speaker and that I didn’t see coming. Put in perspective that Jon Skeet is the SO user with highest reputation and such a badass that he has earned his own facts, much like Chuck Norris! I would love to see him again, FOTB next year? People loved him. He talked about the absolutely mess that is working with dates, strings and numbers in computers due to so many different standards. All this with a sock puppet in his right hand.

Things like Argentina decided this year NOT to follow daylight savings and warned the world only 11 days before hand. Well done you guys!

Christian Heilmann: another very good speaker. He’s a Yahoo! evangelist and I can see why. He demoed YQL and I I had a question banging in my head all the time: Why nobody told me about this before?!?!?! It’s a Yahoo! service to mashup open APIs and it looks REALLY powerful and something I’d definitely look into. Not sure for what yet, but looked very, very cool.

Pekka Kosonen: He works for Nokia and gave a talk about Qt (since when Qt has been pronounced “cute“?!?!?!) that, for those who don’t know, is the framework Nokia finally bought not long ago for building cross-platform *native* applications (including phones and all major desktop OSs). Well he was VERY honest about Nokia. I mean, very, very honest saying things like “we used to suck a lot, now we are getting our act together“. He was very funny, the sort of speaker that doesn’t laugh his own jokes, even when they are good. The honesty was very refreshing after the sales-oriented talks. Again, I wonder what would a US company do should an employee speak *the truth* that about them. Wonder what Joel was thinking (something along the lines “I would SO fire this guy as soon as he’s off the stage“).

Some pearls to put in t-shirts:

Joel: “The mother of all options is giving the user a compiler”
Jeff: “Don’t be afraid of failing publicly ”
Pekka Kosonen: “Light at the end of the tunnel, this time hopefully not a train”
Pekka Kosonen: ” I wrote a Java book but was only for the money”
Phil Nash: “Objective C is like Marmite: LOVE it or HATE it” *
J Mark Pimp about Obj-C: “80s called, they want their memory manager back” // <-- HILARIOUS

There were other speakes as well, they did a decent job. There was a nice intro to iPhone development, a nice intro to Android development, a nice intro to jQuery, a rather dry talk about compilers and a rather drier talk abut Python. Not bad for a single day.

Would I come back next year? I'll have to think about it.

* For probably anyone outside of the UK: Marmite is a cream that literally people either love or hate, they even say it in their adds. Me? Haven’t tried it!

Kids treat you like a taxi service? Now you can act like one with this GPS enabled taximeter application on your mobile. It even includes additional annoyance tolls and children-friendly payment options.

It’s a simple looking app but it does indeed use the GPS and the calculation of the fare is done following London’s official taxi rules. It also takes into account if for whatever reason you lose connection with the satellites. Well, not so simple after all!

But I cannot take full credit, fellow ustwobie Dain Demmel did a big part of the app (if not the biggest), plus we teamed up with WorkClub for art direction.

Anyway, very happy to release an app that people actually use and are happy about.

[UPDATE] Here’s a video demo of the app. [/UPDATE]

And lately we’ve been releasing quite a few apps at UsTwo:

** Ben 10 MouthOff in partnership with Turner.
** .™, brutally addictive first release of the 48hours app series (watch the interview with Mills if you want to know more about the concept).
** Hell-oween MouthOff special.
** And the soon to be released inkstrumental in collaboration with Jon Burgerman.

We don’t stop : )

This year’s FOTB will be remembered as “yes, the year that Joa Ebert…” FOTB. His session was without a doubt the best of the 3 days and if you feel bad for not going, imagine the people that did go to FOTB but didn’t go to the session.

Because it’s taken me a week to write this post (went to Spain after FOTB, came back yesterday, waking up today at 6am wasn’t funny), I’m not going to talk much about every single thing that went on like Richard Lord and frameworks, Mike Jones and Flex 4, Colin Moock doesn’t read books when he gets into new things (funny!), AIR 2.0 improvements, etc. and will only talk about this:

++ Joa Ebert

His session was on Tuesday 22nd September, let’s see how long does it take Adobe to put his optimizations into the nightly builds of the Flex SDK compiler. Because fair enough if your compiler can be improved, but there will be NO EXCUSE to not use Joa’s code. Luckily for us, it seems Adobe is taking it the good way.

The bright side of things is that, without refactoring any code, current applications can improve performance just by running his optimizations. Or from another angle: the AVM2 is faster than we all thought. Can’t wait to hear from all the people squeezing the ass of the player: Papervision and all the 3D engines to begin with, but also image encoders/decoders and other CPU intensive tasks.

++ Open Source rocks

I was very, very happy to see how almost all the big names were finishing their presentations saying: “… and yeah, all these amazing things I do you can download already from this URL…“.

Specially remarkable was Joel Gethin Lewis that said, and I quote:

I think that selling software is immoral

How cool :)

If you are of those who think that he’s a communist and his approach is taking Open Source too far, then at least check out this other quote:

All my work is released as Open Source and I don’t give a shit about people ripping it. I’ve done it, had fun with it and made my money already. I’m not interested any more in the things I’ve done, go and get them. I’m interested in the next thing I’m going to build.

Awesome mindset. And he’s not kidding, here’s his repo.

We are not talking about a nerd in his apartment, we are talking about very successful people working for very big companies. They know their work would be 10x harder without the gazillion OS libraries out there and they think it’s only fair to contribute back as payment. So do I. Let alone the practical point of view of getting other people “to work for you”. Ask Carlos Ulloa what Papervision was before releasing it. It was re-written and ported to AS3 in the first 3 months. And you cannot do that alone. Neither PPV nor Carlos would be anywhere near successful as they are now if Carlos would have kept it for himself only.

Open Frameworks, Merapi, Apparat, ASAXB (do NOT miss out the TV ad)… So if you think your code is so valuable that has to be kept locked, think again. Unless you are doing cooler things than these guys your code is not worth keeping closed (and probably not even then). And yes, I know that telling clients that you are going to release their sources sounds like utopia, we had a long chat about that, but I’ll leave that discussion for another post.

–

And that’s it. For me it’s been the best FOTB so far, if only for the people there! Cay, Diego, Diego, Carlos, the rest of the UsTwo crew and some of the guys of the haXe list made the 4 days very geeky and fun.

Already waiting for FOTB 2010 : )