A Year of Mashable - 2012</h1> <article> <h1>A Year of Mashable - 2012</h1> <p>andy — Fri, 04 Jan 2013 23:06:32 +0000</p> <p></p> <p>At work I finally got around to doing a project I’ve been wanting to do for a long time: analyze the sharing behavior of a year’s worth of content at Mashable.</p> <p>It’s no small project. First, a year’s worth of Mashable content must be collected, which ended up being 13,979 articles in total. Next, the author, publish date, headline, and full text of each post must be extracted from each page, which requires a (fortunately simple) custom scraper to be built. Next, the social resonance data of each article must be collected. For this analysis, I collected share counts for Twitter, Facebook, StumbleUpon, LinkedIn, Google+, and Pinterest, plus clicks from Bitly and per-article submissions from Reddit. Once all that data has been collected and structured, it must be analyzed. I found good ol’ Excel pivot tables to be perfect for most of the analysis. Tracking mentions of key topics from the past year, like <a href="http://www.youtube.com/watch?v=9bZkp7q19f0">Gangnam Style</a>, requires the ability to do full-text searches against headlines and article content, so I indexed all of the data from above into <a href="http://www.elasticsearch.org/">ElasticSearch</a>. It performed brilliantly.</p> <p>I ended up making an infographic out of the data, and I <a href="http://blog.wcgworld.com/2013/01/a-year-of-mashable-2012-infographic">posted it</a> to the <a href="http://blog.wcgworld.com/">corporate blog</a> of the company I work for. I’m proud of it, so I’m posting it here too.</p> <p>By no means the finest infographic ever made, but hopefully not the worst one, either. Enjoy!</p> <div class="feedflare"> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=mYc47wHAsh4:B17v8tVfoJk:yIl2AUoC8zA"></img></a> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=mYc47wHAsh4:B17v8tVfoJk:qj6IDK7rITs"></img></a> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=mYc47wHAsh4:B17v8tVfoJk:V_sGLiPBpWU"></img></a> </div> </article> <article> <h1>Stork, An Example Programming Language, Lesson 4: Variables</h1> <p>andy — Sun, 14 Oct 2012 05:02:15 +0000</p> <h3>Welcome back!</h3> <p>For those of you just joining, <a href="http://sigpwned.com/content/stork-example-programming-language-10-steps">Stork</a> is an example programming language “course” designed to demonstrate the principles of programming language implementation in 10 “lessons.” This is Lesson 4 in a series of 10, so if you’re just joining now, you may want to take a peek at lessons <a href="http://sigpwned.com/content/stork-example-programming-language-lesson-1-tokenization">1</a>, <a href="http://sigpwned.com/content/stork-example-programming-language-lesson-2-expression-parsing">2</a>, and <a href="http://sigpwned.com/content/stork-example-programming-language-lesson-3-expression-evaluation">3</a> to gear up a bit for this post.</p> <p>Lesson 4 adds <a href="http://en.wikipedia.org/wiki/Variable_%28computer_science%29">variables</a> to Stork, which involves adding <a href="http://en.wikipedia.org/wiki/Statement_%28computer_science%29">statements</a> in addition to the <a href="http://en.wikipedia.org/wiki/Expression_%28computer_science%29">expressions</a> already in the language. The addition of variables provides fodder for some additional (and more interesting) <a href="http://en.wikipedia.org/wiki/Static_program_analysis">static analysis</a> as well. At the end of this lesson, Stork will be a working interpreter for simple numerical expressions with support for variables. (The variables will become much more interesting over the course of the next couple of lessons, which will add support for <a href="http://en.wikipedia.org/wiki/Function_%28computer_science%29">functions</a> and <a href="http://en.wikipedia.org/wiki/Control_flow">control structures</a>.)</p> <p>The code for this lesson is available on <a href="https://github.com/sigpwned/stork">github</a> under the tag <a href="https://github.com/sigpwned/stork/tags">lesson4</a>, and you can follow the discussion about this lesson on <a href="http://www.reddit.com/r/programming/comments/11gk21/stork_implementing_a_programming_language_lesson/">reddit</a>. As a quick preview, though, Stork is getting cool:</p> <pre><code>$ java com.sigpwned.stork.Stork >>> var x:Int >>> x ERROR: Variable may not have been initialized: x >>> x = 1+2*(3+4) 15 >>> var y:Float >>> y = x 15.0 >>> x = y ERROR: Will not coerce to less precise type: Float -> Int >>> x = (cast Int) y 15 >>> x+y 30.0 >>> ^D $ </code></pre> <div class="feedflare"> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=ljG6XJ5sBFk:pC7_36HPRZY:yIl2AUoC8zA"></img></a> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=ljG6XJ5sBFk:pC7_36HPRZY:qj6IDK7rITs"></img></a> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=ljG6XJ5sBFk:pC7_36HPRZY:V_sGLiPBpWU"></img></a> </div> </article> <article> <h1>Stork, An Example Programming Language, Lesson 3: Expression Evaluation</h1> <p>andy — Fri, 28 Sep 2012 14:33:19 +0000</p> <h3>Welcome back!</h3> <p>For those of you just joining, <a href="http://sigpwned.com/content/stork-example-programming-language-10-steps">Stork</a> is an example programming language “course” designed to demonstrate the principles of programming language implementation in 10 “lessons.” This is Lesson 3 in a series of 10, so if you’re just joining now, you may want to check out lessons <a href="http://sigpwned.com/content/stork-example-programming-language-lesson-1-tokenization">1</a> and <a href="http://sigpwned.com/content/stork-example-programming-language-lesson-2-expression-parsing">2</a> to gear up a bit for this post.</p> <p>Lesson 3 covers the basics of <a href="http://en.wikipedia.org/wiki/Compiler">compiler</a> design (<a href="http://en.wikipedia.org/wiki/Compiler#Front_end">front end</a> versus <a href="http://en.wikipedia.org/wiki/Compiler#Front_end">back end</a>) and <a href="http://en.wikipedia.org/wiki/Data_type">types</a>, plus a very brief preview of <a href="http://en.wikipedia.org/wiki/Static_program_analysis">static analysis</a>. At the end of this lesson, Stork will be a working interpreter for simple numerical expressions.</p> <p>The code for this lesson is available on <a href="https://github.com/sigpwned/stork">github</a> under the tag <a href="https://github.com/sigpwned/stork/tags">lesson3</a>, and you can follow the discussion about this lesson on <a href="http://www.reddit.com/r/programming/comments/10pjzz/stork_implementing_a_programming_language_lesson/">reddit</a>.</p> <h3>(Basic) Compiler Theory</h3> <p>Most developers are familiar with the <em>use</em> of compilers like <a href="http://en.wikipedia.org/wiki/Javac"><code>javac</code></a> and <a href="http://gcc.gnu.org/"><code>gcc</code></a> — instant program, just add source code — but aren’t familiar with their inner workings. Stork is intended to dispel some of the mystery around compilers, and its far enough along now to start discussing Stork in the greater context of compiler design.</p> <p>In the most general sense, compilers are simply translators that turn program source code into executable instructions. There are many compilers: <code>javac</code>, the Java compiler, turns Java code into <a href="http://docs.oracle.com/javase/specs/jvms/se5.0/html/Overview.doc.html#2111">Java bytecode</a>; <code>gcc</code>, the Gnu C Compiler, turns C code into native instructions, and so on. There are also similar programs called <a href="http://en.wikipedia.org/wiki/Interpreter_%28computing%29">interpreters</a> that execute program source code directly without first compiling them down to instructions, like <a href="http://www.ruby-lang.org/en/"><code>ruby</code></a> or the subject of this course, Stork. While interpreters are technically different from compilers, the same design principles apply, so the Stork interpreter will serve nicely as a platform for exploring simple compiler design.</p> <h4>Compiler Design: Front End, Middle End, and Back End</h4> <p>At a high level, compilers look like this:</p> <div style="width:468px;margin-left:auto;margin-right:auto;"> <p style="text-align:center;">Basic Compiler Design</p> </div> <div class="feedflare"> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=x8kKsBdBIAE:ZmFgiw-gUiI:yIl2AUoC8zA"></img></a> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=x8kKsBdBIAE:ZmFgiw-gUiI:qj6IDK7rITs"></img></a> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=x8kKsBdBIAE:ZmFgiw-gUiI:V_sGLiPBpWU"></img></a> </div> </article> <article> <h1>Stork, An Example Programming Language, Lesson 2: Expression Parsing</h1> <p>andy — Sun, 02 Sep 2012 16:05:36 +0000</p> <h3>Welcome back!</h3> <p>For those of you just joining, <a href="http://sigpwned.com/content/stork-example-programming-language-10-steps">Stork</a> is an example programming language “course” designed to demonstrate the principles of programming language implementation in 10 “lessons.” This is Lesson 2 in a series of 10, so if you’re just joining now, you may want to check out <a href="http://sigpwned.com/content/stork-example-programming-language-lesson-1-tokenization">lesson 1</a> to gear up a bit for this story.</p> <p>Lesson 2 covers the basics of parsing numerical expressions using the tokenizer implemented in Lesson 1. Evaluation of these expressions will be handled in Lesson 3.</p> <p>The code for this lesson is available on <a href="https://github.com/sigpwned/stork">github</a> under the tag <a href="https://github.com/sigpwned/stork/tags">lesson2</a>, and you can follow the discussion about this lesson on <a href="http://www.reddit.com/r/programming/comments/zyzdx/stork_implementing_a_programming_language_lesson/">reddit</a>.</p> <h3>What is Parsing?</h3> <p>If a programming language is a (more) convenient language humans can use to describe tasks to computers, then <a href="http://en.wikipedia.org/wiki/Parsing">parsing</a> is the process of turning a program’s tokens into sentences, or “abstract syntax trees” <a href="http://en.wikipedia.org/wiki/Abstract_syntax_tree">(ASTs)</a>, that the computer can understand. For example, consider this simple mathematical expression for the area of a circle with radius 5:</p> <p><pre class="brush:python"> 3.14159*5*5 </pre></p> <p>For this program text, the tokens would be <code>3.14159</code>, <code>*</code>, <code>5</code>, <code>*</code>, <code>5</code>, and a parser would build the following AST for it:</p> <div style="width:240px;margin-left:auto;margin-right:auto;">  </div> <p>Clearly, parsing is essentially “sentence diagramming” for a programming language.</p> <p>This lesson covers how to transform a token stream into a parse tree like the above example. Looking at parse trees — the syntactic relationships among tokens — instead of the tokens themselves will make evaluating those expressions much easier in the next lesson.</p> <div class="feedflare"> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=o4mrdH74q04:wfdcRgr1rn0:yIl2AUoC8zA"></img></a> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=o4mrdH74q04:wfdcRgr1rn0:qj6IDK7rITs"></img></a> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=o4mrdH74q04:wfdcRgr1rn0:V_sGLiPBpWU"></img></a> </div> </article> <article> <h1>Stork, An Example Programming Language, Lesson 1: Tokenization</h1> <p>andy — Tue, 28 Aug 2012 18:42:24 +0000</p> <h3>Welcome back!</h3> <p>For those of you just joining, <a href="http://sigpwned.com/content/stork-example-programming-language-10-steps">Stork</a> is an example programming language “course” designed to demonstrate the principles of programming language implementation in 10 “lessons.” This is Lesson 1 in the series, so if you’re just joining now, you haven’t missed much!</p> <p>The code for this lesson is available on <a href="https://github.com/sigpwned/stork">github</a> under the tag <a href="https://github.com/sigpwned/stork/tags">lesson1</a>, and you can follow the discussion about this lesson on <a href="http://www.reddit.com/r/programming/comments/z89dm/stork_implementing_a_programming_language_lesson/">reddit</a>.</p> <h3>What is Tokenization?</h3> <p>If a programming language is a (more) convenient language humans can use to describe tasks and processes to computers, then <a href="http://en.wikipedia.org/wiki/Tokenization">tokenization</a> is the process of turning a program’s raw program text into words, or “tokens,” that the computer can understand. For example, consider this simple <a href="http://www.python.org/">Python</a> program for the factorial function:</p> <p><pre class="brush:python"> def factorial(n): if n == 0: return 1 else: return n * factorial(n-1) </pre></p> <p>For this program text, the tokens would be: <code>def</code>, <code>factorial</code>, <code>(</code>, <code>n</code>, <code>)</code>, <code>:</code>, <code>if</code>, <code>n</code>, <code>==</code>, and so on. Looking at tokens — atomic units of program semantics — as opposed to characters makes the next lesson’s topic of “parsing,” or discovering the semantic relationships among the different parts of the program text, much easier.</p> <p>In a very real sense, the tokenizer defines the vocabulary of the programming language.</p> <div class="feedflare"> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=RgObX4BJCG0:6sMWY9zL6Gs:yIl2AUoC8zA"></img></a> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=RgObX4BJCG0:6sMWY9zL6Gs:qj6IDK7rITs"></img></a> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=RgObX4BJCG0:6sMWY9zL6Gs:V_sGLiPBpWU"></img></a> </div> </article> <article> <h1>Stork: An Example Programming Language in 10 Steps</h1> <p>andy — Sun, 26 Aug 2012 17:28:34 +0000</p> <p>There are several questions every developer gets asked sooner or later:</p> <ul> <li>How do you learn to program?</li> <li>Should I learn to program?</li> <li>What is a program?</li> <li>Where do programs come from?</li> <li>What is a programming language?</li> <li>Where do programming languages come from?</li> </ul> <p><a href="http://sigpwned.com/content/learning-how-program">Most</a> <a href="http://www.codecademy.com/">of</a> <a href="http://norvig.com/21-days.html">these</a> <a href="http://en.wikipedia.org/wiki/Computer_program">questions</a> <a href="http://business.time.com/2012/06/08/codecademy-founder-why-everyone-should-learn-programming/">already</a> <a href="http://en.wikipedia.org/wiki/Programming_language">have</a> <a href="http://www.nicolethenerd.com/2012/01/computer-science-q-why-are-programming.html">excellent</a> <a href="http://code.google.com/edu/languages/">answers</a> <a href="http://www.businessdictionary.com/definition/programming-language.html">online</a>. But while the question of where programming languages come from is the topic of some <a href="http://www.amazon.com/Compilers-Principles-Techniques-Tools-Edition/dp/0321486811/ref=dp_ob_title_bk">excellent</a> <a href="http://www.amazon.com/Programming-Language-Pragmatics-Michael-Scott/dp/1558604421">books</a>, I’ve never been able to find a simple, straightforward, <em>free</em> answer online.</p> <div style="width:400px;margin-left:auto;margin-right:auto;"> <p style="text-align:center;">I’m happy/sad this Michael Scott is not the author of that book.</p> </div> <p><em>Stork</em> is a simple, free programming language I’m writing in ten steps and documenting in writing, code, and Reddit threads. I think Stork fills that hole, and I hope that you, gentle reader, think that it does, too.</p> <div class="feedflare"> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=nDre1dwDM0E:LlFV6XcwS7M:yIl2AUoC8zA"></img></a> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=nDre1dwDM0E:LlFV6XcwS7M:qj6IDK7rITs"></img></a> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=nDre1dwDM0E:LlFV6XcwS7M:V_sGLiPBpWU"></img></a> </div> </article> <article> <h1>Twitter Is Not Evil, It's Just a Business</h1> <p>andy — Fri, 17 Aug 2012 04:40:57 +0000</p> <p>Today, <a href="https://dev.twitter.com/blog/changes-coming-to-twitter-api">Twitter announced version 1.1 of its <span class="caps">API</span></a>. The announcement included some interesting changes:</p> <ol> <li><strong>All <span class="caps">API</span> requests must now be authenticated.</strong> Twitter doesn’t talk to strangers anymore. You have to at least introduce yourself before it’ll talk to you.</li> <li><strong><span class="caps">API</span> hits are now counted per-endpoint.</strong> Some APIs have more hits hourly and some fewer, purportedly based on endpoint popularity.</li> <li><strong>Display Guidelines are now required to be observed.</strong> If you display tweets off of Twitter, they must be consistent with Twitter’s visual style <em>or else</em>.</li> <li><strong>Pre-installed client applications must be certified by Twitter.</strong> Applications that come installed on things like mobile devices must be Twitter tested, Twitter approved.</li> <li><strong>Twitter app growth is limited to 100,000 users.</strong> Apps are only allowed to have 100,000 user tokens before they’re forced to ask Twitter “please, sir, I want some more?”</li> </ol> <div style="width:250px;margin-left:auto;margin-right:auto;"> <p style="text-align:center;">Twitter developers in 6 months</p> </div> <p>In short, Twitter started acting like a business. And the world was <em>shocked and apalled</em>.</p> <div class="feedflare"> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=KZaMped6h5I:-JIHsxdavmw:yIl2AUoC8zA"></img></a> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=KZaMped6h5I:-JIHsxdavmw:qj6IDK7rITs"></img></a> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=KZaMped6h5I:-JIHsxdavmw:V_sGLiPBpWU"></img></a> </div> </article> <article> <h1>Should I Use ORM Or Not? Sure.</h1> <p>andy — Sat, 11 Aug 2012 18:12:58 +0000</p> <p>There are a whole lot of strong opinions about <span class="caps">ORM</span> floating around the internet and elsewhere. When you see <a href="http://news.ycombinator.com/item?id=3008830">so</a> <a href="http://omniti.com/seeds/your-orm-sucks">many</a> <a href="https://speakerdeck.com/u/kennethreitz/p/flasky-goodness">passionate</a>, <a href="http://cloud.dzone.com/articles/spring-hibernate-google">conflicting</a> <a href="http://stackoverflow.com/questions/10405650/how-to-make-the-amazing-hibernate-framework-provide-a-connection-object-from-its">opinions</a> in so many different threads, it’s a pretty clear sign you’re looking at a religious argument rather than a rational debate. And, as in any good religious argument — big endian or little endian, butter side up or butter side down, vi or emacs, Team Jacob or Team Edward — this one has two sides, too.</p> <div style="width:400px;margin-left:auto;margin-right:auto;"> <p style="text-align:center;">Still a better love story than Twilight.</p> </div> <div class="feedflare"> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=Pw_KGFPXXI4:sZ8hKRkPjss:yIl2AUoC8zA"></img></a> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=Pw_KGFPXXI4:sZ8hKRkPjss:qj6IDK7rITs"></img></a> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=Pw_KGFPXXI4:sZ8hKRkPjss:V_sGLiPBpWU"></img></a> </div> </article> <article> <h1>Complication is What Happens When You Try to Solve a Problem You Don't Understand</h1> <p>andy — Sat, 05 May 2012 03:32:42 +0000</p> <p>Code should be simple. Code should be <em>butt</em> simple. Code should be so simple that there’s no way it can be misunderstood. Good code has no nooks. Good code has no crannies. Good code is a round room with no corners for bugs to hide in.</p> <p>We all know this. So why does most code <em>suck</em>?</p> <p>Because it’s written by people who don’t understand the problem they’re trying to solve.</p> <div style="width:200px;margin-left:auto;margin-right:auto;"> <p style="text-align:center;">Oooooooooh!</p> </div> <div class="feedflare"> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=ovoKX-WAgUs:rfB27quJF7M:yIl2AUoC8zA"></img></a> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=ovoKX-WAgUs:rfB27quJF7M:qj6IDK7rITs"></img></a> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=ovoKX-WAgUs:rfB27quJF7M:V_sGLiPBpWU"></img></a> </div> </article> <article> <h1>Enabling "Personal Sites" with PHP on Lion</h1> <p>andy — Sun, 15 Apr 2012 04:27:11 +0000</p> <p>After <a href="/content/migrated-snow-leopard-lion-nice">switching over to Lion</a>, I had to re-enable personal sites to continue working on a side project. Fortunately, it’s just as easy in Lion as it was in Snow Leopard. I’ll walk through the setup process in this article. Note that you’ll need administrator access for a few steps in the process, so you’ll need the admin password.</p> <p>In Snow Leopard, the quickest and easiest way to get sites set up was to use the “Web Sharing” feature of the <span class="caps">OS</span>, and it looks like Lion works the same way.</p> <div class="feedflare"> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=GCqrE7SlIwQ:0csNjvS824U:yIl2AUoC8zA"></img></a> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=GCqrE7SlIwQ:0csNjvS824U:qj6IDK7rITs"></img></a> <a href="http://feeds.feedburner.com/~ff/sigpwned?a=GCqrE7SlIwQ:0csNjvS824U:V_sGLiPBpWU"></img></a> </div> </article> </main></body></html>