<< Dinks >>

Lexical Scoping in Ruby

2015-05-31T04:20:00.000-07:00

A video explains better than words!

Change

2015-03-31T05:55:00.002-07:00

Its been more than 3 years now and to tell the least, I have learned a lot. Starting from structuring an application to deploying and tagging. Monitoring if parts of the application works and taking actions and analysing.

But during the last year my productivity and urge has gone down. Substantially. And I have myself to blame. I kept on latching on to my job and did not innovate and search for a new one or change something inside. Now I feel that my team has no trust in me and I am a useless part of the team. This has to change. This has to stop. And importantly I have to come out of this strong.

I intend to look to for opportunities in Berlin and shape my future for the best!

Look more at :-

Nodejs
React
Backbone
Docker
Chef
Swift
SQS

No Deployment Friday Grunt Plugin

2015-03-01T11:09:00.001-08:00

My First Grunt Plugin which just a simple thing! Stops a deployment if the day is a Friday (any day you define as a No Deployment day actually).

Have a look at https://github.com/dinks/grunt-warn-friday.

Nodejs on Heroku

2015-02-24T16:09:00.004-08:00

After hours of effort and suffering, I was able to deploy a Node.js application to Heroku. This post reveals the effort that one has to make in deploying Node.js apps to Heroku.

I had been not using Heroku for some time now and wanted to host a test application on Heroku. This test application has a DB connection to MongoDb, uses the excellent Express Framework in the server side and React with Flux in the Frontend.

The first thing that one immediately notices is that its not that easy to add add-ons in Heroku anymore. They have a policy now with specifying a Credit Card / Payment Details even though I would only like to avail one Dyno. Previously I remember when I could add small add-ons to any Cedar Instance. That was so much cooler. I went on to look at OpenShift from RedHat, but that was a much bigger pain than I expected.

So back to Heroku. The first thing that I tried was to look at MongoLab for a simple Db hosting. They have a nice free developer plan and thats what I went for. The url for the DB went onto the ENV Config for the new Heroku App created. All fine until now.

Now came the actual building process. By default, if one does not specify the node and npm versions in the package.json file, it take the latest versions from semver.io. So for node it took 0.12.0 (https://semver.io/node/stable) and for npm 2.6.0 (https://semver.io/npm/stable).

I have many packages in my test application and it failed compiling for a package called node-sass@1.2.3. This was because of a known issue (https://github.com/sass/node-sass/issues/550) and was fixed with an upgrade of node-sass. But my dependency came from another package and could not upgrade it myself. So I had to tie the version for npm and node.

Once could do this using the engines option inside the package.json file.


"engines": {

  "node": "0.10.x",
  "npm": "2.3.0"
}

The next problem was with the actual building via grunt.

I use wiredep to manage the bower dependencies for me. It injects the dependencies very gracefully and in a fully configurable way. I use font-awesome too in the test app, but it never could add fonts to the dist folder after build. I only way I could do this was via a copy grunt task.

The dependencies are added to the html file (according to the bower:css, bower:js comments) after the build. One normally would like to have the built version served on Heroku. My builds all go to the dist folder and therefore my script start looked like this




"scripts": {

  "start": "NODE_ENV=production node dist/server.js"

}

Once the fonts got copied over successfully, the pending issue was to execute the bower install and grunt build task. This could be done via a post-install hook available with npm. One has just to write something similar to the line below




"scripts": {

  "start": "NODE_ENV=production node dist/server.js",

  "test": "grunt test",

  "postinstall": "bower install && grunt build"

}

The next problem that I faced was that bower and grunt were not a part of the dependencies list. Heroku by default has the setting NPM_CONFIG_PRODUCTION set to true. This means that the npm install only installs the items in the dependencies list and not the devDependencies list (logically). This meant that I either had to move all the grunt tasks and their deps to the dependencies list or set the variable to false. I preferred the latter

heroku config:set NPM_CONFIG_PRODUCTION=false

Now the postinstall was failing. It was not able to find the commands bower and grunt. This was because the commands never got installed globally. To go around this I made a shell file called post_install.sh which has these commands with the expanded paths (according to http://gregtrowbridge.com/deploying-a-node-app-to-heroku-with-grunt-and-bower/)




#!/bin/bash

./node_modules/bower/bin/bower install

./node_modules/grunt-cli/bin/grunt build

and the call from the scripts look like




"scripts": {

  "start": "NODE_ENV=production node dist/server.js",

  "test": "grunt test",

  "postinstall": "bash ./post_install.sh"

}

The grunt-cli was not a part of my original devDependencies list and it had to be added for the command to execute properly.

Now the application ran fine! Phew!

Random Computer quote

2015-01-30T10:53:00.000-08:00

A simple generator :P

http://dinks.github.io/computer-quotes/

JavaScript Currying

2015-01-24T16:30:00.000-08:00

Generic currying in JavaScript is so great but it takes time to understand the code. Closures!

'use strict';

// subCurry(fn, 1)(2, 3)
var subCurry = function (fn /* Multiple arguments possible */) {
var args = [].slice.call(arguments, 1); // Dont take the first argument
return function () {
var thisArgs = Array.prototype.slice.call(arguments);
return fn.apply(this, args.concat(thisArgs));
};
};

// curry(fn)(1)(2)(3)
var curry = function (fn, length) {
// Length will only be available after the first curry
length = length || fn.length;
return function () {
if (arguments.length < length) {
var thisArgs = Array.prototype.slice.call(arguments);
var combined = [fn].concat(thisArgs);

return curry(subCurry.apply(this, combined), length - arguments.length);
} else {
// All arguments ok
return fn.apply(this, arguments);
}
};
};

var fn = function(x, y, z) { return x+y+z; }

var mFn = curry(fn);

console.log(mFn(1)(2)(3));

A Developer Playlist

2014-12-19T06:58:00.000-08:00

A Developer Playlist from http://www.musicforprogramming.net

Recent Reads

2014-11-17T13:56:00.000-08:00

From the book "The Senior Software Engineer" from David Bryant

I had a code review once where the reviewer took issue with a stylistic decision that I had made. It had nothing to do with the underlying change or the correctness of the system. It was a classic "agree to disagree" situation and, as I was the maintainer of the code base, I kept the change the way I had done it. He complained to my boss, who then directed me to change it. NOT COOL.

You may encounter a similar situation when having your code reviewed. You may find that the reviewer is insistent that you do things "their way". This is a difficult situation, especially if the other developer is either senior to you or experienced.

The first thing you do in this situation is re-think the change. Ask yourself if the reviewer has a point and if there really is something substantially wrong about the code in question. Chances are, the reviewer is right.

If you are not convinced of this, ask the reviewer to explain in more technical terms why you should make the change they are suggesting. Explain that you don't see anything substantially wrong and that, as the code's maintainer, you feel your style should be given more weight. This might either defuse the situation or lead to a deeper discussion of why the code is problematic.

In the end, the reviewer may just forget about your code, but if the person is persistent and present roadblocks, you might need to just make their suggested changes just to move on. In the end, its more valuable to ship your code than to "be right" in a code review. If you end up taking this route, I would recommend you avoid including this person in future code reviews.

Great read and great quote!

Points and Animation

2014-07-30T05:36:00.001-07:00

A simple code pen for travel between points and animation. Works for Firefox atleast!

See the Pen iebuc by Dinesh Vasudevan (@dinks) on CodePen.

seconds_until_end_of_day expires for Cache in Rails

2014-05-26T08:11:00.000-07:00

A colleague of mine had to cache some html until the end of the day but found it difficult because cache expects expires_in which is relative. We cant pass an absolute Time.now :P

So we now have seconds_until_end_of_day in 4.0.2, but we use Rails 3 :(

But patching Time is simple

def seconds_until_end_of_day
  end_of_day.to_i - to_i
end

http://apidock.com/rails/v4.0.2/Time/seconds_until_end_of_day

Observers and Migratios

2014-04-29T05:51:00.000-07:00

The past day we created a model migration and then added an observer for the model after the migration. Surprisingly, the observer (now added in the application.rb file) was loaded first by environment which then checks for the model and tries to fire a DB query for columns.

This fails and therefore the migration does not go through.

So for future reference, always migrate first and then add the observer!

Chuck Norris Hubot

2014-03-28T15:44:00.000-07:00

I stumbedupon an API which spits out random Chuck Norris Jokes and I ended up writing a smal hubot for this :)

The API points to http://api.icndb.com/jokes/random

Try it out Chuck Norris Hubot

Caching Simple Navigation

2014-03-10T12:09:00.000-07:00

Morale: Simple Navigation is not that simple

We, in our firm, have different types of user navigation for different types of users. We wanted the flexibility of creating our navigation from the backend(rails) so that there is just one file to maintain with all configurations. Simple Navigation works great in this aspect.

The configuration is complex, but is absolutely generic. We have a couple of navigations to start with, for the normal application and when a user visits the application via the iPad.

The navigation for the normal user takes more than 500ms to render. NOT GOOD! We decided on caching the html. For this we need to split the navigation yet again. With respect to logged in users. Therefore we now have 4 types of navigation, loggedout-normal, loggedin-normal, loggedout-iPad, loggedin-iPad.

We also had some badges on the navigation for unopened items. The next step was to remove these from the navigation file. We created a notifications controller and wrote a small javascript, which takes data from the json response of the show method of this controller, and updated the corresponding sections in the navigation.

Now came the hard part. Caching.

We need to define keys for the Caching itself first.

For a logged out normal user, this would be quite straight forward. Get the locale of the navigation bar. All the users with the same locale got the same navigation bar.

For logged out normal users it would be a little tricky. We have some user specific stuff in the navigation bar such as the username. Therefore, we need the user_id. The user could change his locale and this would trigger a change in the updated_on field on the Users table. This would mean that we need to include this in the key as well. We have a specific link for backend services if the user has admin privileges. For this we need to evaluate the roles of the user. An MD5 has been used to facilitate this.

We need to Cache the non highlighted navigation bar for sanity purposes. Then we plan to highlight the section according to the pages that are rendered. For this we could either create a javascript to add the correct classes or create a stylesheet which highlights the correct section on verification of the correct classes.

We decided to create a stylesheet for this. The stylesheet reads the configuration from the simple_navigation configuration and creates the correct CSS. The file is a LESS file. We extracted the styles to highlight the navigation items into some mixins and used these mixins inside our custom classes.

The next tough part is the sub navigation. While this problem still lurks, we are trying to get away from the sub navigation altogether.

While this post is clearly not technical and is conceptual, this might help some others trying to solve something similar to this.

:)

Altering a MySQL Table

2014-01-07T05:13:00.001-08:00

In a normal world without a lot of records, altering (adding, deleting columns and indices) a table is an easy job. Have a look at the syntax here.

Its essentially creation of a copy of the original table, applying the alter table to the new table and copying row by row until the end of the table is reached. The essential problem with this is that the row by row copy locks the table because we don't want inconsistencies while we copy. I.e. no writes during the copy.

If the table has lots of rows then this becomes a real problem.

It seems that those intelligent guys have a solution to this too.

One Approach :
- Make changes on the Slave and Upgrade the Slave to Master.

Another (Facebook's Way) :
- Create a temporary table which is a copy of the main table
- Apply the changes to the temp table
- Add something which could be used to run changes on the temp table
- Copy data from the main table to the temp table
- Lock the main table
- Replay the changes on the temp table
- Rename the temp table to the original table after renaming the original table to something else

Phew

Thanks to Martin for the star in github

http://www.facebook.com/note.php?note_id=430801045932
https://github.com/soundcloud/lhm

Bucket Maker

2013-12-25T15:47:00.001-08:00

After some days of research and work, I managed to create a gem which focused on Creating buckets for objects and querying them when needed

Have a look at https://github.com/dinks/bucket_maker which is a gem for Rails 3.2 -> 4 .

Comments most appreciated !

That Great Feeling

2013-12-19T12:20:00.000-08:00

Words can't express that feeling when you upload something to a community that everyone can use !

https://rubygems.org/profiles/dvasudevan

:)

Module extensions 1.9 and 2.0

2013-12-01T10:21:00.000-08:00

I did not know that this threw TypeError on 1.9 but passes for 2.0


x = Module.new { def foo; end }

Module.new { define_method :bar, x.instance_method(:foo) }

From Rails !

Fibonacci - Golden Ratio

2013-10-13T04:41:00.000-07:00

In mathematics, the Fibonacci numbers or Fibonacci series or Fibonacci sequence are the numbers in the following integer sequence: 0, 1, 1,2, 3, 5, 8, 13, 21, 34, 55, 89, 144 ...

I have always done the one with recursion (or iteration). But mathematics says we could do it with the Golden Ratio ..

Dom Mutation Observers and other Topics

2013-10-12T10:46:00.000-07:00

A great video about Dom Mutation Observers

Some notes to read as well

http://infrequently.org/2012/04/bedrock/
http://smus.com/how-the-web-should-work/
http://www.x-tags.org/
http://www.polymer-project.org/

Js for Sublime

2013-10-08T03:41:00.002-07:00

Setting up a build system for Sublime Text for js

Let your interpreter be Node. If you don't have Node, I would recommend installing it from here. It uses the Google V8 Engine.

Open Tools -> Build System and select a New Build System

Name it whatever you want it to be (this will show up in the Build Options)

Add the following to it

"cmd": ["node", "$file", "$file_base_name"],
"working_dir": "${project_path:${folder}}",
"selector": "*.js"

The syntax could be understood from this link.

Restart sublime and open the file. Goto Tools -> Build System and set the build system to the name you gave.

Run Command + B and it will work !

All the build files go into /Library/Application Support/Sublime Text 2/Packages/User

Statsd

2013-10-02T06:35:00.000-07:00

During the last couple of days, I was trying to find myself around Statsd from Etsy. It seems to be a wonderful tool which lets users send stats (or tracking) to a server which in turn could be visualized using tools like Graphite.

The set up is quite simple. Add the Statsd gem to your application's Gemfile and then write a Rack Middleware which sends out information to the predefined server. Before sending out information, we need to setup the Statsd NodeJS Server and give the IP and port for the Gem to work.

Matt Aimonetti has written a great post about setting up the service.

I have found it damn hard to set up Graphite.

The download is easy. git clone the 3 repositories and then run check_dependencies.

Install all the required libraries using pip. Now comes the hard part. A 2D graphics library called Cairo is a dependency for Graphite and a library called py2cairo (pycairo if python >2.7) is to be installed.

I would suggest installing cairo using


sudo brew install cairo

Homebrew is better than MacPorts.

Install pycairo using pip


sudo pip install pycairo


easy_install pycairo

You might get errors when importing the module for cairo. This might be because you installed it via easy_install.

If it does not work (it did not because I have 2 versions of python), symlink from the site-packages/Cairo to the place where python searches for site-packages.

Then run check_dependencies again and you are good to go. I still have to setup Graphite. But I hope I'll have less obstacles after this.

Experimenting with Rails 4

2013-09-21T16:34:00.000-07:00

I had some time this week and I had to try out the Rails 4 and Ruby 2. That's exactly what I did !

I did not try out Key based Cache Expirations or Etag stuff. But I did try out some Server Sent Events stuff. And it went pretty well.

I started out installing Ruby 2 with rvm (I use rvm and don't use to rbenv for some reason). I got through installing 2.0, but when I tried to use a specific gem_set for a test application, I got an error from Rubinius for some odd reason. It said that rbx was to be installed. Somehow it messed up the whole setup and I had to do away with gem_sets. I also had to remove the rbx* installation directory because it was bursting warnings to the console every time the rvm was set.

You must upgrade RVM :)

This benchmark is a great read for 2.0

I wrote the version to the .ruby-version file and that was the start of the project.

I wanted to do something which had some real time communication. Tic Tac Toe seemed to be a nice choice.

There was then this weird problem with sqlite3. It, for some odd reason, could not find the native binding of sqlite3. The path was correctly set but it just could not find the path. I had to spend some hours of debugging to find this out and a lot of googling !

The error was

/usr/local/share/gems/gems/sqlite3-1.3.7/lib/sqlite3.rb:6:in `require': cannot load such file -- sqlite3/sqlite3_ruby (LoadError)

This post saved me at last. Seems like we have to change the actual file of the gem to get this thing running.

In the case of rvm, the file would be under


~/.rvm/gems/ruby-2.0.0-p247/gems/sqlite3-1.3.8/lib/sqlite3.rb

and you will have to change the loading locations relative like


~/.rvm/gems/ruby-2.0.0-p247/gems/sqlite3-X-X-X/ext/sqlite3/sqlite3_native

Once this is done, rails finds it and loads it. This, I think, is NOT good for a Continous Integration Server.

Server Side Events came next. I went through this excellent post on how to get started with SSE. I managed to add Redis pub/sub with SSE after looking through this post. And ultimately used some Thread Processing to get it less Non Blocking as per this post.

Another problem I had was with the servers. I started with Unicorn which was a bad choice. Unicorn kills connections because it is meant for fast processing. For persistent connections, we need to have Puma or Rainbows!

I started using Puma but I did the mistake of not putting


config.preload_frameworks = true

config.allow_concurrency = true

in the application.rb file. Only one request was permitted because of this flaw. This is to be removed later (I have no idea why this is not default ?).

But that did not solve my problems. Puma constantly gave me errors like

ThreadError: Attempt to unlock a mutex which is locked by another thread

which is not good. It never called the ensure block (don't know why) and I seriously doubt the sockets to be open :|

Thats when I tried Rainbows! I added the rainbow.rb file for server config and started the server. It worked great for me !

I also understood that attr_accesible is no more for rails and its all about Strong Parameters.

I tried adding rails-api to the project (this was my first time). It was only after some time that I realized that the stack for rails-api removes the Rack for Session handling because it aims for the Processing to be as less as possible

Rack::Session::Cookie

I was working with an existing Rails application and I did not want this feature. I tried adding


config.api_only = false

to the application.rb file. But that did not help me.

I had to add the particular require for the api for this to work in the Gemfile


gem 'rails-api', require: 'rails-api/action_controller/api'

I wanted to try my bit with the state machine and I managed to write this inside Concerns.

The POC is still incomplete, but I loved doing this after a long time !

Feeling Little

2013-09-06T06:53:00.000-07:00

Today I managed to catch up on some reading and it actually made me feel so tiny and insignificant.

Like the action is elsewhere. And looking up some of the high profiles in LinkedIn, I feel that to do something significant one needs at least a PhD/MS.

Some links

http://gigaom.com/2013/09/04/new-open-source-tech-marathon-wants-to-make-your-data-center-run-like-googles/

http://gigaom.com/2013/07/29/airbnb-is-engineering-itself-into-a-data-driven-company/

https://blog.twitter.com/2011/engineering-behind-twitter%E2%80%99s-new-search-experience

https://blog.twitter.com/2011/twitter-search-now-3x-faster

https://blog.twitter.com/2010/twitters-new-search-architecture

https://github.com/twitter

http://mesos.apache.org/

http://gigaom.com/2013/06/14/a-real-time-bonanza-facebooks-wormhole-and-yahoos-streaming-hadoop/

http://developer.yahoo.com/blogs/ydn/storm-yarn-released-open-source-143745133.html

https://www.facebook.com/notes/facebook-engineering/wormhole-pubsub-system-moving-data-through-space-and-time/10151504075843920

https://amplab.cs.berkeley.edu/projects/spark-lightning-fast-cluster-computing/

http://nerds.airbnb.com/introducing-chronos/

http://www.mesosphere.io/about

Vienna to Innsbruck on Rails

2013-08-28T02:17:00.002-07:00

We had a short get away the past weekend to Innsbruck. We had decided to board a train from Vienna to Innsbruck after we landed by plane in Vienna. I had looked up the prices and found it to be reasonable.

We reached from the airport to the railway station on time and had to buy the tickets from the vending machine. The tickets cost me about 58 per person. We hoped on the Rail Jet train, in second class and found the cabins to be almost full. I and Reshma managed to get hold of a seat which was made for children. There was a small screen in front of us where all the animation movies were run. So time flew ! We watched clips of Donald, Mickey, Goofy, UP! including others.

The train stopped at St Polten, Linz, Salzburg to reach Innsbruck. It would be too less if I were to describe the scenic beauty of this route. Mountains on the left and right with luscious green fields, cattle and watch dogs, trees matriculately placed all cut and clean. What a view ! A breath taking treat to the eyes. The houses were all so beautifully placed as though a great painter had portrayed his dreams.

If you are plan to go to Vienna try this route ! You won't be sad.

Trip To Kerala

2013-06-28T05:22:00.000-07:00

It took me more than a year to find some time to go to my home place. The wait was worth it. I managed to enjoy the Monsoons to the fullest extend, spend quality time with my Mom and Dad, visit Kumarakom with Friends and meet up some NITC batchmates. At the end, 2 weeks was not enough time.

The next time around I will go for more than 3 weeks. :)