D-Roch

MongoDB, How to make a local copy of your production database

Thu Sep 27 00:00:00 UTC 2012

mongodump -h HOST:27053 -d DATABASE -u USER -p PASSWORD -o backups

mongorestore -h localhost --drop -d DEV_DATABASE backups/DATABASE

}

How to find and replace in a MySQL table

Thu Sep 13 00:00:00 UTC 2012

}

How to add Facebook OpenGraph meta tags with Lift Framework

Fri Sep 07 00:00:00 UTC 2012

- Use a head_merge tag to append some attributes to your default template

- In your snippet you can now add values to the meta properties

}

How to parse a RSS feed in Scala

Sun Jul 22 00:00:00 UTC 2012

val rssFeed = XML.load((new URL("http://feedurl.com")).openConnection.getInputStream)     
 
 for (item <- (rssFeed \\ "channel" \ "item")) {       
      logger.debug( (item \\ "title") text )       
      logger.debug( (item \\ "content") text )     
 }

}

How to change the encoding of a file

Thu Jun 21 00:00:00 UTC 2012

Display the current encoding :

file filetochange.ext

Convert it :

iconv -f ISO-8859-1 -t UTF-8 filetochange.ext > fileoutput.ext

}

PHP / Memcached: List all keys

Tue Jun 19 00:00:00 UTC 2012

}

How to get users location on iOS

Tue Jun 19 00:00:00 UTC 2012

CLLocationManager *locationManager = [[CLLocationManager alloc] init];

CLLocationManager alloc] init];

locationManager.desiredAccuracy = kCLLocationAccuracyBest;

locationManager.distanceFilter = kCLDistanceFilterNone;

startUpdatingLocation];

stopUpdatingLocation];

CLLocation *location = [locationManager location];

float longitude=location.coordinate.longitude;

float latitude=location.coordinate.latitude;

}

How to find a file using OSX's Terminal

Tue Apr 10 00:00:00 UTC 2012

mdfind -name filename

}

How to transfer files between two servers

Fri Mar 30 00:00:00 UTC 2012

scp filename user@host:/path/to/folder

}

How to hide every emails from a MySQL table

Fri Feb 10 00:00:00 UTC 2012

UPDATE sys_email SET email=REPLACE(email, SUBSTRING(email,INSTR(email,'@')+1), 'usineadesign.com')

}

Git : Compare file between two branch

Thu Dec 01 00:00:00 UTC 2011

git difftool master..feature

}

Github: Git keep asking for auth on push/pull

Thu Nov 17 00:00:00 UTC 2011

If github keep asking for your login and password even if you have copied your ssh public key, this is what you should do !

Check your .git/config file :

[core]

repositoryformatversion = 0

filemode = true

bare = false

logallrefupdates = true

ignorecase = true

[remote "origin"]

fetch = +refs/heads/*:refs/remotes/origin/*

url = https://github.com/login/project.git

[branch "master"]

remote = origin

merge = refs/heads/master

If the remote origin's url is formated this way : https://github.com/user/project.git your should replace it with git@github.com:user/project.git

}

Hack Day Paris

Wed Nov 16 00:00:00 UTC 2011

Two weeks ago, I went to Hack Day Paris with my friend Christos,

We had decided to start an app' you could use to find people around you (and going in the same way you are going) in order to share a Taxi.

Ok they idea isn't that amazing, but It was the perfect kind of project for this kind of event.

A hackathon is about how you can impress the audience with a two minutes demo of your app. If you have been working on the next generation API,

during the last 40 hours then it's going to be hard to prove it in less than two minutes

Some projects were very impressive because of their complexity and I was quite sure their teams would win.

We didn't expect to get any prices, since our project wasn't going to change the world but we had something to show during demo and thats the most important part.

In the end we got two prices : one from La Ruche & the 2nd price for TechStars ( The awesome Winecombinator arrived first ! )

This is the stack we used, It's extremely productive and scalable :

- PlayFramework (Java Web Framework)

- Siena (NoSQL persistence)

- JQuery (JS Frontend)

- Google Maps javascript API v3

- Google Places API

- Google App Engine (Hosting)

Cabster App isn't only about showing people around you looking for a taxi, we also wanted to sort those matches depending to were they are going.

For each users we persist a current latitude/longitude and a destination latitude/longitude. This way, it's very easy to compare and sort them.

This is the function we used to calculate those distances (The unit is Meters):

public static double distance(double lat1, double lon1, double lat2, double lon2) {

double theta = lon1 - lon2;

double dist = Math.sin(deg2rad(lat1)) * Math.sin(deg2rad(lat2)) + Math.cos(deg2rad(lat1)) * Math.cos(deg2rad(lat2)) * Math.cos(deg2rad(theta));

dist = Math.acos(dist);

dist = rad2deg(dist);

dist = dist * 60 * 1.85315962;

return (dist);

}

I have released the source of the project on Github, and you can try it here.

}

Switch Git's default text editor to Nano

Wed Oct 26 00:00:00 UTC 2011

git config core.editor "nano"

}

How to change the extension of every files in a directory

Tue Oct 25 00:00:00 UTC 2011

for i in *; do mv "$i" "$i.ext"; done

}

Hackernews TreeMap Representation

Sun Sep 11 00:00:00 UTC 2011

A few days ago I found newsmap.jp : It's a nice way to visualize news. I decided to create the same kind of TreeMap representation but for the hackernews feed.
This small experiment is hosted on Heroku and you can find the source on Github. It was made using Playframework, InfoVis and the Hacknews Api.

It also went recursive on hackernews !

}

Google App Engine - CloudFlare and Google Bot's Crawlrate

Sun Sep 11 00:00:00 UTC 2011

Recently Google App Engine's team announced some big changes in their pricing.

There has been a lot of bad buzz on the newsgroup, on guy even said : Googlebot is your Enemy. Well yes, while Google is crawling your content you have to pay for servers and bandwidth but at the same time blocking Googlebot would destroy your SEO.

The fact that Google App Engine users can't manage their crawl rate in Google Webmaster Tools is wrong, and I don't really understand why they want it this way.

I wanted to see what happen if I use a round robin proxy on top of my GAE application and the result was very impressive :

Basicaly, Cloudflare was activated from June to August, then I disabled it and reactivated it in September. As you can see on the graphic, my crawl rate is way better when my app is served by a proxy.

I'm not a SEO expert, but one thing I know for sure is that when I have a high crawl rate my indexing is increasing. What's going on is not very clear to me, but it looks like GAE applications are disadvantaged.

}

Playframework : Import you GAE Datastore and use it in local

Fri Aug 05 00:00:00 UTC 2011

This small guide tells you how to download your data from your Google App Engine application and use it in your local.
For now, I have only tested those steps on Mac OSX.

First, you will need to enable the remote_api if it's not already done.
By default, Play-gae doesn't use any web.xml file so you are going to need to create one in the /war/WEB-INF folder.

This is my web.xml file feel free to copy it :

For some reasons I can't really explain, you will need to disable Federated Login in your App Engine's Application Settings.

The next step is to install Google App Engine's Python SDK in order to be able to use the remote api and download all your data.

Once you have installed it you will be able to download it using the following command :

appcfg.py download_data --application=my-app --url=http://my-app.appspot.com/remote_api --filename=data.csv

Then you need to package your application into a WAR archive :

play war -o ../package.war

It's now time to start your application in local !:

dev_appserver.sh package.war

Once your app is started just open a browser and go to the following url, you will be asked to setup a remote_api user :

http://localhost:8080/remote_api

Then you can upload your data to the local server :

appcfg.py upload_data --url=http://localhost:8080/remote_api --filename=data.csv

If you are on OSX you will need to be running Charles Web Debbugging Proxy to get it working ... yeah, I have no clue why it works only when Charles is running.

}

Javascript deobfuscator

Sun Jul 24 00:00:00 UTC 2011

I recently found a service that can be used to deobfuscate code, you can check it out on http://jsbeautifier.org. Its source is also available on Github.}

My Review of Cloudflare

Thu Jul 21 00:00:00 UTC 2011

I recently started using Cloudfare on some of my websites, and here is my review of this service.
At first sight it looks like a very attractive Round-robin proxy that can be used as a CDN for cheap. I thought that would be a great way to reduce my usage on Google App Engine.
A free plan with unlimited bandwidth ... well that sounds good ! Almost every CDNs are priced on usage so I'm not sure how they are planning to keep a good quality of service but for now it's fine but if they can save me some money in bandwidth I'm okay with that.
The good thing about Cloudflare is that you don't have to worry about any technical implementation, image upload, cache invalidation or whatever: It's really easy to setup, you just need update your domain's DNS. And to be honest that takes less than 5 minutes.
So that's good, plus they have quite a lot of nice things like css/js/html minifiers or hotlink protection preventing other websites to use your images.
Now let's talk about the bad things ! One of the main feature of Cloudflare is to offer a captcha protection and challenge threatening visitors, well that sounds good too until it starts bothering you all the time as if you are a security threat. I basically turned this thing off.
I also tried their SSL service which looks awesome : the service is supposed to activate HTTPS on your domain with zero conf. Well that's great but does it work?
It took me a week to get their validation (2 business days were announced). Well that would be okay if the damn thing worked in the end but no all I got was "Cloudflare error" and nothing else.

I'm aware that it could be coming from my server configuration and that's not necessarily cloudflare's fault but "Cloudflare error" doesn't mean anything to me. Cloudflare would be much better if it wasn't a blackbox.

Conclusion: I'll keep using Cloudflare on my main domain for now but I'm a bit skeptical about the quality of this service, the idea and the pricing are great but it's a bit obscure. It would be great to have access and error logs for now It's just too much marketing.

}

How to replace a word in multiple files / subdirectories

Fri Jun 24 00:00:00 UTC 2011


find . -name "*.php" -print | xargs sed -i 's/OldWord/NewWord/g'

}

Github : Keep your fork up to date

Mon Jun 20 00:00:00 UTC 2011

If github keep asking for your login and password even if you have copied your ssh public key, this is what you should do !

Check your .git/config file :

 	[core] 	repositoryformatversion = 0 	filemode = true 	bare = false 	logallrefupdates = true 	ignorecase = true 	[remote "origin"] 	fetch = +refs/heads/*:refs/remotes/origin/* 	url = https://github.com/login/project.git 	[branch "master"] 	remote = origin 	merge = refs/heads/master

If the remote origin's url is formated this way : https://github.com/user/project.git your should replace it with git@github.com:user/project.git

}

How to delete a remote branch with Git

Tue Jun 14 00:00:00 UTC 2011


git push origin :nameOfTheBranch

}

How to remove folders from Git History

Wed Jun 08 00:00:00 UTC 2011


git filter-branch --index-filter "git rm -rf --cached --ignore-unmatch ./heavy/folder"

}

IRCCloud Invites

Tue Jun 07 00:00:00 UTC 2011

I have three IRCCloud invites, send me your email or ask me via @D_Roch if you want one.

}

GAE Blob binding with Siena/Crudsiena 2.0.0

Tue Jun 07 00:00:00 UTC 2011

In order to use a GAE Blob binding with Siena/Crudsiena 2.0.0, you need to add a new model to your application:

And this is how you can use it in your entities:


@Column("picture")
@As(binder=models.GaeBlobBinder.class)
public Blob picture;

}

Le Pandaranol

Mon Jun 06 00:00:00 UTC 2011

Le Pandaranol n'est pas une espece de panda, c'est un concours SEO.

}

How to use GAE AppStats with Playframework

Mon Jun 06 00:00:00 UTC 2011

Use the war command to generate a web.xml file.

play war -o ./tmpfolder/

Move it to your war folder

mv ./tmpfolder/WEB-INF/web.xml ./war/WEB-INF/web.xml

Remove the tmp folder

rm -r ./tmpfolder/

Activate AppStats and add the routes to the web.xml file (before )

}

How to merge two git repositories

Tue May 31 00:00:00 UTC 2011


git remote add branchB git@github.com:user/repo.git
git pull branchB
git pull branchB master

}

How to generate a random string in MySQL

Mon May 30 00:00:00 UTC 2011


SELECT SUBSTRING(MD5(RAND()) FROM 1 FOR 6)

}

How to bind JQuery load events on href links

Thu May 26 00:00:00 UTC 2011


$(document).ready(function() {
    $('.insite').live("click", function(ev) {
    var href = $(this).attr('href');
        if ( history.pushState ) history.pushState( {}, document.title, href);
        ev.preventDefault();
        $('#content').fadeOut().load(href+' #content', function() {
                $(this).fadeIn();
                _gaq.push(['_trackPageview', href ]);
		//window.disqus_no_style = true;
		//$.getScript("http://disqus.com/forums/mnml/embed.js")
            });
    });
});

}

How to remove conflicted files from Dropbox

Thu May 26 00:00:00 UTC 2011


find . -type f -name "* conflicted *" -exec rm -f {} \;

}

Return a HTTP Response code

Wed May 11 00:00:00 UTC 2011

wget --delete-after site.com 2>&1|egrep "HTTP|Length|saved" | head -1 | sed s/"HTTP request sent, awaiting response... "//

}

How to word count a MySQL column

Tue Apr 12 00:00:00 UTC 2011


SELECT SUM( LENGTH(name) - LENGTH(REPLACE(name, ' ', ''))+1) FROM table

}

How to fetch url parameters using Javascript

Fri Mar 18 16:45:21 UTC 2011


"getParameter": function(name) {
    name = name.replace(/[\[]/,"\\\[").replace(/[\]]/,"\\\]");
    var regexS = "[\\?&]"+name+"=([^&#]*)";
    var regex = new RegExp( regexS );
    var results = regex.exec( window.location.href );
    if( results == null )
      return "";
    else
      return results[1];
 }

}

How to mirror your website on Amazon S3

Fri Mar 11 00:00:00 UTC 2011

First, you need to fetch your website using wget:

wget -r -k -E -p -U Mozilla http://www.usineadesign.com -c --force-html 2>&1 | egrep -o "(http|https):.*"

Then we upload it all to amazon s3:

php5 import.php

 include_once('./s3.php'); try {   //AWS access info   if (!defined('awsAccessKey'))     define('awsAccessKey', 'MYACCESSKEY');   if (!defined('awsSecretKey'))     define('awsSecretKey', 'MYSECRETKEY');    function listFolder($folder = ".") { // Fonction qui liste un dossier de façon récursive     $s3 = new S3(awsAccessKey, awsSecretKey);     if (is_dir($folder)) {       if ($folderOpen = opendir($folder)) {         while (($file = readdir($folderOpen)) !== false) {           if ($file == ".." || $file == "." || $file == "index.php") {             continue;           } else {             if (is_dir("$folder/$file"))               listeDossier("$folder/$file");             else               $paths[] = "$folder/$file";           }         }       }     }     foreach ($paths as $path) {       $chemin = explode('/', $path, 2);       $s3->putObject($s3->inputResource(fopen('domain.com/' . $chemin[1], 'r'), filesize('domain.com/' . $chemin[1])), 'subdomain.domain.com', $chemin[1], S3::ACL_PUBLIC_READ, null, array('Content-Type' => 'text/html'));     }   }      listFolder('domain.com');    } catch (Exception $e) {}

The s3 php class can be found on this website

}

GIT: How to create a new remote branch

Tue Mar 22 12:32:31 UTC 2011

1. Create the remote branch


git push origin origin:refs/heads/new_feature_name

2. Make sure everything is up-to-date


git fetch origin

3. Then you can see that the branch is created.


git branch -r

This should show ‘origin/new_feature_name’ 4. Start tracking the new branch


git checkout –track -b new_feature_name origin/new_feature_name

}

How to sync installed packages between computers

Tue Feb 22 00:00:00 UTC 2011

dpkg --get-selections > installed-software dpkg --set-selections < installed-software dselect

}

How to check Ati Radeon temperature & change fan speed & check GPU load on Linux