ForeverYoung's blog

Speeding up films and podcasts, improved

2013-07-24T21:44:19Z

Improved version of speedup script.

Fancy coloring, progress in percents, command line options, default speedup rate is taken from a file "SPEEDUP", handling Ctrl-C.

mp3-acceleration script:

#!/bin/bash
dir=`dirname $(realpath $0)`
DEFAULT_SPEEDUP=`cat $dir/SPEEDUP 2> /dev/null`
DEFAULT_SPEEDUP=${DEFAULT_SPEEDUP:-+45}

speedup=${1:-${DEFAULT_SPEEDUP}}
echo "Using tempo change ${speedup}%"
mkdir /tmp/result 2>/dev/null

trap interrupt INT

function interrupt() {
    echo -e "\nDeleting unfinished $name"
    rm "result/$name" 2> /dev/null
    exit 1
}

count=`ls original/*.mp3 2>/dev/null | wc -l`
if [ ! $count -gt 0 ]; then
    echo "No input files"
    exit 0
fi

i=1
for f in original/*.mp3; do
    name=`basename "$f"`
    if [ ! -f "result/$name" ]; then
        printf "\E[32m%3.0f%%\E[0m Processing %s" "$(($i*100/$count))." "$name"
        lame --quiet --decode "$f" - | soundstretch stdin stdout -tempo=$speedup -speech 2>/dev/null | lame --quiet -m a -cbr -b 64 --resample 24  - "result/$name"
        echo -e "\E[32m Done\E[0m"
    else
        printf "\E[32m%3.0f%%\E[0m Skipping %s\n" "$(($i*100/$count))" "$name"
    fi
    i=$((i+1))
done

mp4-sound-extraction and acceleration script:

#!/bin/bash
dir=`dirname $(realpath $0)`
DEFAULT_SPEEDUP=`cat $dir/SPEEDUP 2> /dev/null`
DEFAULT_SPEEDUP=${DEFAULT_SPEEDUP:-+45}

DEFAULT_SOURCE=original

trap interrupt INT

function interrupt() {
    echo -e "\nDeleting unfinished $name.mp3"
    rm "result/$name.mp3" 2> /dev/null
    rm /tmp/temp.wav 2> /dev/null
    rm /tmp/temp.mp4a 2> /dev/null
    exit 1
}

original=$1
if [ ! -d "$original" ]; then
    speedup=${original:-${DEFAULT_SPEEDUP}}
    original=${2:-$DEFAULT_SOURCE}
else
    speedup=${2:-${DEFAULT_SPEEDUP}}
fi

if [ "$speedup" == "0" ]; then
    echo "Only extracting"
else
    echo "Using tempo change ${speedup}%"
fi
echo "Using source directory ${original}"

mkdir /tmp/result 2>/dev/null

count=`ls $original/*.mp4 2>/dev/null | wc -l`
if [ ! $count -gt 0 ]; then
    echo "No input files"
    exit 0
fi

i=1
for f in $original/*.mp4; do
    name=`basename "$f" .mp4`
    if [ ! -f "result/$name.mp3" ]; then
        printf "\E[32m%3.0f%%\E[0m Processing %s. \E[32mExtracting...\E[0m" "$(($i*100/$count))" "$name.mp4"
        mplayer "$f" -dumpaudio -dumpfile /tmp/temp.mp4a > /dev/null 2>&1
        faad /tmp/temp.mp4a > /dev/null 2>&1
        if [ "$speedup" == "0" ]; then
            lame --quiet -m a -cbr -b 64 --resample 24 /tmp/temp.wav "result/${name}.mp3"
            echo -e "\b\b\b\b\b\b\b\b\b\b\b\b\bExtracting. \E[32mDone\E[0m"
        else
            echo -en "\b\b\b\b\b\b\b\b\b\b\b\b\bExtracting. \E[32mSpeeding up...\E[0m"
            soundstretch /tmp/temp.wav stdout -tempo=$speedup -speech 2>/dev/null | lame --quiet -m a -cbr -b 64 --resample 24  - "result/${name}.mp3"
            echo -e "\b\b\b\b\b\b\b\b\b\b\b\b\b\bSpeeding up. \E[32mDone\E[0m"
        fi
        rm /tmp/temp.wav 2> /dev/null
        rm /tmp/temp.mp4a 2> /dev/null
    else
        printf "\E[32m%3.0f%%\E[0m Skipping %s\n" "$(($i*100/$count))" "$name.mp4"
    fi
    i=$((i+1))
done

Copy podcasts back after speeding up

2013-07-08T06:10:31Z

Script for moving processed podcasts back to player:

#!/bin/bash
for f in result/*; do
    base=`basename "$f"`
    if [ -L "original/$base" ]; then
        orig=`readlink -f "original/$base"`
        echo "Moving $base"
        mv "$f" "$orig"
        rm "original/$base"
    else
        echo -e "\E[33mSkipping $base, no original file or not a symlink\E[0m"
    fi
done

UPD: Added checking for existance of original file and it's a symlink. Added progress display.

Speeding up films and podcasts (Linux)

2013-06-14T21:22:42Z

Here is version of my speedup script for linux:

mp3-acceleration script:

mkdir /tmp/result
for f in original/*.mp3; do
    name=`basename "$f"`
    lame --quiet --decode "$f" - | soundstretch stdin stdout -tempo=+45 -speech | lame --quiet -m a -cbr -b 64 --resample 24  - "result/$name"
done

mp4-sound-extraction and acceleration script:

mkdir /tmp/result
for f in original_flash/*.mp4; do
    name=`basename "$f" .mp4`
    mplayer "$f" -dumpaudio -dumpfile /tmp/temp.mp4a
    faad /tmp/temp.mp4a
    soundstretch /tmp/temp.wav stdout -tempo=+45 -speech | lame --quiet -m a -cbr -b 64 --resample 24  - "result/${name}.mp3"
    rm /tmp/temp.wav
    rm /tmp/temp.mp4a
done

For SSD life prolongation, I use /tmp in-memory disk for temporary and result files. I place softlinks to original mp3 files into 'original' directory, and 'original_flash' is a link to the usual place of mp4 files.

Useful cli remote control for N900 KMplayer

2012-09-18T18:04:12Z

Works only if you use mplayer backend.

On N900 create script /home/user/.bin/mplayer-control.sh:

#!/bin/bash
if [ "`pidof kmplayer`" == "" ]; then
    exit
fi

out=/proc/`pidof mplayer`/fd/0

echo "Choose:
  p or space or enter: toggle play/pause
  <: seek backward 5 seconds
  >: seek forward 5 seconds
  [: seek backward 30 seconds
  ]: seek forward 30 seconds
  {: seek backward 5 minutes
  }: seek forward 5 minutes
  9: volume down
  0: volume up
  o: toggle osd mode
  v: toggle subtitle visibility
  q: quit this program"
while true; do
    read -n 1 -s  ans
    case $ans in
        "" ) echo "pause" > $out ;;
        " " ) echo "pause" > $out ;;
        "p" ) echo "pause" > $out ;;
        "<" ) echo "seek -5" > $out ;;
        ">" ) echo "seek +5" > $out ;;
        "[" ) echo "seek -30" > $out ;;
        "]" ) echo "seek +30" > $out ;;
        "{" ) echo "seek -300" > $out ;;
        "}" ) echo "seek +300" > $out ;;
        "9" ) echo "volume -1" > $out ;;
        "0" ) echo "volume +2" > $out ;;
        "o" ) echo "osd" > $out ;;
        "v" ) echo "sub_visibility" > $out ;;
        "q" ) exit ;;
    esac
done

On desktop add to .bashrc:

alias mplco="ssh n900 /home/user/.bin/mplayer-control.sh"

Moving to Nginx and Gunicorn

2012-02-15T06:18:37Z

Selectel resumed cloud server service selectel, so I decided to create new server in new server pool and also move from lighttpd to nginx.

Server is running on Debian Squeeze Mini.

Installation

Nginx is installed from squeeze-backports repository.

From root:

echo "# squeeze-backports" >> /etc/apt/sources.list
echo "deb http://backports.debian.org/debian-backports squeeze-backports main" >> /etc/apt/sources.list
apt-get update
apt-get -t squeeze-backports install nginx

For controlling server processes install supervisord:

apt-get install supervisor

Install virtualenv and mercurial:

apt-get install virtualenv
apt-get install mercurial

Creating user and setting up virtualenv

useradd -m -s /bin/bash blog
su blog

From blog user:

cd ~
virtualenv env
cd env
. bin/activate

Under env:

easy_install pip
pip install gunicorn

Install blohg

I use customized version, so I get it from my repository (under env):

cd ~
hg clone https://bitbucket.org/ForeverYoung/blohg
cd blohg
python setup.py install

If there is an error while installing, install gcc and python-dev (under root):

apt-get install gcc
apt-get install python-dev

For stock version (under env):

pip install blohg

Configuring gunicorn

Create blog_app.py in ~blog:

#!/usr/bin/python
from blohg import create_app

app = create_app("/home/blog/blog")

Clone your blog to server (as here):

hg clone my_blohg ssh://blog@yourdomain.tld/home/blog/blog/

Create gunicorn.conf.py in ~blog:

import multiprocessing

workers = multiprocessing.cpu_count() * 2 + 1

bind = "unix:/home/blog/blog.socket"
pidfile = "/home/blog/blog.pid"
logfile = "/home/blog/logs/gunicorn.log"
loglevel = "info"
proc_name = "blog"
user = "www-data"
group = "www-data"

Configuring supervisor

Create /etc/supervisor/conf.d/blog.conf:

[program:blog]
command = /home/blog/env/bin/gunicorn blog_app:app -c /home/blog/gunicorn.conf.py
directory = /home/blog/
autostart = true
autorestart = true
redirect_stderr = true
daemon = false
debug = false
logfile = /home/blog/logs/supervisor.log
loglevel = "info"
user = "www-data"

Start supervisor:

/etc/init.d/supervisor start

Configuring nginx

Create /etc/nginx/sites-available/blog:

server {
        listen 80;

        server_name yourdomain.tld;
        access_log /home/blog/logs/nginx_access.log;
        error_log /home/blog/logs/nginx_error.log;

        location / {
            proxy_pass http://unix:/home/blog/blog.socket;
            include proxy_params;
        }
}

Create link in sites-enabled:

cd /etc/nginx/sites-enabled
ln -s ../sites-available/blog blog

Start nginx:

/etc/init.d/nginx start

That's all!

Link shortening on hotkey

2011-08-12T10:45:00Z

Install keyboard-shortcuts. Also install CSSU, so as to get keyboard-shortcuts work.

Tune /apps/osso/hildon-desktop/key-actions/dbus_shortcuts_use_fn to press Ctrl-Fn-<letter> instead of Ctrl-Shift-<letter> (if you prefer).

/home/user/.bin/clck.py:

#!/usr/bin/python
import os
import pygtk
pygtk.require('2.0')
import gtk

clipboard = gtk.clipboard_get()
text = clipboard.wait_for_text()

import urllib2
fetcher = urllib2.urlopen('http://clck.ru/--?url=' + text)
text = fetcher.read()

os.system("phone-control --notify 'Link is shortened'")

clipboard.set_text(text)
clipboard.store()

Edit /usr/bin/keyboard-shortcuts:

if key == 'c': # or another letter
    os.system("su user -c 'run-standalone.sh /home/user/.bin/clck.py'")

Out-call-vibro variant, using dbus-scripts

2011-08-12T10:25:10Z

After installing enhanced-busybox, out-call-vibro refused to work. I had rewritten it using dbus-scripts.

/etc/dbus-scripts.d/out-call-vibro.dbus:

/home/user/.bin/out-call-vibro.sh * * org.freedesktop.Telepathy.Channel.Interface.Group MembersChanged *

/home/user/.bin/out-call-vibro.sh:

#!/bin/sh
if [[ "$5" == "Call answered" ]]; then
    if [ `cat /sys/devices/platform/gpio-switch/proximity/state` = "open" ]; then
        echo 150 > /sys/class/leds/twl4030:vibrator/brightness
        gsleep 0.5
        echo 0 > /sys/class/leds/twl4030:vibrator/brightness
    fi
fi

Sending SMS from server

2011-08-07T12:59:24Z

Several days ago I looked into details of how my selectel server spended money and saw that it spends about 20 roubles per day (about $0.8) and has 100% CPU load for about 2 last days. I connected to it and saw that some 'sh' proccess is hang. I just killed it.

So as to react in time to such cases I decided to set up an SMS notification.

I registered on SMSC.RU. One SMS costs 0.50 roubles (about $0.02).

I wrote small script that is watching average load and will notify if it becomes too high.

from urllib import urlopen, urlencode
import re

def send_sms(load):
    data = {
        "login": "<login>",
        "psw": "<password>",
        "phones": "<phone-number>",
        "mes": (u"Server is overloaded %.2f %.2f %.2f" % tuple(loadavg))
    }

    urlopen("http://smsc.ru/sys/send.php", urlencode(data))

f = open("/proc/loadavg", "r")
line = f.readline()
f.close()
m = re.search("^(\d+[.]\d+) (\d+[.]\d+) (\d+[.]\d+)", line)
loadavg = [float(x) for x in m.groups()]
if loadavg[2] > 0.7:
    send_sms(loadavg)

Hosting moved to selectel cloud

2011-07-19T09:24:28Z

As my server is gone down suddenly and I don't have a chance to find out what is with it, I decided to move my blog to cloud platform.

I chose Selectel as hosting provider. Prices start from 50 roubles (about $1.85), this is only for keeping virtual machine for month, without running it. For my blog traffic (almost 0 :) ) overall price will be about 70 roubles (about $2.60) per month, it's very cheap I think.

UPD: After month usage, actual price is about 44 roubles (about $1.57).

Unlocked volume buttons while screen is locked

2011-07-18T12:30:01Z

To unlock volume buttons while the screen is locked, edit /etc/mce/mce.ini, so as parameter DisableKPImmediately in section [TKLock] equals 2.

# Policy for keypad interrupts
#
# 2 - leave keypad interrupts on even after blanking
#     (used to support pass-through of +/-)
# 1 - disable interrupts immediately
# 0 to wait until display is blanked
DisableKPImmediately=2