My Blog

Best AdMob alternatives

2015-03-09T04:30:00.000-07:00

MoPub
Axonix (requires Google Play Services)
MobFox (requires Google Play Services, but has custom API)
InMobi (requires Google Play Services)
LeadBolt (only full screen ads)
MMedia (requires Google Play Services)

(pickup which one is lesser evil)

Show longest continuous block of code not covered by tests

2014-10-26T08:04:00.001-07:00

Usage: nocov.py

import fileinput
count = 0
lengths = {}
first = 0
for line in fileinput.input():
    if first and ('stm mis' in line or 'pln' in line):
        lengths[first] += 1
    else:
        t = line.split("id='t")
        if len(t) < 2:
            continue
        first = t[-1].split("'")[0]
        lengths[first] = 1

for x in sorted(lengths.items(), key=lambda (x, y): y):
    print x

Profiling C++ scopes

2014-10-26T08:02:00.000-07:00

The following simple class measure time spent in scope it is declared in:

class profile {
    // usage: profile __profile(__FILE__, __LINE__);
    static map < pair, clock_t> __total;
    string _file;
    unsigned _line;
    clock_t _start;
public:
    profile(const char* file, unsigned line) :
        _file(file), _line(line), _start(clock()) {
    }
    ~profile() {
        clock_t d = clock() - _start;
        clock_t t = __total[make_pair(_file, _line)] += d;
        OutputDebugStringA(((string)_file + ':' + to_string(_line) + "+=" + to_string(d) + " = " + to_string(t) + '\n').c_str());
    }
};
map < pair, clock_t> profile::__total;

Example:

void foo() {
profile __profile(__FILE__, __LINE__); // measure time in foo
// other code
while (something) {
profile __profile(__FILE__, __LINE__); // measure time in while loop
}
}

VPS hosting shortlist

2014-09-24T23:31:00.002-07:00

Linux:
https://ititch.com/
http://www.web-hosting.com/
https://www.ovh.com/
Windows:
http://alt-hosting.com/

Why I hate fxsol.co.uk?

2014-05-30T00:47:00.000-07:00

Short answer: you can not get your money back. Once you send it to FX Solutions consider them lost. They will find 1000 reasons but will not process your withdrawal request.
Long answer: just look at this:

Case #1

I have request to withdraw to another bank since my previous bank shut down:

Date: Mon, 31 Mar 2014 16:03:41 +0100
From: funding@fxsol.co.uk
To: <yurii....@gmail.com>

Dear Mr Z. MT650629 

Thank you for your recent withdrawal request. Unfortunately, we are unable to process your request as we are required to return the funds to the source bank account ending 3840 at Loyal Bank. 

Please reply to our email confirming the following information: 

ABA/SWIFT/BSB/BIC/IBAN/Sort Code - Please select as appropriate  

Bank Name 

Bank Address 

Beneficiary Name 

Bank Account Number 

Sort Code if applicable                                 
If you require any further assistance please contact us during opening hours on the contact details below.

Regards, 
Pedro Bennasar

Date: Tue, 1 Apr 2014 06:41:04 +0100
From: funding@fxsol.co.uk
To: <yurii....@gmail.com>

Dear customer, 
  
If this account ending 3840 is closed, you will need to provide a close proof so that we can return the fund to your other bank account. Thanks. 
  
 
Regards, 
Jiachen Shen

Date: Tue, 1 Apr 2014 07:15:59 +0100
From: funding@fxsol.co.uk
To: <yurii....@gmail.com>

Dear customer, 

If bank does not accept USD wire, does it mean that they will convert the USD into other currency when they receive the fund? Please confirm with your bank. Thanks. 

Regards, 
Jiachen Shen

Date: Tue, 1 Apr 2014 13:28:59 +0700
From: "Yurii Z." <yurii....@gmail.com>
To: funding@fxsol.co.uk

No they do not accept incoming wire transfers at all since December 2013.
All incoming transfers will be put on hold or reversed.
PLEASE DO NOT SEND MONEY TO LOYALBANK! IT WILL BE LOST!

Please send to local bank account I've provided. See attachment for the
proof I'm owner of this account as well.

Date: Tue, 1 Apr 2014 10:55:14 +0100
From: funding@fxsol.co.uk
To: <yurii....@gmail.com>

Dear Mr Z. MT 650629 

We are in receipt of your withdraw request, however to be in compliance with our Anti Money Laundering  policy, we must send funds back to your original bank account with which you funded your account.  

Please provide the swift code, bank name, address and account number for the account ending in 3840 in order for us to proceed with your request.  

If your bank is not accepting incoming wires please provide us a confirmation on a headed paper from your bank, we are not allowed to call your bank due to the  Data Protection Act to check this. 

If we send the funds to Loyal Bank and they return it to us then we can check for alternative options. 

We look forward to hearing from you soon. 

Regards, 
Katya de Rios

Date: Tue, 1 Apr 2014 17:20:09 +0700
From: "Yurii Z." <yurii....@gmail.com>
To: funding@fxsol.co.uk

If I add funds to account using another bank can I use it for
withdrawals after this?

Date: Tue, 1 Apr 2014 11:42:23 +0100
From: funding@fxsol.co.uk
To: <yurii....@gmail.com>

Dear Mr Z. MT 650629 

Could you please get a confirmation from your bank that they can not accept incoming wires so we see an alternative solution for you. 

If you deposit new funds we will only return this funds to the new bank account that you will use. 

Thank you. 

Regards, 
Katya de Rios

Date: Wed, 2 Apr 2014 10:57:59 +0700
From: "Yurii Z." <yurii....@gmail.com>
To: funding@fxsol.co.uk

That is ok I want to use this account in future. I've sent funds. Details:

Dear Valued Customer

International Fund Transfer Transaction

Instruction Date : 02/04/2014 09:55
Transfer Date : 02/04/2014
Reference No : 14464
Payer A/C Name : IURII Z. , A/C No.: XXXXXXXXXX
Payee A/C Name : CITY INDEX LIMITED TRADING , A/C No.: GB47CHAS60924241408410
Address : PARK HOUSE, 16 FINSBURY CIRCUS
    LONDON EC2M 7EB
    UNITED KINGDOM
Receiver Bank : JPMORGAN CHASE BANK, N.A. , Branch :
Bank Code : CHASGB2L
Transfer Amount : USD 50.00
Exchange Rate : 32.4900000
Deduct Amount : THB 1,624.50
Fee : THB 1,100.00
Short Note : -
Remark : Your transaction may be declined due to a problem of the
destination bank.
    Please check your statement
Remittance Information : AC NO 650629 - - -

Date: Wed, 2 Apr 2014 08:03:28 +0100
From: funding@fxsol.co.uk
To: <yurii....@gmail.com>

Dear Sir, 

Per previously advised, funds will need to be withdrawn back to the source bank account. 
As you have advised that Loyal Bank no longer accepts incoming USD, and your account is still open with Loyal Bank. We will require you to provide confirmation from Loyal Bank that they are no longer able to accept USD into your bank account with them. 

Please advise so that we may proceed further. 

Regards, 
Anthony Chia

Date: Wed, 2 Apr 2014 15:44:16 +0100
From: funding@fxsol.co.uk
To: <yurii....@gmail.com>

Dear Mr Z. MT651310 

Kindly be informed that your $50 wire transfer has been now returned back to the remitter bank account since funds were originated from a different Country where you reside. Please note that in order to comply with our AML policy, funds must come from your Country of Residence. 

If you require any further assistance please contact us during opening hours on the contact details below.

Regards, 
Pedro Bennasar

Date: Thu, 3 Apr 2014 14:00:25 +0700
From: "Yurii Z." <yurii....@gmail.com>
To: funding@fxsol.co.uk

Then please send 1 USD to LoyalBank to verify it will not be processed.

Beneficiary:
Name: Z. Iurii
Address: XXX
Account number: XXXXXXXXX

Beneficiary Bank:
Name: Loyal Bank Limited
Address: Cedar Hill Crest, Villa, VC0100, Kingstown, St. Vincent and
the Grenadines, West Indies
SWIFT code: LOYAVCVX

This situation is an absurd. I'm very disappointed by your withdrawal service...

Date: Thu, 3 Apr 2014 14:08:44 +0700
From: "Yurii Z." <yurii....@gmail.com>
To: funding@fxsol.co.uk

Attached the proof my Country of Residence is Thailand.

Date: Thu, 3 Apr 2014 08:09:26 +0100
From: funding@fxsol.co.uk
To: <yurii....@gmail.com>

Dear customer, 
  
We cannot process 1 USD withdraw to LoyalBank. You will need to get the bank provide proof that they cannot accept USD wire. Thanks. 
  
 
Regards, 
Jiachen Shen

Date: Thu, 3 Apr 2014 14:18:14 +0700
From: "Yurii Z." <yurii....@gmail.com>
To: funding@fxsol.co.uk

Are you kidding me?! In the email before you said you can process
withdrawals to LoyalBank only. Now you say you will not send my money
anywhere.
I can not provide the proof they do not accept anything. Their customer
support is not answering. They do not reply by email and by phone they
promised they will send it but didn't send anything.

...more than one month has passed and I still haven't returned my money.

Case #2

Another attempt to withdraw my money:

Date: Thu, 15 May 2014 19:20:34 +0700
From: "Yurii Z." <yurii....@gmail.com>
To: funding@fxsol.co.uk

Hello,

Please send another withdrawal of $400 using same instructions to same bank
account.

Date: Thu, 15 May 2014 14:04:25 +0100
From: funding@fxsol.co.uk
To: <yurii....@gmail.com>

Dear Mr Z.,  MT650629 

We have noticed that your form states a different address to the one we have on file. 
Kindly complete and submit the attached form if you have changed your Country of Residence. 
Your withdrawal request will be processed upon receipt of your confirmation. 

Regards, 
Pedro Bennasar

Date: Fri, 16 May 2014 06:41:31 +0700
From: "Yurii Z." <yurii....@gmail.com>
To: funding@fxsol.co.uk

I see no attachment.

Date: Fri, 16 May 2014 00:53:54 +0100
From: funding@fxsol.co.uk
To: <yurii....@gmail.com>

Dear Client MT650629, 
  
Please see attached to update your contact information. 
Thank you. 
  
 
Regards, 
Siyuan Chang

Date: Sat, 17 May 2014 18:49:40 +0700
From: "Yurii Z." <yurii....@gmail.com>
To: funding@fxsol.co.uk

Please see attachments.

Date: Mon, 19 May 2014 10:26:38 +0100
From: "FX Solutions" <accounts@fxsol.co.uk>
To: <yurii....@gmail.com>

Dear Iurii Z. 

Thank you very much for your email. 

Unfortunately, we are unable to update your address because the proof of address document you sent to us is not in English. 

Please re-send us one of the below documents in English. If the document is not in English, please have the document be translated in to English or verified by a certified accountant, lawyer or a notary public. 

1. copy of credit card statement dated within the last three months 
2. copy of bank statement dated within the last three months 
3. copy of utility bill dated within the last three months 

Kindly take note that e-statement and mobile bill are not accepted. 

We will update your record as soon as receipt of the above document. 

Feel free to let us know if you have any enquiry. 

Regards, 
Mei-Ling Chan

Date: Tue, 20 May 2014 16:52:42 +0700
From: "Yurii Z." <yurii....@gmail.com>
To: FX Solutions <accounts@fxsol.co.uk>

Please see attachment for bank statement dated today. Address in top left
corner.

https://maps.google.ru/maps?f=q&source=s_q&hl=en&geocode=+&q=ao+nang&ie=UTF8&hq=&hnear=Ao+Nang,+Mueang+Krabi+District,+Krabi,+Thailand&t=m&z=12&vpsrc=0&iwloc=A

https://maps.google.ru/maps?f=q&source=s_q&hl=th&geocode=+&q=ao+nang&ie=UTF8&hq=&hnear=Ao+Nang,+Mueang+Krabi+District,+Krabi,+Thailand&t=m&z=12&vpsrc=0&iwloc=A

Date: Wed, 21 May 2014 09:37:18 +0100
From: "FX Solutions" <accounts@fxsol.co.uk>
To: <yurii....@gmail.com>

Dear Iurii Z. 

As mentioned in my previous email, we are unable to verify documents which is not in English. Please have the document be translated in to English or verified by a certified accountant, lawyer or a notary public. 

Or you can request your bank to issue a letter to you which states your name, address and the account your are maintaining with the bank. 

Feel free to let us know if you have any enquiry. 

Regards, 
Mei-Ling Chan

Date: Thu, 22 May 2014 14:29:37 +0700
From: "Yurii Z." <yurii....@gmail.com>
To: FX Solutions <accounts@fxsol.co.uk>

OK. Certified translation costs $30-50 per page. If you credit it to my
account I will send you certified translation.

Date: Thu, 22 May 2014 09:42:00 +0100
From: "FX Solutions" <accounts@fxsol.co.uk>
To: <yurii....@gmail.com>

Dear Iurii Z. 

I am afraid this translation cost shall be beared by client. 

As mentioned, you can request a letter in English from your bank stating your name, address and account number maintaining with the bank. We can accept this letter as the proof of address.   

Regards, 
Mei-Ling Chan

Oh, I have to pay $50 for some papers just because FX Solutions UK decided they need it and I have to pay for it. Great.
So I strongly discourage anybody from putting their money to FX Solutions UK. If you want a good broker try Alpari or Pepperstone. They process withdrawals in 48 hours with no bureaucracy.

Python cache dictionary

2014-04-09T04:14:00.000-07:00

class cachedict(dict):
    def __init__(self, factory):
        self.factory = factory

    def __missing__(self, key):
        value = self[key] = self.factory(key)
        return value

USAGE:

d = cachedict(lambda x: x ** 2)
print d[2]  # 4

Best AdSense Alternatives

2013-06-01T22:59:00.003-07:00

Motorola Milestone 2 Firmware links

2013-06-01T03:51:00.003-07:00

GMail cleanup

2013-05-31T23:31:00.000-07:00

This Python script cleans All Mail GMail folder by moving emails to Trash if there are more than 33 emails from same sender or email is more than 55 days old (values can be adjusted by editing code). IMAP must be enabled in order to work.

#!/usr/bin/env python
from datetime import datetime, timedelta
from email.utils import parsedate, parseaddr
import imaplib
import re
import socket

socket.setdefaulttimeout(30)

IMAP_SERVER = 'imap.gmail.com'
IMAP_PORT = 993


def main():
    clean('email1@gmail.com', 'password1')
    clean('email2@gmail.com', 'password2')


def clean(user, pwd):
    mbox = imaplib.IMAP4_SSL(IMAP_SERVER, IMAP_PORT)
    rc, resp = mbox.login(user, pwd)
    print rc, resp
    r, data = mbox.select("[Gmail]/All Mail")
    assert r == 'OK'
    r, data = mbox.expunge()
    assert r == 'OK'
    r, (ids,) = mbox.search(None, 'ALL')
    assert r == 'OK'
    r, data = mbox.fetch(
        '1:*',
        '(INTERNALDATE FLAGS BODY.PEEK[HEADER.FIELDS (FROM)])')
    assert r == 'OK'
    threads = {}
    for row in data:
        if row == ')':
            continue
        uid_date, subject = row
        m = re.compile(
            r'(\d+) \(INTERNALDATE "(.*)" FLAGS \((.*)\) '
            'BODY\[HEADER\.FIELDS\ \(FROM\)\]\ \{\d+\}').match(uid_date)
        assert m, uid_date
        uid, date, flags = m.groups()
        if '\\Flagged' in flags:
            continue
        date = parsedate(date)
        uid = int(uid)
        _, frm = parseaddr(subject)
        threads.setdefault(frm, []).append((date, uid))
    uids = []
    for key, lst in sorted(threads.items(), key=lambda x: len(x[1])):
        # date descending
        lst.sort(reverse=True)
        for no, (date, uid) in enumerate(lst):
            if no > 33 or datetime.now() - datetime(*date[:6]) > timedelta(55):
                print key, date, uid
                uids.append(uid)
    # uids.sort(reverse=True)
    print len(uids)
    if uids:
        r, data = mbox.store(
            #','.join(str(uid) for uid in uids), '+FLAGS', '\\Deleted')
            ','.join(str(uid) for uid in uids), '+X-GM-LABELS', '\\Trash')
        assert r == 'OK'
    r, data = mbox.expunge()
    assert r == 'OK'
    print 'ok'
    mbox.close()
    mbox.logout()


if __name__ == '__main__':
    main()

XFCE reboot on Ctrl+Alt+Delete

2013-04-28T01:23:00.000-07:00

xfconf-query -c xfce4-keyboard-shortcuts -n -p "/commands/custom/Delete" -t string -s "xfce4-session-logout -r"

Exclude the only specific field from django serialization

2013-04-28T01:22:00.003-07:00

MyModel._meta.get_field('my_field').serialize = False

Sort Firefox Bookmarks

2013-03-28T03:57:00.001-07:00


% sqlite3 ~/.mozilla/firefox/*.default/places.sqlite 'update moz_bookmarks set position=(select count(*) from moz_bookmarks as b where lower(b.title) < lower(moz_bookmarks.title));'

Autologin in FreeBSD without GDM

2013-01-30T05:20:00.000-08:00

Autologin and startx without GDM or other display manager:

Add this line to /etc/gettytab to describe new terminal line with autologin
al.username:al=username:tc=std.230400:
, where <username> is user to log in automatically. "al.username" is the terminal name which can be any.
Change ttyv0 line in /dev/ttys from this:
ttyv0 "/usr/libexec/getty Pc" xterm on secure
to this
ttyv0 "/usr/libexec/getty al.username" xterm on secure
to spawn auto logged in terminal at Alt+F1 console.
Set login shell on ttyv0 to start X11 immediately
echo 'if $tty == ttyv0 startx' >> ~/.login
Reboot.
X11 will start automatically for <username>.

Django html5lib validating middleware

2012-09-10T00:55:00.000-07:00

Django middleware to validate every HTML response with html5lib.

Usage

Save to middleware.py
Add 'middleware.ProfileMiddleware' to MIDDLEWARE_CLASSES

Listing

from html5lib.html5parser import HTMLParser
from html5lib import treebuilders
from django.http import HttpResponse


class ValidateMiddleware(object):
    def process_request(self, request):
        pass

    def process_response(self, request, response):
        if response.content and 'html' in response['Content-Type'] \
                and 'disable-validation' not in request.GET:
            # validate
            treebuilder = treebuilders.getTreeBuilder("simpleTree")
            parser = HTMLParser(tree=treebuilder, strict=True)
            try:
                parser.parse(response.content)
            except Exception:
                pass
            if parser.errors:
                # format output
                out = []
                lines = response.content.splitlines()
                for (row, col), e, d in parser.errors:
                    out.append('%s, %s' % (e, d))
                    for x in range(max(0, row - 3), min(len(lines), row + 1)):
                        out.append(lines[x])
                    out.append(' ' * col + '^')
                out = '\n'.join(out)
                return HttpResponse(out, mimetype='text/plain')
        return response

    def process_view(self, request, callback, callback_args, callback_kwargs):
        return callback(request, *callback_args, **callback_kwargs)

Django Profiling Middleware

2012-06-21T19:52:00.002-07:00

This Django middleware can be used to collect and print accumulated profiling statistics on a running site. As opposed to popular individual view profiling tools this one profiles all existing views as they are being executed and saves statistics for later usage. On production (DEBUG=False) only each 20-th request is profiled to keep CPU overhead low.

Usage

Save to profile.py
Add 'profile.ProfileMiddleware' to MIDDLEWARE_CLASSES
...run requests
Visit http://mysite/profile/ to print accumulated statistics
Visit http://mysite/myview?profile to profile this view only and print statistics immediately

Listing

from cStringIO import StringIO
from django.conf import settings
from django.http import HttpResponse
from os import path
from random import randrange
import cProfile
import pstats

# see pstats.Stats.print_stats
RESTRICTIONS = 30,
# to keep stats in memory
STATS_FILE = None
# to dump accumulated stats to file after every request
STATS_FILE = '/tmp/mysite.profile'


class ProfileMiddleware(object):
    empty = True
    prof = cProfile.Profile()

    def process_request(self, request):
        if request.path.startswith('/profile/'):
            # return collected stats
            if not (settings.DEBUG or request.user.is_staff):
                return HttpResponseForbidden(
                    'Forbidden', content_type='text/plain')
            return self.print_stats()

    def process_response(self, request, response):
        return response

    def process_view(self, request, callback, callback_args, callback_kwargs):
        if 'profile' in request.GET:
            # profile this view and print results
            self.prof.clear()
            self.prof.runcall(
                callback, request, *callback_args, **callback_kwargs)
            self.empty = False
            return self.print_stats(None)
        if not self.empty and not settings.DEBUG and randrange(20):
            # run without profiling
            return callback(request, *callback_args, **callback_kwargs)
        # run with profiling
        self.empty = False
        if STATS_FILE:
            self.prof.clear()
        retval = self.prof.runcall(
            callback, request, *callback_args, **callback_kwargs)
        if STATS_FILE:
            # merge stats
            self.save()
        return retval

    def save(self):
        stats = pstats.Stats(self.prof)
        stats.strip_dirs()
        if path.exists(STATS_FILE):
            try:
                stats.add(STATS_FILE)
            except (EOFError, ValueError):
                pass
        stats.dump_stats(STATS_FILE)

    def print_stats(self, input_file=STATS_FILE):
        # handle ourselfves
        out = StringIO()
        if input_file:
            stats = pstats.Stats(input_file, stream=out)
        else:
            if self.empty:
                return HttpResponse('No data yet.', content_type='text/plain')
            stats = pstats.Stats(self.prof, stream=out).strip_dirs()
        stats.sort_stats('cumulative').print_stats(*RESTRICTIONS)
        stats_str = out.getvalue()
        return HttpResponse(stats_str, content_type='text/plain')

My Blog

Best AdMob alternatives

Show longest continuous block of code not covered by tests

Profiling C++ scopes

VPS hosting shortlist

Why I hate fxsol.co.uk?

Case #1

Case #2

Python cache dictionary

Best AdSense Alternatives

Motorola Milestone 2 Firmware links

GMail cleanup

XFCE reboot on Ctrl+Alt+Delete

Exclude the only specific field from django serialization

Sort Firefox Bookmarks

Autologin in FreeBSD without GDM

Django html5lib validating middleware

Usage

Listing

Django Profiling Middleware

Usage

Listing

See also