MooGoo's Blog

SQLAlchemy的count很慢

noreply@blogger.com (shl) — Thu, 03 Jan 2013 09:54:00 +0000

http://docs.sqlalchemy.org/en/rel_0_8/orm/tutorial.html#counting

uall = User.query.count()
很慢 (subquery的關係?)

session.query(func.count(User.id)).scalar()
快多了

232,053的資料, 用time.time() 算

count(): 4.53022193909 sec
func.count: 0.17828607559 sec

[nginx] facebook canvas連nginx時出現 HTTP 405 Not allowed

noreply@blogger.com (shl) — Fri, 23 Nov 2012 04:32:00 +0000

Facebook是用POST去抓canvas/iFrame,
但是nginx處理static file預設不給POST,
workaround如下:

location / {
error_page 405 =200 $uri;
root /var/www/html/yoursite.com;
}

比較好的處理如下:

http://invalidlogic.com/2011/04/12/serving-static-content-via-post-from-nginx/

[SQLAlchemy] 不用primary key的table

noreply@blogger.com (shl) — Mon, 19 Nov 2012 09:41:00 +0000

table沒有設pirmary key會出現這個錯誤:

sqlalchemy.exc.ArgumentError: Mapper Mapper|FooTable|foo_table could not assemble any primary key columns for mapped table 'foo_table'

mapper要設:

"primary_key":(col1, col2)}

[Mac][git] git diff in Mac

noreply@blogger.com (shl) — Fri, 16 Nov 2012 04:03:00 +0000

如果有裝GitX的話，設定選"Enable Terminal Usage"，然後

git diff | gitx

或是XCode的FileMerge/opendiff也很好用，

git difftool -t opendiff -y

可以寫到.gitconfig的

[alias]

df = difftool -t opendiff -y

[SQLAlchemy] foreign key constraint 問題

noreply@blogger.com (shl) — Thu, 15 Nov 2012 04:13:00 +0000

以不delete, SET NULL為例:

1. database level
db.Column(db.Integer, ForeignKey(db.ForeignKey('category.id',ondelete='SET NULL')))

2. pythen level
db.relationship(passive_deletes=True)

[Tools] 方便產生server response的Deployd

noreply@blogger.com (shl) — Sun, 11 Nov 2012 01:42:00 +0000

http://www.deployd.com/

Emacs 24 color theme 錯誤

noreply@blogger.com (shl) — Tue, 16 Oct 2012 09:45:00 +0000

是因為Emacs有內建color theme，語法改一下就好了。

參考:
http://batsov.com/articles/2012/02/19/color-theming-in-emacs-reloaded/

[tools] 找domain有無被用走的方便工具

noreply@blogger.com (shl) — Tue, 03 Jul 2012 09:27:00 +0000

https://github.com/zachwill/dom

$ pip install dom # 安裝

$ dom foo # 列出相關domain有無被註冊

[note] 2012 GDC Taipei - Aaron Pulkka (Rabbx) 利用AAA電腦/遊戲機遊戲開發經驗來獲得智慧手機/平板電腦遊戲的成功

noreply@blogger.com (shl) — Wed, 27 Jun 2012 06:04:00 +0000

AAA
------
- big buget
- large item
- long development schedule
- requirement:
* large scope,
* broad feature set
- long play time
- high quality/ polish
- innovation?
- no middle in game market
- marketing costs >= development costs

.. note:: core gamers bring high expectations but are willing to pay
.. note:: late adopters form new casual audience, but want to pay less

1. High Quality User Experiance
- responsive
- 0.1s good
- 0.5s slow
- consistent
- clear/obvious
- forgiving

* Lasting Appeal
- Ramping difficulty + Random Chance + Increasing Rewards = Replayability
- Rollercoaster Excitement Curve

* Quality Assurance
- Start QA early, ramp-up from alpha through launch
- 100 little bugs worse than 1 big bug

2. Launch Multiplatform

* cross-platform social play allowed on mobile and can increase audience growth dramatically
* Amortize Development & Marketing
* Build game as native to each platform
- meet 'cultural' expectations
- tune for platform specific features
* xbox live! rich presence
* apple game center & retena display
* android 'back'
3. Connect with yurr audience
* Most AAA gamers target core gamers (young males)
* konwing your audience
* mobile has potential for broader audience
- casual audience spends less per user
- broader audience can increase costs
* community anagement
- best marketing: word-of-mouth
- metric tracking can help filter noise
- press is not magic entity but part of your community
* bioware & blizzard provide great example
* App store
understanding how each app store search function works is key

* Plannang
- launch of game is just the beginning
* plan for updates
- DLC for AAA games usually in development before game launches
- post-launch, be ready to modify update plan based on users

* tools
- metric tracking (flurry, bitpollen)
- project management (Hansoft)
- Feedback (Forum)

Naughty Dog (AAA developer with no project managers)

* clones copy a proven base set of features, without adding much new.
* experimental games focus more on innovation, generally at the expense of scope and polish
* AAA games focus on evolution and polish on proven features

smartphone
* short session
* always connected to Internet
tablate
* longer session
* often disconnected from Internet

AAA to mobile
* smaller scope
- app store
- more qualtiy
- more budget
+ larger possible audience
+ core gamers willing to pay to play

New Territory
---------------
TV + Mobile:
* Google TV
* Apple TV
* Transmedia
TV + Console + Mobile:
* MS Smart Glass
Tactile Controls:
* joysticks and buttons on mobile? (we missed buttons)

[note] 2012 GDC Taipei - Metro Style Game for Windows 8

noreply@blogger.com (shl) — Wed, 27 Jun 2012 02:15:00 +0000

Metro App min resolution: 1024x768

如果Metro App resolution大於1366x768+會在前景另外開一個APp (Snap View?)

Tile 動態磚, 每個是不同Entry Point, 同一個遊戲可有不同進入點 (從不同關卡進去)

Data sync:

* App Data(setting...)

* User Data (music, library...) - live.com 帳號

Game可在任意時間(電動打一半)分享, 分享給個social service, 或"另一個App" (puzzle...)

統一Settings (Setting的framework?), 統一使用者體驗

http://ie.microsoft.com/testdrive/

好fish shell, 不用嗎

noreply@blogger.com (shl) — Sun, 10 Jun 2012 12:05:00 +0000

shell很多了: bash, ksh, dash, zsh... 在PyCon Taiwan 2012聽到這個很好用的fish shell，目前我只能發現自動補齊和指令顏色顯示很方便，不用很複雜的設定，就很好用了。

1. 在Mac OSX用brew安裝:

brew install fish

2. 設定檔在: ~/.config/fish/config.fish (自己新增) 顯示git branch,
參考: https://wiki.archlinux.org/index.php/Fish#Configuration_Suggestions

3. 換預設shell:

chsh -s /usr/local/bin/fish

4. 以上出現"non-standard shell"錯誤, 到/etc/shells加"/usr/local/bin/fish"

但是指令和bash/zsh不太合。

Git 強制pull

noreply@blogger.com (shl) — Mon, 07 May 2012 10:40:00 +0000

git pull時出現 error: Untracked working tree file 'foo.bar' would be overwritten by merge. Aborting

git fetch --all
git reset --hard origin/master

ref: http://stackoverflow.com/questions/1125968/force-git-to-overwrite-local-files-on-pull

[Python][Javascript] Python抓Javascript產生的頁面 (phantomJs)

noreply@blogger.com (shl) — Thu, 03 May 2012 04:28:00 +0000

一向都是用Python的Beautiful Soup來parse網頁，現在出到第四版，更好用文件也好看多了。

from BeautifulSoup import BeautifulSoup

改成

from bs4 import BeautifulSoup

method name也有改，參考。不過這次遇到的是內容是javascript產生的，如play.google.com，以前可能看一下js的code，學他送http request出去就可抓回來，現在的js越來越複雜，不好搞。
幸好有PhantomJS這種東西(headless WebKit with JavaScript API)，就可以很方便的用webkit把網頁內容全開出來(跑完javascript)。既然是javascript，DOM的selector就用jquery吧(page.injectJs("jquery.min.js"))。

var page = require('webpage').create(),
    t, address;

if (phantom.args.length === 0) {
    //console.log('Usage: loadspeed.js ');
    phantom.exit();
} else {
    address = phantom.args[0];
    page.open(address, function (status) {
        if (status !== 'success') {
            //console.log('FAIL to load the address');
        } else {
          
           if (page.injectJs("jquery.min.js")) {
                //console.log("jQuery loaded...");
            }

            var get_data = page.evaluate(function () {
              var data = {}
              data['title'] = $('h1.doc-banner-title').text();
              data['content'] = $('#doc-original-text').text();
              data['icon'] = $('.doc-banner-icon img').attr('src');
              var img_list = []
              $('.screenshot-carousel-content-container img').each(function(){ img_list.push($(this).attr('src')) });
              data['images'] = img_list

              return JSON.stringify(data);
            });
          console.log(get_data);
          phantom.exit();
        }

    });
}

command line執行$ phantomjs my_scrapy.js my_url console.log裡的資料就回跑出來了。 Python裡用commands.getoutput，再json.loads把JSON拆成dict，大改就這樣吧。

import commands
import json

out = commands.getoutput(my_cmd)
data = json.loads(out)

[Flask] multiple file input 上傳多檔案

noreply@blogger.com (shl) — Wed, 02 May 2012 18:12:00 +0000

這個害我傷腦筋好久，Flask處裡form的post，透過Werkzeug處理，如果是單一name，用request.values()(串列list)或request.form(dict)，就可以抓到。如過是多重name，如：

<input name="animal" type="checkbox" value="lion" />
<input name="animal" type="checkbox" value="tiger" />

就要用request.form.getlist('animal')取的list。

檔案上傳:

<input name="icon[]" type="file" />

就要用request.files，是一個werkzeug自定的ImmutableMultiDict。如果是同一個name的多檔案(input array)

<input name="image[]" type="file" />
<input name="image[]" type="file" />

request.files裡有值，但是用for j in request.files:同一個input name只能抓第一個出來，有人說：Flask-WTF的FileField可以解決(沒試過)。後來去看了Werkzeug的原始碼:

class MultiDict
...
def iteritems
...

學他用

for key, values in dict.iteritems(request.files):
     for value in values:
         print key, value

就可以了。

[Flask][Flask-WTF]

noreply@blogger.com (shl) — Tue, 24 Apr 2012 03:38:00 +0000

Flask-WTF升級到0.6，{{ form.csrf }}要改成{{ form.csrf_token }}

[Django] 圖片上傳錯誤

noreply@blogger.com (shl) — Tue, 17 Apr 2012 01:43:00 +0000

換了新的VPS後上傳圖片出現錯誤:
(jpg才會出現)

"上傳一個有效的圖片。你上傳的檔案不是圖片，否則就是壞掉的圖。"
英文:
"Upload a valid image. The file you uploaded was either not an image or a corrupted image."

果然是PIL的問題，找不到libjpeg吧，用pip或apt重裝/upgrade PIL, libjpeg等都沒用。

懶得自己重編，最後是以下順序成功了:

sudo pip uninstall PIL
sudo apt-get install libjpeg-dev
sudo pip install PIL

[WebDesign] 10 things every designer needs to know about forms (心得文摘)

noreply@blogger.com (shl) — Sat, 14 Apr 2012 10:58:00 +0000

via: 10 things every designer needs to know about forms

其實很多都是「常識」了，不過再實作時還是會常常忘記。

1. 不用特別標示「必填欄位」，使用者通常只會直接按送出，然後再看有什麼沒填完的。
2. 不要用HTML5的"spinner"，按鈕小不好按，用普通的TextField或Select就好了
spinner: http://www.html5tutorial.info/html5-number.php
3. 表單有很多按鈕時，要把最重要的「送出」特別標出，不然容易迷失自我。
4. 欄位多可以分區塊，人是視覺的動物
5. 表單的用詞遣字可多用心，讓使用者覺的填這資料是有意義的，而不是冷冰冰格子。（想一下例子）
6. 日期欄位用動態跳出的月曆來選很酷，但是要考慮各地風水民情不同，年月日順序等（用Select簡單又方便）
7. Server端檢查不容易，但還是一定要做好（工程師的事）
8. 不要設橫向欄位，或是用tab，從上到下就好了
9. 簡化欄位，如地址不要用xx路xx巷xx號、電話不要分區碼，直接用一格就好了
10. 別用機掰語氣做錯誤檢查，如:出生選成2028年，不要寫「你是未來出生的嗎」

[Flask][WTForms] 要在HTML的Select tag, 新增一個"空"的預設選項

noreply@blogger.com (shl) — Fri, 30 Mar 2012 05:48:00 +0000

本來想用jQuery來後製，但其實不用那麽麻煩，WTForms果然都想好了：
QuerySelectField的話，加上

allow_blank=True, blank_text=u'-- please choose --'

wtforms doc

時常出現HTTP 403 Forbidden

noreply@blogger.com (shl) — Thu, 08 Mar 2012 10:01:00 +0000

Forbidden

You don't have permission to access xxx on this server.

通常發生在圖很多的頁面，兇手是Apache防DOS的mod_evasive
果然是被保護機制擋掉了...

[Python] 像PHP的associate array一樣初始Dict

noreply@blogger.com (shl) — Fri, 17 Feb 2012 12:47:00 +0000

Python的dict不能像PHP的associate array一樣"任意給值"，當不知道dict有幾維時很麻煩。
有一個defaultdict可以用，只是不好看，哈哈!

cat = {} # 先初始一個dict
for k, v in foo_list:
   cat.setdefault(k, []).append(v)

ref: collections

[ssh][error] Could not open a connection to your authentication agent.

noreply@blogger.com (shl) — Thu, 16 Feb 2012 03:33:00 +0000

ssh-agent沒有跑,

exec ssh-agent bash

domain transfer

noreply@blogger.com (shl) — Thu, 09 Feb 2012 01:14:00 +0000

Godaddy -> Namecheap

1. 登入Godaddy,Domain Manager左邊Domain Information的Authorization Code:按Send by Email,
就會寄一封EPP Code的信來
2. 到Namecheap申請domain transfer, 付完錢後會寄一封信來, 給你一個認證網址, 再輸入剛才godaddy寄來的EPP code. 輸入後再等一封transfer認證信(不會馬上).
3. 收到認證信後, 點一個"terms and conditions of the Agreement"的連結, 看完按Approval, 等結果

[Slides] PHP之惡, Flask (Python)之優

noreply@blogger.com (shl) — Sun, 23 Oct 2011 18:14:00 +0000

滿主觀的, 不過可姒參考

http://zakx.de/phprant-en.pdf

Google earth在Debian squeeze 32bit 中文出不來

noreply@blogger.com (shl) — Thu, 20 Oct 2011 14:31:00 +0000

Google附的Qt4函式庫的問題，改用系統內建的就好了。

先把Google附的砍掉

Google附的Qt4lib裝在 /opt/google/earth/free/目錄下, 有四個檔:
libQtCore.so.4, libQtGui.so.4, libQtNetwork.so.4, libQtWebKit.so.4
全砍掉, 然後再改 /opt/google/earth/free/googleearth
找到以下這行:
LD_LIBRARY_PATH=.:$LD_LIBRARY_PATH ./googleearth-bin “$@”
再之前加上這行
export LD_PRELOAD=/usr/lib/libfreeimage.so.3
就好了。

(註: 要安裝sudo aptitude install libfreeimage3)

via: http://blog.slps.tp.edu.tw/00086/?p=275

[Python] PyPI實在太常連不到了

noreply@blogger.com (shl) — Sat, 15 Oct 2011 04:31:00 +0000

pip 0.8.1之後:

pip install --use-mirrors $PACKAGE

舊版pip (Debian 6用的是0.7.2)

pip install -i http://d.pypi.python.org/simple $PACKAGE

或是把mirror資料寫在"~/.pip/pip.conf"裡

[global]
index-url = http://d.pypi.python.org/simple

via: http://jacobian.org/writing/when-pypi-goes-down/