Star Life

Howto: ZeroMQ (ØMQ) & PyZMQ Install Guide

Sat, 11 Jun 2011 18:41:49 -0700

ØMQ zeromq:
Ø The socket library that acts as a concurrency framework.
Ø Carries messages across inproc, IPC, TCP, and multicast.
Ø Connect N-to-N via fanout, pubsub, pipeline, request-reply.
Ø Fast enough for clustered products and supercomputing.
Ø Asynch I/O for scalable multicore message-passing apps.
Ø Large and active open source community.
Ø 20+ languages including C, C++, Java, .NET, Python.
Ø Most OSes including Linux, Windows, OS X.
Ø LGPL free software with full commercial support from iMatix.

1. ZeroMQ (ØMQ) Installation
# wget http://download.zeromq.org/zeromq-2.1.6.tar.gz # tar zxvf zeromq-2.1.6.tar.gz # cd zeromq-2.1.6 # ./configure # make # make install # vi /etc/ld.so.conf.d/zmq.conf /usr/local/lib # ldconfig /etc/ld.so.conf

2. PyZMQ Installation
# easy_install-2.6 pyzmq

3. Study ZMQ
消息队列的适用场合 * 可靠传输 * 分布式计算 * 多进程通信

4. 同类产品
ZeroMQ 关注 RabbitMQ(Erlang) 关注 Apache QPID Red Hat Enterprise MRG Fedora AMQP Infrastructure OpenAMQ

Refer to:
1. ZeroMQ Guide
http://zguide.zeromq.org/page:all
2. AMQP和ZeroMQ的分析
https://docs.google.com/present/view?id=df85d3vm_316dbhtg3f7&pli=1

Permalink | Leave a comment »

Howto: Transifex Installation and Configuration

Wed, 27 Apr 2011 09:04:09 -0700

Translation service: http://www.transifex.net/ Open source software: http://www.transifex.org/ 1. Installation (CentOS 5.2 & Python 2.6 & Django 1.2.4) # easy_install -U transifex Note 1: some related rpm packages will be installed by yum Note 2: the following packages will be installed by python ./Jinja2-2.5.5-py2.6.egg ./Pygments-1.4-py2.6.egg ./PIL-1.1.7-py2.6-linux-i686.egg ./polib-0.6.3-py2.6.egg ./httplib2-0.6.0-py2.6.egg ./userprofile-0.7_r422_correct_validation-py2.6.egg ./Markdown-2.0.3-py2.6.egg ./pycurl-7.19.0-py2.6-linux-i686.egg ./ctypes-1.0.2-py2.6-linux-i686.egg ./transifex-1.0.0-py2.6.egg 2. Configuration for development # cd /usr/lib/python2.6/site-packages/transifex-1.0.0-py2.6.egg/transifex Note: running the following command by python ./manage.py txcreatedirs # Create necessary directories ./manage.py syncdb # Setup DB tables, create superuser ./manage.py migrate # Setup more DB tables ./manage.py txlanguages # Create a standard set of languages ./manage.py txcreatenoticetypes # Create a standard set of notice types ./manage.py build_static # Copy all the addons files to the static dir 3. Running for development # cd /usr/lib/python2.6/site-packages/transifex-1.0.0-py2.6.egg/transifex Note: running the following command by python ./manage.py runserver 0.0.0.0:8000 # Start the development server 4. Configuration for apache # vi /etc/httpd/conf.d/transifex.conf < IfModule !python_module> LoadModule python_module modules/python26-mod_python.so < /IfModule> < Directory "/var/www/manual/mod/python26-mod_python"> < Files *.html> SetHandler default-handler < /Files> < /Directory> < Location "/transifex/"> SetHandler python-program PythonHandler django.core.handlers.modpython SetEnv DJANGO_SETTINGS_MODULE settings PythonOption django.root /transifex PythonDebug On PythonPath "['/usr/lib/python2.6/site-packages/transifex-1.0.0-py2.6.egg/transifex'] + sys.path" < /Location> Alias /site_media /usr/lib/python2.6/site-packages/transifex-1.0.0-py2.6.egg/transifex/site_media < Directory /usr/lib/python2.6/site-packages/transifex-1.0.0-py2.6.egg/transifex/site_media> Order Deny,Allow Deny from all # Allow from 127.0.0.1 Allow from 192.168.1.0/24 < /Directory> Note: change some file permission to apache, e.g. the database file and its parent directory. Refer to: Installation Guide

Permalink | Leave a comment »

Howto: MongoDB Installation Guide

Fri, 15 Apr 2011 02:45:00 -0700

MongoDB (from "humongous") is a scalable, high-performance, open source, document-oriented database, written in C++. Homepage: http://www.mongodb.org/ 1. Download the package # uname -a Linux hzserver1 2.6.18-8.el5 #1 SMP Fri Jan 26 14:15:21 EST 2007 i686 i686 i386 GNU/Linux # mkdir -p /home/mongo # cd /home/mongo # wget http://fastdl.mongodb.org/linux/mongodb-linux-i686-1.8.1.tgz # tar zxvf mongodb-linux-i686-1.8.1.tgz # tree mongodb-linux-i686-1.8.1 mongodb-linux-i686-1.8.1 |-- GNU-AGPL-3.0 |-- README |-- THIRD-PARTY-NOTICES `-- bin |-- bsondump |-- mongo |-- mongod |-- mongodump |-- mongoexport |-- mongofiles |-- mongoimport |-- mongorestore |-- mongos |-- mongosniff `-- mongostat 1 directory, 14 files Note: 32-bit builds are limited to around 2GB of data. Recommend 64-bit system. 2. Install the package

Current servers: server1(192.168.1.67): shard1: /home/mongo/data/shard11 shard2: /home/mongo/data/shard21 config1: /home/mongo/data/config mongos server2(192.168.1.68): shard1: /home/mongo/data/shard12 shard2: /home/mongo/data/shard22 config2: /home/mongo/data/config mongos Note: server1 & server2 set up to Replica Sets. 1) server1 tree:


# tree /home/mongo
mongo
|-- bin
|   |-- bsondump
|   |-- mongo
|   |-- mongo.start.sh
|   |-- mongod
|   |-- mongodump
|   |-- mongoexport
|   |-- mongofiles
|   |-- mongoimport
|   |-- mongorestore
|   |-- mongos
|   |-- mongosniff
|   `-- mongostat
`-- data
    |-- config
    |   |-- _tmp
    |   |-- config.0
    |   |-- config.1
    |   |-- config.log
    |   |-- config.ns
    |   |-- diaglog.4da6a3ac
    |   |-- diaglog.4da6a4e1
    |   |-- diaglog.4da6ac00
    |   `-- mongod.lock
    |-- mongos.log
    |-- shard11
    |   |-- local.0
    |   |-- local.1
    |   |-- local.2
    |   |-- local.ns
    |   |-- mongod.lock
    |   `-- shard11.log
    `-- shard21
        |-- local.0
        |-- local.1
        |-- local.2
        |-- local.ns
        |-- mongod.lock
        `-- shard21.log

6 directories, 33 files

2) server2 tree:


[root@hzserver2 home]# tree mongo
mongo
|-- bin
|   |-- bsondump
|   |-- mongo
|   |-- mongo.start.sh
|   |-- mongod
|   |-- mongodump
|   |-- mongoexport
|   |-- mongofiles
|   |-- mongoimport
|   |-- mongorestore
|   |-- mongos
|   |-- mongosniff
|   `-- mongostat
`-- data
    |-- config
    |   |-- config.log
    |   |-- diaglog.4da6a371
    |   |-- diaglog.4da6a4f4
    |   |-- diaglog.4da6a573
    |   |-- diaglog.4da6acee
    |   `-- mongod.lock
    |-- mongos.log
    |-- shard12
    |   |-- local.0
    |   |-- local.1
    |   |-- local.2
    |   |-- local.ns
    |   |-- mongod.lock
    |   `-- shard12.log
    `-- shard22
        |-- local.0
        |-- local.1
        |-- local.2
        |-- local.ns
        |-- mongod.lock
        `-- shard22.log

5 directories, 31 files

3. Configuring the Replica Sets 1) Start shard1 replica set


# /home/mongo/bin/mongo -port 10000 -host 192.168.1.67
> config = {_id:'shard1',members:[{_id: 0, host: '192.168.1.67:10000'},{_id: 1, host: '192.168.1.68:10000'}]}
> rs.initiate(config);

2) Start shard2 replica set


# /home/mongo/bin/mongo -port 10000 -host 192.168.1.67
> config = {_id:'shard2',members:[{_id: 0, host: '192.168.1.67:10001'},{_id: 1, host: '192.168.1.68:10001'}]}
> rs.initiate(config);

4. Mongo start scripts 1) server1


# cat /home/mongo/bin/mongo.start.sh
/home/mongo/bin/mongod -shardsvr -replSet shard1 -port 10000 -dbpath /home/mongo/data/shard11 -oplogSize 100 -logpath /home/mongo/data/shard11/shard11.log -fork
/home/mongo/bin/mongod -shardsvr -replSet shard2 -port 10001 -dbpath /home/mongo/data/shard21 -oplogSize 100 -logpath /home/mongo/data/shard21/shard21.log -fork
/home/mongo/bin/mongod -configsvr -dbpath /home/mongo/data/config -port 20000 -logpath /home/mongo/data/config/config.log -logappend -fork
/home/mongo/bin/mongos -configdb 192.168.1.67:20000 -port 30000 -chunkSize 5 -logpath /home/mongo/data/mongos.log -logappend -fork

2) server2


# cat /home/mongo/bin/mongo.start.sh
/home/mongo/bin/mongod -shardsvr -replSet shard1 -port 10000 -dbpath /home/mongo/data/shard12 -oplogSize 100 -logpath /home/mongo/data/shard12/shard12.log -fork
/home/mongo/bin/mongod -shardsvr -replSet shard2 -port 10001 -dbpath /home/mongo/data/shard22 -oplogSize 100 -logpath /home/mongo/data/shard22/shard22.log -fork
/home/mongo/bin/mongod -configsvr -dbpath /home/mongo/data/config -port 20000 -logpath /home/mongo/data/config/config.log -logappend -fork
/home/mongo/bin/mongos -configdb 192.168.1.67:20000 -port 30000 -chunkSize 5 -logpath /home/mongo/data/mongos.log -logappend -fork

Note: mongos only use 1 or 3 configdb. 5. Configuring the Shard Cluster


# /home/mongo/bin/mongo 192.168.1.67:30000/admin
> db
admin
> db.runCommand({addshard:"shard1/192.168.1.67:10000,192.168.1.68:10000", name:"s1", maxsize:20480});
{ "shardAdded" : "s1", "ok" : 1 }
> db.runCommand({addshard:"shard2/192.168.1.67:10001,192.168.1.68:10001", name:"s2", maxsize:20480});
{ "shardAdded" : "s2", "ok" : 1 }
> db.runCommand({listshards:1})
{
        "shards" : [
                {
                        "_id" : "s1",
                        "host" : "shard1/192.168.1.67:10000,192.168.1.68:10000"
                },
                {
                        "_id" : "s2",
                        "host" : "shard2/192.168.1.67:10001,192.168.1.68:10001"
                }
        ],
        "ok" : 1
}
> db.runCommand({enablesharding:"test_database"})
{ "ok" : 1 }

Refer to: 1. 配置mongodb分片群集(sharding cluster) 2. MongoDB shard replica config/ 分片复制配置

Permalink | Leave a comment »

Howto: RTPproxy Installation Guide

Fri, 08 Apr 2011 08:17:00 -0700

The Sippy RTPproxy is a high-performance software proxy server for RTP streams that can work together with SIP Express Router (SER), OpenSIPS, Kamailio, Sippy B2BUA or reSIProcate B2BUA. The main purpose of RTPproxy originally had been to make the communication between SIP user agents behind NAT(s) (Network Address Translator) possible. Homepage: http://www.rtpproxy.org/ 1. Installation Download the package # cd ~ # wget http://b2bua.org/chrome/site/rtpproxy-1.2.1.tar.gz # tar zxvf rtpproxy-1.2.1.tar.gz # cd rtpproxy-1.2.1 Make and install # ./configure # make # make install 2. Running with Kamailio # rtpproxy -l xxx.xxx.xxx.xxx -s udp:localhost 7722 -u ftp

Permalink | Leave a comment »

Howto: Kamailio (OpenSER) Installation Guide

Fri, 08 Apr 2011 08:05:45 -0700

Kamailio (former OpenSER) is an Open Source SIP Server released under GPL, able to handle thousands of call setups per second. Homepage: http://www.kamailio.org 1. Installation Download the source package # cd ~ # wget http://www.kamailio.org/pub/kamailio/latest/src/kamailio-3.1.3_src.tar.gz # tar zxvf kamailio-3.1.3_src.tar.gz # cd kamailio-3.1.3 # make FLAVOUR=kamailio cfg Modify "modules.lst", Remove db_mysql from the variable exclude_modules. # make all # make install The Kamailio was installed in "/usr/local/sbin", the configuration file was installed in "/usr/local/etc/kaimailio" kamailio - Kamailio (OpenSER) server kamdbctl - script to create and manage the Databases kamctl - script to manage and control Kamailio (OpenSER) server sercmd - CLI - command line tool to interface with Kamailio (OpenSER) server 2. Configuration Config the enviroment variables # cat /usr/local/etc/kamailio/kamctlrc # $Id$ # # The Kamailio configuration file for the control tools. # # Here you can set variables used in the kamctl and kamdbctl setup # scripts. Per default all variables here are commented out, the control tools # will use their internal default values. ## your SIP domain # SIP_DOMAIN=kamailio.org SIP_DOMAIN=hzserver1 ## chrooted directory # $CHROOT_DIR="/path/to/chrooted/directory" ## database type: MYSQL, PGSQL, ORACLE, DB_BERKELEY, or DBTEXT, by default none is loaded # If you want to setup a database with kamdbctl, you must at least specify # this parameter. # DBENGINE=MYSQL DBENGINE=MYSQL ## database host # DBHOST=localhost DBHOST=localhost ## database name (for ORACLE this is TNS name) # DBNAME=openser DBNAME=openser # database path used by dbtext or db_berkeley # DB_PATH="/usr/local/etc/kamailio/dbtext" ## database read/write user # DBRWUSER=openser DBRWUSER=openser ## password for database read/write user # DBRWPW="openserrw" DBRWPW="openserrw" ## database read only user # DBROUSER=openserro DBROUSER=openserro ## password for database read only user # DBROPW=openserro DBROPW=openserro ## database super user (for ORACLE this is 'scheme-creator' user) # DBROOTUSER="root" DBROOTUSER="root" # user name column # USERCOL="username" USERCOL="username" # SQL definitions # If you change this definitions here, then you must change them # in db/schema/entities.xml too. # FIXME # FOREVER="2020-05-28 21:32:15" # DEFAULT_ALIASES_EXPIRES=$FOREVER # DEFAULT_Q="1.0" # DEFAULT_CALLID="Default-Call-ID" # DEFAULT_CSEQ="13" # DEFAULT_LOCATION_EXPIRES=$FOREVER # Program to calculate a message-digest fingerprint # MD5="md5sum" # awk tool # AWK="awk" # If you use a system with a grep and egrep that is not 100% gnu grep compatible, # e.g. solaris, install the gnu grep (ggrep) and specify this below. # # grep tool # GREP="grep" # egrep tool # EGREP="egrep" # sed tool # SED="sed" # tail tool # LAST_LINE="tail -n 1" # expr tool # EXPR="expr" # Describe what additional tables to install. Valid values for the variables # below are yes/no/ask. With ask (default) it will interactively ask the user # for an answer, while yes/no allow for automated, unassisted installs. # # If to install tables for the modules in the EXTRA_MODULES variable. # INSTALL_EXTRA_TABLES=ask # If to install presence related tables. # INSTALL_PRESENCE_TABLES=ask # Define what module tables should be installed. # If you use the postgres database and want to change the installed tables, then you # must also adjust the STANDARD_TABLES or EXTRA_TABLES variable accordingly in the # kamdbctl.base script. # Kamailio standard modules # STANDARD_MODULES="standard acc lcr domain group permissions registrar usrloc msilo # alias_db uri_db speeddial avpops auth_db pdt dialog dispatcher # dialplan" # Kamailio extra modules # EXTRA_MODULES="imc cpl siptrace domainpolicy carrierroute userblacklist htable purple" ## type of aliases used: DB - database aliases; UL - usrloc aliases ## - default: none # ALIASES_TYPE="DB" ## control engine: FIFO or UNIXSOCK ## - default FIFO # CTLENGINE="FIFO" ## path to FIFO file # OSER_FIFO="FIFO" ## check ACL names; default on (1); off (0) # VERIFY_ACL=1 ## ACL names - if VERIFY_ACL is set, only the ACL names from below list ## are accepted # ACL_GROUPS="local ld int voicemail free-pstn" ## verbose - debug purposes - default '0' # VERBOSE=1 VERBOSE=1 ## do (1) or don't (0) store plaintext passwords ## in the subscriber table - default '1' # STORE_PLAINTEXT_PW=0 ## OPENSER START Options ## PID file path - default is: /var/run/kamailio.pid # PID_FILE=/var/run/kamailio.pid PID_FILE=/var/run/kamailio.pid ## Extra start options - default is: not set # example: start Kamailio with 64MB share memory: STARTOPTIONS="-m 64" # STARTOPTIONS= STARTOPTIONS="-u ftp" Add the following lines in the config file. # cat /usr/local/etc/kamailio/kamailio.cfg ...... #!define WITH_MYSQL #!define WITH_AUTH #!define WITH_USRLOCDB #!define WITH_NAT ...... Create MySQL database (Do change the passwords for these two users immediately after the database is created) # /usr/local/sbin/kamdbctl create 3. Start the Kamailio # /usr/local/sbin/kamailio 4. Monitor the Kamailio # /usr/local/sbin/kamctl moni 5. Add user # kamctl add 80001 80001 Refer to: http://www.kamailio.org/dokuwiki/doku.php/install:kamailio-3.1.x-from-git

Permalink | Leave a comment »

Howto: FFmpeg build in Windows & Linux

Wed, 06 Apr 2011 02:17:54 -0700

FFmpeg is a complete, cross-platform solution to record, convert and stream audio and video. It includes libavcodec - the leading audio/video codec library. Homepage: http://ffmpeg.org/ 1. Linux Test release: http://ffmpeg.org/releases/ffmpeg-0.6.2.tar.gz # cd ~/ffmpeg # wget http://ffmpeg.org/releases/ffmpeg-0.6.2.tar.gz # tar zxvf ffmpeg-0.6.2.tar.gz # cd ffmpeg-0.6.2 # ./configure # make Example code: ～/ffmpeg/ffmpeg-0.6.2/libavcodec/api-example.c # cd ~/ffmpeg/ffmpeg-0.6.2 # cp ./lib*/*.a . # cp ./libavcodec/api-example.c . # touch Makefile.test Test Makefile: CC=gcc CFLAGS=-I. -L. -L/usr/lib -lm -lz -lavdevice -lavfilter -lavformat -lavcodec -lpostproc -lswscale -lavutil OBJECTS = api-example.o all: api-example api-example: $(OBJECTS) $(CC) -o api-example $(OBJECTS) $(CFLAGS) api-example.o: api-example.c $(CC) -c api-example.c $(CFLAGS) .PHONY: clean clean: -rm -rf $(OBJECTS) api-example Note: we should modify the directory of the include files! 2. Windows Windows builds: http://hawkeye.arrozcru.org/ Test release: http://hawkeye.arrozcru.org/builds/32-bit/dev/ffmpeg-git-8b8bf89-32-bit-dev.7z Example code: unzip ffmpeg-git-8b8bf89-32-bit-dev.7z into the following directory. c:\project\ffmpeg\test.win> dir api-example.c Makefile.win doc include lib Note: include the "include" & "lib" in the project, modify the directory of the include files!

Permalink | Leave a comment »

Howto: usage of tools

Wed, 23 Feb 2011 09:31:02 -0800

yum下载不按照RPM包

Refer to: http://297020555.blog.51cto.com/1396304/477757 1. 首先安装yum-downloadonly yum install yum-downloadonly 2. 只下载不安装 yum update httpd -y --downloadonly 3. 只下载到指定目录，但不安装 yum update httpd -y --downloadonly --downloaddir=/opt

Permalink | Leave a comment »

Howto: Voip Performance test - SIPp

Mon, 21 Feb 2011 06:26:21 -0800

Homepage: http://sipp.sourceforge.net/ 测试软件 SIPp v3.2-TLS-PCAP, version unknown, built Feb 17 2011, 10:19:21. 安装编译：下载源代码后重新编译 # wget http://sourceforge.net/projects/sipp/files/sipp/3.2/sipp.svn.tar.gz/download?... # tar zxvf sipp.svn.tar.gz # cd sipp.svn # make pcapplay_ossl 备注：测试RTP需要pcap包，测试认证需要OpenSSL包，e.g. * C++ Compiler * curses or ncurses library * For authentication and TLS support: OpenSSL >= 0.9.8 * For pcap play support: libpcap and libnet * For distributed pauses: Gnu Scientific Libraries 测试脚本命令 sipp -sf meeting.xml -inf meeting.csv -l 60 -m 60 -i 192.168.1.67 192.168.1.40:5060 测试流程 1. 创建会议接入号：10000； 2. 创建会议：123456，密码：123； SIPp UAC MCU |(1) INVITE | |------------------>| |(2) 100 (optional) | |<------------------| |(3) 183 (optional) | |<------------------| |(4) 200 | |<------------------| |(5) ACK | |------------------>| | | |(6) RFC2833 DIGIT | | (123456#) | | | |==================>| |(7) RFC2833 DIGIT | | | | (123#) | |==================>| | | |(8) RTP send (600s)| |==================>| | | |(9) BYE | |------------------>| |(10) 200 | |<------------------| 相关脚本： gennum.sh #!/bin/bash echo "SEQUENTIAL" > meeting.csv i=80000 while [ $i != 89999 ] do i=$(($i+1)) echo "$i;10000" >>meeting.csv # j=$(($i+1)) #echo "$i;[authentication username=$i password=$i]" >>meeting.csv done meeting.csv SEQUENTIAL 80001;10000 80002;10000 80003;10000 meeting.sh ./sipp -sf meeting.xml -inf meeting.csv -p 10000 -l 60 -m 10000 -i 192.168.1.67 192.168.1.40:15060 meeting.xml 参考uac_pcap.xml Refer to: SIP压力测试最好的工具，SIPp的安装与使用

Permalink | Leave a comment »

Howto: MySQL Master Slave Configuration

Sat, 12 Feb 2011 03:33:08 -0800

Mysql Master-Slave configuration

网络环境

主服务器：server1, 192.168.2.231 备份服务器：server2, 192.168.1.78

配置主备数据库

创建同步用户

在主数据库上创建同步用户，以便该帐号可以访问主数据库。 e.g. mysql> GRANT REPLICATION SLAVE ON *.* TO 'repl'@'192.168.1.78' IDENTIFIED BY '123456'; 验证方法，可以登录到备份服务器使用下面的命令访问主服务器，如果可以访问说明配置正确： # mysql –u repl –p –h 192.168.2.231

修改数据库配置文件

注意：所有服务器的server-id不能相同！！！ 1. 修改主配置文件 # vi /etc/my.cnf [mysqld] log-bin=mysql-bin server-id=1 # 1 - 2^32-1 2. 修改备配置文件 # vi /etc/my.cnf [mysqld] server-id=101 # 1 - 2^32-1 3. 重启主备数据库 # service mysqld restart

备份主数据库文件并导入备份数据库（方法一）

注意：确认主数据库不被修改！！！ 1. 主服务器上操作：备份数据库 # mysqldump --all-databases > /root/mysql-backup.sql 打包备份文件 # tar czvf /root/mysql-backup.tar.gz /root/mysql-backup.sql 复制到备份服务器 # scp /root/mysql-backup.tar.gz root@server2:/root/ 2. 备份服务器上操作：解压备份文件 # cd /root # tar zxvf /root/mysql-backup.tar.gz 导入到备份数据库 # mysql –u roo –p < /root/mysql-backup.sql

备份主数据库文件并导入备份数据库（方法二）

1. 主服务器上操作：锁定数据库只读 mysql> FLUSH TABLES WITH READ LOCK; 不要退出上面的命令，备份数据库文件 # tar zcvf /root/backup.tar.gz /var/lib/mysql 复制到备份服务器 # scp /root/ backup.tar.gz root@server2:/root/ 记录master状态 mysql> SHOW MASTER STATUS; 释放数据库锁 mysql> UNLOCK TABLES; 2. 备份服务器上操作：停止mysql服务 # service mysqld stop 解压备份文件 # cd /var/lib/mysql # tar zxvf /root/mysql-backup.tar.gz 启动mysql服务 # service mysqld start

配置主备同步

查看主数据库状态

设置Master，查看备份数据库状态

1. 设置Master mysql> CHANGE MASTER TO MASTER_HOST='192.168.2.231', MASTER_USER='repl', MASTER_PASSWORD='123456', MASTER_LOG_FILE='mysql-bin.000001', MASTER_LOG_POS=72267996; 2. 查看slave状态 mysql> show slave status; | Connecting to master | 192.168.2.231 | repl | 3306 | 60 | mysql-bin.000001 | 72267996 | mysqld-relay-bin.000001 | 98 | mysql-bin.000001 | No | Yes | | | | | | | 0 | | 0 | 72267996 | 98 | None | | 0 | No | | | | | | NULL | 3. 启动slave mysql> start slave; 4. 验证同步状态检查主数据库进程状态，共1个同步进程 mysql> show processlist; 110346 | repl | 192.168.1.78:45597 | NULL | Binlog Dump | 59523 | Has sent all binlog to slave; waiting for binlog to be updated | NULL 检查备份数据库进程状态，共2个同步进程 mysql> show processlist; | 1 | system user | | NULL | Connect | 59472 | Waiting for master to send event | NULL | | 2 | system user | | NULL | Connect | 35 | Has read all relay log; waiting for the slave I/O thread to update it | NULL | 修改主数据库数据，然后在备份数据库查看备份数据库是否也修改成功。

FAQ

Q1：同步数据库启动失败？

# tail -f /var/log/mysqld.log 101117 12:52:25 mysqld started 101117 12:52:25 InnoDB: Started; log sequence number 0 8769907 101117 12:52:25 [Note] /usr/libexec/mysqld: ready for connections. Version: '5.0.22' socket: '/var/lib/mysql/mysql.sock' port: 3306 Source distribution 101117 12:56:50 [Warning] Neither --relay-log nor --relay-log-index were used; so replication may break when this MySQL server acts as a slave and has his hostname changed!! Please use '--relay-log=hzserver2-relay-bin' to avoid this problem. 101117 13:38:18 [Note] Slave SQL thread initialized, starting replication in log 'FIRST' at position 0, relay log './hzserver2-relay-bin.000001' position: 4 101117 13:38:18 [Note] Slave I/O thread: connected to master 'repl@hzserver1:3306', replication started in log 'FIRST' at position 4 101117 13:41:39 [Note] /usr/libexec/mysqld: Normal shutdown 101117 13:41:39 [Note] Slave I/O thread killed while reading event 101117 13:41:39 [Note] Slave I/O thread exiting, read up to log 'hzserver1-bin.000001', position 98 101117 13:41:39 [Note] Error reading relay log event: slave SQL thread was killed 101117 13:41:39 InnoDB: Starting shutdown... 101117 13:41:42 InnoDB: Shutdown completed; log sequence number 0 8769907 101117 13:41:42 [Note] /usr/libexec/mysqld: Shutdown complete -----------------

A1：修改启动脚本

增加启动项：'--relay-log=hzserver2-relay-bin' # vi /etc/init.d/mysqld /usr/bin/mysqld_safe --defaults-file=/etc/my.cnf --pid-file="$mypidfile" --log-error="$errlogfile" --relay-log=hzserver2-relay-bin>/dev/null 2>&1 &

参考资料

官方资料： http://dev.mysql.com/doc/refman/5.5/en/replication-howto.html 如何设置MySQL同步(Replication) http://blog.chinaitlab.com/html/30/104830-161852.html MYSQL主从复制或双机互备 http://hi.baidu.com/ultimated_fantasy/blog/item/f6752d1843f9450034fa4148.html

Permalink | Leave a comment »

Howto: 安装配置CentOS文件同步

Fri, 17 Dec 2010 03:32:54 -0800

Homepage: inotify-tools master: the source host slave: the destination host 1. Download inotify-tools package and installation

master # cd ~ master # wget https://github.com/downloads/rvoicilas/inotify-tools/inotify-tools-3.14.tar.gz master # tar zxvf inotify-tools-3.14.tar.gz master # cd inotify-tools-3.14 master # ./configure master # make master # make install

2. Generate the SSH KEY to access without the password

master # cd ~ master # ssh-keygen -t rsa # two files: id_rsa (private key) & id_rsa.pub (public key) in ~/.ssh/ master # scp ~/.ssh/id_rsa.pub root@slave:~/.ssh/ slave # cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys slave # service sshd restart

3. Create sync shell

master # cat /etc/rc.local nohup /backup/scripts/sync.sh & > /dev/null 2>&1

master # cat /backup/scripts/sync.sh #!/bin/sh ip="xxx.xxx.xxx.xxx yyy.yyy.yyy.yyy" # Add multiple IP address of slave hosts srcdir="/backup/" dstdir="/backup/" /usr/local/bin/inotifywait -mrq --timefmt '%d/%m/%y-%H:%M' --format '%T %w%f' -e modify,delete,create,attrib ${srcdir} \ | while read file do for i in $ip do rsync -aqztH --delete --progress ${srcdir} root@${i}:${dstdir} done done

Refer to: Cent OS 5.4 rsync+inotify配置触发式(实时)远程同步

Permalink | Leave a comment »

Howto: GTD tools

Wed, 10 Nov 2010 05:43:13 -0800

EverNote: win/mac/web & iPad/iPhone/Android/BlackBerry/Palm/WinMobile DropBox: win/mac/linux & iphone/ipad/andriod/blackberry Blocked! RTM (Remember The Milk): web OmniFocus: mac/iphone/ipad, trial mode for 14 days Things: mac/iphone/ipad Refer to: What is GTD 【幸福课】如何提高创作型任务的效率？（MAC版） GTD软件工具列表

Permalink | Leave a comment »

Howto: Translation

Wed, 10 Nov 2010 02:52:32 -0800

Gettext Gettext 主页简介：是GNU国际化与本地化(i18n)函数库。它常被用于编写多语言程序。

xgettext: 源代码 => .pot模板文件 # xgettext --help e.g. # xgettext -LPHP /xxx/yyy/zzz.php

# xgettext --help
Usage: xgettext [OPTION] [INPUTFILE]...

Extract translatable strings from given input files.

Mandatory arguments to long options are mandatory for short options too.
Similarly for optional arguments.

Input file location:
  INPUTFILE ...               input files
  -f, --files-from=FILE       get list of input files from FILE
  -D, --directory=DIRECTORY   add DIRECTORY to list for input files search
If input file is -, standard input is read.

Output file location:
  -d, --default-domain=NAME   use NAME.po for output (instead of messages.po)
  -o, --output=FILE           write output to specified file
  -p, --output-dir=DIR        output files will be placed in directory DIR
If output file is -, output is written to standard output.

Choice of input file language:
  -L, --language=NAME         recognise the specified language
                                (C, C++, ObjectiveC, PO, Shell, Python, Lisp,
                                EmacsLisp, librep, Scheme, Smalltalk, Java,
                                JavaProperties, C#, awk, YCP, Tcl, Perl, PHP,
                                GCC-source, NXStringTable, RST, Glade)
  -C, --c++                   shorthand for --language=C++
By default the language is guessed depending on the input file name extension.

Input file interpretation:
      --from-code=NAME        encoding of input files
                                (except for Python, Tcl, Glade)
By default the input files are assumed to be in ASCII.

Operation mode:
  -j, --join-existing         join messages with existing file
  -x, --exclude-file=FILE.po  entries from FILE.po are not extracted
  -c, --add-comments[=TAG]    place comment block with TAG (or those
                              preceding keyword lines) in output file

Language specific options:
  -a, --extract-all           extract all strings
                                (only languages C, C++, ObjectiveC, Shell,
                                Python, Lisp, EmacsLisp, librep, Scheme, Java,
                                C#, awk, Tcl, Perl, PHP, GCC-source, Glade)
  -k, --keyword[=WORD]        additional keyword to be looked for (without
                              WORD means not to use default keywords)
                                (only languages C, C++, ObjectiveC, Shell,
                                Python, Lisp, EmacsLisp, librep, Scheme, Java,
                                C#, awk, Tcl, Perl, PHP, GCC-source, Glade)
      --flag=WORD:ARG:FLAG    additional flag for strings inside the argument
                              number ARG of keyword WORD
                                (only languages C, C++, ObjectiveC, Shell,
                                Python, Lisp, EmacsLisp, librep, Scheme, Java,
                                C#, awk, YCP, Tcl, Perl, PHP, GCC-source)
  -T, --trigraphs             understand ANSI C trigraphs for input
                                (only languages C, C++, ObjectiveC)
      --qt                    recognize Qt format strings
                                (only language C++)
      --debug                 more detailed formatstring recognition result

Output details:
  -e, --no-escape             do not use C escapes in output (default)
  -E, --escape                use C escapes in output, no extended chars
      --force-po              write PO file even if empty
  -i, --indent                write the .po file using indented style
      --no-location           do not write '#: filename:line' lines
  -n, --add-location          generate '#: filename:line' lines (default)
      --strict                write out strict Uniforum conforming .po file
      --properties-output     write out a Java .properties file
      --stringtable-output    write out a NeXTstep/GNUstep .strings file
  -w, --width=NUMBER          set output page width
      --no-wrap               do not break long message lines, longer than
                              the output page width, into several lines
  -s, --sort-output           generate sorted output
  -F, --sort-by-file          sort output by file location
      --omit-header           don't write header with `msgid ""' entry
      --copyright-holder=STRING  set copyright holder in output
      --foreign-user          omit FSF copyright in output for foreign user
      --msgid-bugs-address=EMAIL@ADDRESS  set report address for msgid bugs
  -m, --msgstr-prefix[=STRING]  use STRING or "" as prefix for msgstr entries
  -M, --msgstr-suffix[=STRING]  use STRING or "" as suffix for msgstr entries

Informative output:
  -h, --help                  display this help and exit
  -V, --version               output version information and exit

msginit: .pot模板文件 => .po文件 (翻译者需要工作的对象) # msginit --help Creates a new PO file, initializing the meta information with values from the user's environment.

# msginit --help
Usage: msginit [OPTION]

Creates a new PO file, initializing the meta information with values from the
user's environment.

Mandatory arguments to long options are mandatory for short options too.

Input file location:
  -i, --input=INPUTFILE       input POT file
If no input file is given, the current directory is searched for the POT file.
If it is -, standard input is read.

Output file location:
  -o, --output-file=FILE      write output to specified PO file
If no output file is given, it depends on the --locale option or the user's
locale setting.  If it is -, the results are written to standard output.

Input file syntax:
  -P, --properties-input      input file is in Java .properties syntax
      --stringtable-input     input file is in NeXTstep/GNUstep .strings syntax

Output details:
  -l, --locale=LL_CC          set target locale
      --no-translator         assume the PO file is automatically generated
  -p, --properties-output     write out a Java .properties file
      --stringtable-output    write out a NeXTstep/GNUstep .strings file
  -w, --width=NUMBER          set output page width
      --no-wrap               do not break long message lines, longer than
                              the output page width, into several lines

Informative output:
  -h, --help                  display this help and exit
  -V, --version               output version information and exit

msgfmt: .po文件 => 编译为.mo文件 # msgfmt --help e.g. # msgfmt /xxx/yyy/zzz.po Note: msgfmt: messages.po: warning: Charset "CHARSET" is not a portable encoding name. You should update the "CHARSET" with "utf-8" in zzz.po file.

# msgfmt --help
Usage: msgfmt [OPTION] filename.po ...

Generate binary message catalog from textual translation description.

Mandatory arguments to long options are mandatory for short options too.
Similarly for optional arguments.

Input file location:
  filename.po ...             input files
  -D, --directory=DIRECTORY   add DIRECTORY to list for input files search
If input file is -, standard input is read.

Operation mode:
  -j, --java                  Java mode: generate a Java ResourceBundle class
      --java2                 like --java, and assume Java2 (JDK 1.2 or higher)
      --csharp                C# mode: generate a .NET .dll file
      --csharp-resources      C# resources mode: generate a .NET .resources file
      --tcl                   Tcl mode: generate a tcl/msgcat .msg file
      --qt                    Qt mode: generate a Qt .qm file

Output file location:
  -o, --output-file=FILE      write output to specified file
      --strict                enable strict Uniforum mode
If output file is -, output is written to standard output.

Output file location in Java mode:
  -r, --resource=RESOURCE     resource name
  -l, --locale=LOCALE         locale name, either language or language_COUNTRY
  -d DIRECTORY                base directory of classes directory hierarchy
The class name is determined by appending the locale name to the resource name,
separated with an underscore.  The -d option is mandatory.  The class is
written under the specified directory.

Output file location in C# mode:
  -r, --resource=RESOURCE     resource name
  -l, --locale=LOCALE         locale name, either language or language_COUNTRY
  -d DIRECTORY                base directory for locale dependent .dll files
The -l and -d options are mandatory.  The .dll file is written in a
subdirectory of the specified directory whose name depends on the locale.

Output file location in Tcl mode:
  -l, --locale=LOCALE         locale name, either language or language_COUNTRY
  -d DIRECTORY                base directory of .msg message catalogs
The -l and -d options are mandatory.  The .msg file is written in the
specified directory.

Input file syntax:
  -P, --properties-input      input files are in Java .properties syntax
      --stringtable-input     input files are in NeXTstep/GNUstep .strings
                              syntax

Input file interpretation:
  -c, --check                 perform all the checks implied by
                                --check-format, --check-header, --check-domain
      --check-format          check language dependent format strings
      --check-header          verify presence and contents of the header entry
      --check-domain          check for conflicts between domain directives
                                and the --output-file option
  -C, --check-compatibility   check that GNU msgfmt behaves like X/Open msgfmt
      --check-accelerators[=CHAR]  check presence of keyboard accelerators for
                                menu items
  -f, --use-fuzzy             use fuzzy entries in output

Output details:
  -a, --alignment=NUMBER      align strings to NUMBER bytes (default: 1)
      --no-hash               binary file will not include the hash table

Informative output:
  -h, --help                  display this help and exit
  -V, --version               output version information and exit
      --statistics            print statistics about translations
  -v, --verbose               increase verbosity level

备注：使用Unix类型操作系统的用户只需设置环境变量中的LC_MESSAGES，程序将自动从相应的.mo 文件中读取语言信息。

Mozilla Mozilla的架构设计 Creating Applications with Mozilla

DTD (.dtd) Files containing entities that host the strings from XUL content files. Property (.properties) or string bundles Files containing strings that are accessed by JavaScript, C++, and possibly other scripting or component files. RDF RDF files are described in XML syntax, so use entities. HTML and text Suitable for long text, HTML and XML documents and other content that needs to be localized.

Permalink | Leave a comment »

Howto: narro installation and setup

Tue, 09 Nov 2010 09:00:52 -0800

Homepage: Narro Download version:

narro-0.9.4.tar.gz

OS version: CentOS 5

# uname -a Linux hzserver2 2.6.18-8.el5 #1 SMP Fri Jan 26 14:15:21 EST 2007 i686 i686 i386 GNU/Linux

Installation path:

# cat /etc/httpd/conf.d/narro.conf ...... Alias /narro /var/www/narro Order Deny,Allow Deny from all # Allow from 127.0.0.1 Allow from xxx.xxx.xxx.xxx/24

Modify the config file:

# cat /var/www/narro/includes/configuration.inc.php ...... define ('__DOCROOT__', realpath(dirname(__FILE__) . '/../..')); define ('__VIRTUAL_DIRECTORY__', ''); define ('__HTTP_URL__', 'http://xxx.xxx.xxx.xxx'); define ('__SUBDIRECTORY__', '/narro'); define ('__PHP_CLI_PATH__', '/usr/bin/php'); define ('ADMIN_EMAIL_ADDRESS', 'xxx@yyy.com'); ...... define('DB_CONNECTION_1', serialize(array( 'adapter' => 'MySqli5', 'encoding' => 'UTF8', 'server' => 'localhost', 'port' => null, 'database' => 'narro', 'username' => 'narro', 'password' => 'narro', 'profiling' => false))); ......

Install database script

# mysql -u narro narro < /var/www/narro/narro.sql

Modify permission

# chmod -R 777 /var/www/narro/data # chmod -R 777 /var/www/narro/locale

Restart httpd service

# service httpd restart

Access Narro web page

http://xxx.xxx.xxx.xxx/narro

Note: The first account will get super powers.

Create one new language

Chinese Simplified

Create one new project

sandbox

Setup the project

Go to manage the project as admin, import project with the archive file (*.tar.gz, *.zip)

e.g. sandbox.zip (two directories, en-US and zh-CN)

|- en-US - messages.po |- zh-CN

e.g. messages.po (one file to be transferred)

...... msgid "%1$s created platform %2$s" msgstr "%1$s 新增了平台 %2$s" ......

Refer to: http://code.google.com/p/narro/source/browse/narro/INSTALL

Permalink | Leave a comment »

Howto: Update php 5.1 to 5.2 in CentOS 5

Tue, 09 Nov 2010 06:54:04 -0800

使用yum升级php

# uname -a Linux hzserver2 2.6.18-8.el5 #1 SMP Fri Jan 26 14:15:21 EST 2007 i686 i686 i386 GNU/Linux # cat /etc/yum.repos.d/CentOS-Testing.repo [c5-testing] name=CentOS-5 Testing #baseurl=http://dev.centos.org/centos/$releasever/testing/$basearch/ baseurl=http://dev.centos.org/centos/5/testing/i386/ enabled=1 gpgcheck=1 gpgkey=http://dev.centos.org/centos/RPM-GPG-KEY-CentOS-testing includepkgs=php* # yum update php

Refer to: PHP 5.1 To 5.2

Permalink | Leave a comment »

选择在线协作翻译平台

Tue, 09 Nov 2010 05:23:00 -0800

主要平台主要有三类：第一类：专业协同翻译平台。以Launchpad.net为代表，另外还有Narro，py3k.cn。

https://launchpad.net 适用于互联网翻译 http://code.google.com/p/narro/ 适用于自己构建网站，互联网，企业和个人 http://djangobook.py3k.cn/ 程序员 http://www.transifex.net/ 提供服务 & http://www.transifex.org/ 开源软件适用于自己构建网站，程序员

第二类：Wiki网站。以Wikipedia（维基百科）为代表。

MediaWiki MoinMoin 参考：Wiki软件比较

第三类：在线办公套件。以Google Docs为代表。 Refer to: 中文协作翻译平台的选择 - Translation Platform Selection

Permalink | Leave a comment »

美丽的青海湖

Mon, 01 Nov 2010 07:12:19 -0700

十一的时候去了青海湖，美丽而宁静。

最佳的旅游时间是七八月份，十一以后就没人了，听说我们刚走就下雪了。

Permalink | Leave a comment »

Howto: 创建和使用个人图床

Wed, 13 Oct 2010 05:48:04 -0700

在博客中有几种方法可以使用尽可能久的图片： 使用免费的图床 Yahoo flickr: http://www.flickr.com/ --- wp flickr plutin: WordPress Flickr Manager Google picasa: http://picasaweb.google.com/ --- wp picasa plutin: GoldenGate MicroSoft: http://skydrive.live.com 原则：不用国内的，不用小公司的；缺点：可能被封杀； 利用自己的空间创建图床 使用WordPress插件搭建: NextGEN Gallery

简介：NextGEN Gallery is a full integrated Image Gallery plugin for WordPress with a slideshow option.

使用开源软件搭建: CF Image Hosting Script v1.3

简介：CF Image Hosting是简单好用的图床源码，不需要数据库。在提供图片外链方面相当强大，各种大小的缩略图，完整图片的链接。适合论坛的适合博客的应有尽有。多国语言版本，包含简体中文。

原则：开源，免费，图床使用独立域名好转移；缺点：占用空间带宽，怕盗链； Refer to: 搭建了一个图片库推荐2个WordPress图片上传到Flickr和Picasa的插件 50个免费的相册程序

Permalink | Leave a comment »

Howto: Installation & Config Cacti & Nagios

Tue, 28 Sep 2010 05:18:56 -0700

OS: Redhat AS 5 # uname -a Linux hzserver2 2.6.18-8.el5 #1 SMP Fri Jan 26 14:15:21 EST 2007 i686 i686 i386 GNU/Linux Installation # yum install net-snmp net-snmp-utils # yum install mrtg # yum install cacti # yum install nagios nagios-devel nagios-plugins nagios-plugins-all Cacti Configuration # mysql -u root -p -e 'create database cacti' # mysql -u root -p mysql> GRANT ALL ON cacti.* TO cacti@localhost IDENTIFIED BY 'zYn95ph43zYtq'; mysql> FLUSH privileges; mysql> \q # rpm -ql cacti | grep cacti.sql /usr/share/doc/cacti-0.8.7f/cacti.sql # mysql -u cacti -p cacti /dev/null 2>&1 Run Cacti installer http://xxx.xxx.xxx.xxx/cacti/ username: admin password: cacti Refer to: Nagios在线帮助中文版 RedHat / CentOS Install and Configure Cacti Network Graphing Tool

Permalink | Leave a comment »

Howto: sysstat - 系统状态查看工具

Sat, 25 Sep 2010 03:05:27 -0700

sysstat软件包包括以下工具：

iostat 工具提供CPU使用率及硬盘吞吐效率的数据； mpstat 工具提供单个处理器或多个处理器相关数据； sar 工具负责收集、报告并存储系统活跃的信息； sa1 工具负责收集并存储每天系统动态信息到一个二进制的文件中。它是通过计划任务工具cron来运行，是为sadc所设计的程序前端程序； sa2 工具负责把每天的系统活跃性息写入总结性的报告中。它是为sar所设计的前端，要通过cron来调用 sadc 是系统动态数据收集工具，收集的数据被写一个二进制的文件中，它被用作sar工具的后端； sadf 显示被sar通过多种格式收集的数据；

Installation


# yum install sysstat

Refer to: 系统状态查看工具Sysstat

Permalink | Leave a comment »

Howto: install & config Samba

Tue, 21 Sep 2010 08:33:01 -0700

OS Linux server1 2.6.18-8.el5 #1 SMP Fri Jan 26 14:15:21 EST 2007 i686 i686 i386 GNU/Linux Samba version # rpm -qa |grep samba samba-common-3.0.23c-2 system-config-samba-1.2.39-1.el5 samba-client-3.0.23c-2 Configuration Samba configuration directory: # ls /etc/samba lmhosts secrets.tdb smb.conf smbpasswd smbusers User management of Samba: # smbpasswd -h When run by root: smbpasswd [options] [username] otherwise: smbpasswd [options] options: -L local mode (must be first option) -h print this usage message -s use stdin for password prompt -c smb.conf file Use the given path to the smb.conf file -D LEVEL debug level -r MACHINE remote machine -U USER remote username extra options when run by root or in local mode: -a add user -d disable user -e enable user -i interdomain trust account -m machine trust account -n set no password -W use stdin ldap admin password -w PASSWORD ldap admin password -x delete user -R ORDER name resolve order Add user (user must be existed in Linux): # smbpasswd -a test Modify user password: # smbpasswd test Configuration file smb.conf ...... workgroup = WORKGROUP ...... security = user ...... hosts allow = 192.168.1. 192.168.2. 127. ...... [homes] comment = Home Directories browseable = no writable = yes [projects] comment = Projects of xxx path = /projects public = yes browseable = yes writable = yes write list = @project_group force create mode = 0774 create mode = 0774 force directory mode = 0774 directory mode = 0774 Share the directories to one group member Add one group: # groupadd -g gid project_group Add user to the same group: # useradd -G project_group user_name Windows client to remove the link of Samba List all net links: C:\Documents and Settings\Administrator>net use OK \\xxx.xxx.xxx.xxx\IPC$ Microsoft Windows Network Remove Samba link: C:\Documents and Settings\Administrator>net use \\xxx.xxx.xxx.xxx\IPC$ /del 在与 \\xxx.xxx.xxx.xxx\IPC$ 的连接中，有打开的文件和/或没有结束的目录搜索。是否继续断开连接并强行关闭? (Y/N) [N]: y \\xxx.xxx.xxx.xxx\IPC$ 已经删除。 Refer to The Official Samba 3.5.x HOWTO and Reference Guide SAMBA配置详解一步一学Linux与Windows 共享文件Samba

Permalink | Leave a comment »