tag:blogger.com,1999:blog-56655388816708420612012-05-20T18:06:30.487+09:00チラ裏☆彡 python 関連はバージョン 2.6 か 2.7 を前提にMASAKI Asatonoreply@blogger.comBlogger68125tag:blogger.com,1999:blog-5665538881670842061.post-53588174979356967592012-05-20T18:06:00.000+09:002012-05-20T18:06:30.498+09:002012-05-20T18:06:30.498+09:00CentOS 6.x に supervisord と jenkins を導入したきろく<br /> <h2>supervisord のインストールと設定ファイルの作成</h2> <script type='syntaxhighlighter' class='brush:bash'><![CDATA[ [asato@localhost ~]$ sudo yum install python-setuptools [asato@localhost ~]$ sudo easy_install supervisor [asato@localhost ~]$ sudo echo_supervisord_conf > /etc/supervisord.conf ]]></script> <h2>設定ファイルの編集</h2> <script type='syntaxhighlighter' class='brush: bash'><![CDATA[ # /etc/supervisord.conf ; Sample supervisor config file. -- snip -- [supervisord] logfile=/var/log/supervisord.log ; (main log file;default $CWD/supervisord.log) logfile_maxbytes=50MB ; (max main logfile bytes b4 rotation;default 50MB) logfile_backups=10 ; (num of main logfile rotation backups;default 10) loglevel=info ; (log level;default info; others: debug,warn,trace) pidfile=/var/run/supervisord.pid ; (supervisord pidfile;default supervisord.pid) -- snip -- [include] files = /etc/supervisord/*.ini ]]></script> <h2>supervisord の upstart 用設定の作成</h2> <script type='syntaxhighlighter' class='brush: bash'><![CDATA[ # /etc/init/supervisord.conf description 'supervisord' start on [2345] stop on [!2345] respawn exec /usr/bin/supervisord -n ]]></script> <h2>もろもろのディレクトリ作成と jdk, jenkins の導入</h2> <script type='syntaxhighlighter' class='brush:bash'><![CDATA[ [asato@localhost ~]$ sudo mkdir /etc/supervisord/ [asato@localhost ~]$ sudo mkdir /usr/bin/jenkins [asato@localhost ~]$ sudo touch /var/log/supervisord.log [asato@localhost ~]$ sudo rpm -ivh jdk-7u4-linux-x64.rpm [asato@localhost ~]$ cd /usr/bin/jenkins [asato@localhost ~]$ sudo wget http://mirrors.jenkins-ci.org/war/latest/jenkins.war ]]></script> <h2>jenkins の supervisord 用設定ファイル</h2> <script type='syntaxhighlighter' class='brush:bash'><![CDATA[ # /etc/supervisord/jenkins.ini [program:jenkins] command=/usr/bin/java -jar /usr/jenkins/jenkins.war directory=/usr/jenkins user=root stdout_logfile_maxbytes=10MB stderr_logfile_maxbytes=10MB stdout_logfile=/tmp/jenkins_stdout stderr_logfile=/tmp/jenkins_stderr autostart=true autorestart=true ]]></script> <h2>supervisord の起動</h2> <script type='syntaxhighlighter' class='brush: bash'><![CDATA[ [asato@localhost ~]$ sudo initctl start supervisord ]]></script><div class="blogger-post-footer"><img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/5665538881670842061-5358817497935696759?l=blog.j4f.jp' alt='' /></div> <p><a href="http://feedads.g.doubleclick.net/~a/Ij0nGmqVe10wVeXFwqvfUAE6CB8/0/da"><img src="http://feedads.g.doubleclick.net/~a/Ij0nGmqVe10wVeXFwqvfUAE6CB8/0/di" border="0" ismap="true"></img></a><br/> <a href="http://feedads.g.doubleclick.net/~a/Ij0nGmqVe10wVeXFwqvfUAE6CB8/1/da"><img src="http://feedads.g.doubleclick.net/~a/Ij0nGmqVe10wVeXFwqvfUAE6CB8/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/j4f/oeuE/~4/fR1HDK9dbR8" height="1" width="1"/>MASAKI Asatonoreply@blogger.com0http://blog.j4f.jp/2012/05/centos-6x-supervisord-jenkins.htmltag:blogger.com,1999:blog-5665538881670842061.post-14619408340607431652012-05-20T17:35:00.000+09:002012-05-20T17:39:29.557+09:002012-05-20T17:39:29.557+09:00boto 2.4.1 のソースをざっと見た。設定ファイルには以下の値を書いておける<br /> <script type='syntaxhighlighter' class='brush:python'><![CDATA[ # ~/.boto - for user-specific settings # /etc/boto.cfg - for site-wide settings that all users on this machine will use [Credentials] aws_access_key_id = <your access key> aws_secret_access_key = <your secret key> [Boto] debug = # デバッグレベル 0-2 num_retries = # リトライ回数 proxy = # プロキシ proxy_port = proxy_user = proxy_pass = # EC2 ec2_region_name = ec2_region_endpoint = # autoscale autoscale_endpoint = autoscale_region_name = # ELB elb_region_name = elb_region_endpoint = # CloudWatch cloudwatch_region_name = cloudwatch_region_endpoint = # ElasticMapReduce emr_region_name = emr_region_endpoint = # CloudFormation cfn_region_name = cfn_region_endpoint = # CloudSearch cs_region_name = cs_region_endpoint = [DynamoDB] region = [SDB] region = [DB] # SDB 関連の設定値のはずだけどなぜか section が別になってる? debug = db_name = db_user = db_passwd = db_type = db_table = db_host = db_port = enable_ssl = sql_dir = [SWF] region = ]]></script> それぞれのリージョン名とかエンドポイント名は<a href="http://docs.amazonwebservices.com/general/latest/gr/rande.html">ここ</a>で確認<br /> 設定ファイルで指定してあげればそれぞれのサービスのデフォルトの接続先が 'us-east-1' から変更される。 S3 とか RDS はなんで設定ファイル見るようになってないのかな<br /> まだ、全部試してないけど問題ないはず。。。。<br /> <br /> <br /> Pyami 関連は何するものかわかんないので省いています。<br /><div class="blogger-post-footer"><img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/5665538881670842061-1461940834060743165?l=blog.j4f.jp' alt='' /></div> <p><a href="http://feedads.g.doubleclick.net/~a/5WCoxetsORJXj09oVHL1H-CN66s/0/da"><img src="http://feedads.g.doubleclick.net/~a/5WCoxetsORJXj09oVHL1H-CN66s/0/di" border="0" ismap="true"></img></a><br/> <a href="http://feedads.g.doubleclick.net/~a/5WCoxetsORJXj09oVHL1H-CN66s/1/da"><img src="http://feedads.g.doubleclick.net/~a/5WCoxetsORJXj09oVHL1H-CN66s/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/j4f/oeuE/~4/o4c_ak3C2pk" height="1" width="1"/>MASAKI Asatonoreply@blogger.com0http://blog.j4f.jp/2012/05/boto-config.htmltag:blogger.com,1999:blog-5665538881670842061.post-30299548394667800902012-05-18T19:18:00.000+09:002012-05-18T19:18:45.806+09:002012-05-18T19:18:45.806+09:00boto の rds のインターフェースのドキュメントは API リファレンスくらいしか用意されてなくて、その API リファレンスも sphinx でうまくビルドできないのでソース見ながらいろいろとやった<br /> <h2>rds インスタンスの作成</h2> <script type='syntaxhighlighter' class='brush: python'><![CDATA[ >>> import boto.rds >>> boto.rds.regions() # 使用可能なりーきょんの確認 [RegionInfo:us-east-1, RegionInfo:eu-west-1, RegionInfo:us-west-1, RegionInfo:us-west-2, RegionInfo:sa-east-1, RegionInfo:ap-northeast-1, RegionInfo:ap-southeast-1] >>> conndb = boto.rds.connect_to_region('ap-northeast-1') # 東京リージョンに接続 >>> print conndb RDSConnection:rds.ap-northeast-1.amazonaws.com >>> req = conndb.create_dbinstance( ... id='mydb1', # 作成するインスタンスの名前 ... allocated_storage=5, # ストレージのサイズ GB 単位() ... instance_class='db.m1.small', # インスタンスのクラス ... engine='MySQL5.1', # 現在は MySQL5.1 のみの対応っぽい ... master_username='asato', # 作成するユーザ名 ... master_password='databasepassword', # 作成するユーザのパスワード ... port=3306, # mysql が listen するポート ... db_name='myFirstDatabase', # 作成するデータベースの名前。指定しなければデータベースは作られないので後で別途作成する必要がある ... param_group='myparamgroupname', # パラメータグループの名前 ... security_groups=['default'], # 適用するセキュリティグループの名前 ... multi_az=False, # マルチアベイラリティゾーンの有効/無効 boolean で指定 ... engine_version='5.1.62', # データベースのエンジンのバージョン ... auto_minor_version_upgrade=True) # マイナーバージョンが上がった時に自動でアップグレードするかどうか send: 'GET /?AWSAccessKeyId=HogeHogeHoge&Action=CreateDBInstance&AllocatedStorage=5&AutoMinorVersionUpgrade=true&DBInstanceClass=db.m1.small&DBInstanceIdentifier=mydb1&DBName=myFirstDatabase&DBParameterGroupName=myparamgroupname&DBSecurityGroups.member.1=default&Engine=MySQL5.1&EngineVersion=5.1.62&MasterUserPassword=databasepassword&MasterUsername=asato&MultiAZ=false&Port=3306&SignatureMethod=HmacSHA256&SignatureVersion=2&Timestamp=2012-05-18T09%3A26%3A18Z&Version=2011-04-01&Signature=HogeHageHogeHageHogeHage HTTP/1.1\r\nHost: rds.ap-northeast-1.amazonaws.com\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nUser-Agent: Boto/2.4.1 (linux2)\r\n\r\n' reply: 'HTTP/1.1 200 OK\r\n' header: x-amzn-RequestId: 8602efa0-a0cb-11e1-80bb-d9be177606a9 header: Content-Type: text/xml header: Content-Length: 1618 header: Date: Fri, 18 May 2012 09:26:18 GMT >>> conndb.get_all_dbinstances() send: 'GET /?AWSAccessKeyId=HogeHogeHoge&Action=DescribeDBInstances&SignatureMethod=HmacSHA256&SignatureVersion=2&Timestamp=2012-05-18T09%3A26%3A59Z&Version=2011-04-01&Signature=HogeHageHogeHageHogeHage HTTP/1.1\r\nHost: rds.ap-northeast-1.amazonaws.com\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nUser-Agent: Boto/2.4.1 (linux2)\r\n\r\n' reply: 'HTTP/1.1 200 OK\r\n' header: x-amzn-RequestId: 9e30831a-a0cb-11e1-8e49-3b33a03f00bb header: Content-Type: text/xml header: Content-Length: 1792 header: Date: Fri, 18 May 2012 09:26:59 GMT [DBInstance:mydb1] ]]></script> <h2>リードレプリカの作成</h2> <script type='syntaxhighlighter' class='brush: python'><![CDATA[ >>> rep = conndb.create_dbinstance_read_replica( ... id='mydb1-read', # 作成するインスタンスの名前 ... source_id='mydb1', # もとになる rds インスタンスの名前 ... instance_class='db.m1.small', ... port=3306, ... auto_minor_version_upgrade=True) send: 'GET /?AWSAccessKeyId=HogeHogeHoge&Action=CreateDBInstanceReadReplica&AutoMinorVersionUpgrade=true&DBInstanceClass=db.m1.small&DBInstanceIdentifier=mydb1-read&Port=3306&SignatureMethod=HmacSHA256&SignatureVersion=2&SourceDBInstanceIdentifier=mydb1&Timestamp=2012-05-18T09%3A34%3A49Z&Version=2011-04-01&Signature=HogeHageHogeHageHogeHage HTTP/1.1\r\nHost: rds.ap-northeast-1.amazonaws.com\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nUser-Agent: Boto/2.4.1 (linux2)\r\n\r\n' reply: 'HTTP/1.1 200 OK\r\n' header: x-amzn-RequestId: b6ebba80-a0cc-11e1-80bb-d9be177606a9 header: Content-Type: text/xml header: Content-Length: 1674 header: Date: Fri, 18 May 2012 09:34:50 GMT >>> conndb.get_all_dbinstances() # 確認 send: 'GET /?AWSAccessKeyId=HogeHogeHoge&Action=DescribeDBInstances&SignatureMethod=HmacSHA256&SignatureVersion=2&Timestamp=2012-05-18T09%3A35%3A14Z&Version=2011-04-01&Signature=HogeHageHogeHageHogeHage HTTP/1.1\r\nHost: rds.ap-northeast-1.amazonaws.com\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nUser-Agent: Boto/2.4.1 (linux2)\r\n\r\n' reply: 'HTTP/1.1 200 OK\r\n' header: x-amzn-RequestId: c5b85537-a0cc-11e1-a3b6-e3abe3d1e1e3 header: Content-Type: text/xml header: Content-Length: 3484 header: Date: Fri, 18 May 2012 09:35:14 GMT [DBInstance:mydb1, DBInstance:mydb1-read] # mydb1-read が、ちゃんと作成されていることが確認できる ]]></script> <h2>rds インスタンスの削除</h2> rds の場合は ec2 でいう stop ができないみたい。再起動はできるけど <script type='syntaxhighlighter' class='brush: python'><![CDATA[ >>> conndb.delete_dbinstance('mydb1-read',skip_final_snapshot=True) send: 'GET /?AWSAccessKeyId=HogeHogeHoge&Action=DeleteDBInstance&DBInstanceIdentifier=mydb1-read&SignatureMethod=HmacSHA256&SignatureVersion=2&SkipFinalSnapshot=true&Timestamp=2012-05-18T09%3A49%3A06Z&Version=2011-04-01&Signature=HogeHageHogeHageHogeHage HTTP/1.1\r\nHost: rds.ap-northeast-1.amazonaws.com\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nUser-Agent: Boto/2.4.1 (linux2)\r\n\r\n' reply: 'HTTP/1.1 200 OK\r\n' header: x-amzn-RequestId: b5273c20-a0ce-11e1-80c9-9b3aec753c46 header: Content-Type: text/xml header: Content-Length: 1906 header: Date: Fri, 18 May 2012 09:49:05 GMT DBInstance:mydb1-read >>> conndb.get_all_dbinstances() # 削除されたか確認 send: 'GET /?AWSAccessKeyId=HogeHogeHoge&Action=DescribeDBInstances&SignatureMethod=HmacSHA256&SignatureVersion=2&Timestamp=2012-05-18T09%3A56%3A20Z&Version=2011-04-01&Signature=HogeHageHogeHageHogeHage HTTP/1.1\r\nHost: rds.ap-northeast-1.amazonaws.com\r\nAccept-Encoding: identity\r\nContent-Length: 0\r\nUser-Agent: Boto/2.4.1 (linux2)\r\n\r\n' reply: 'HTTP/1.1 200 OK\r\n' header: x-amzn-RequestId: b8812072-a0cf-11e1-9ce6-251b1a1198bb header: Content-Type: text/xml header: Content-Length: 2001 header: Date: Fri, 18 May 2012 09:56:21 GMT [DBInstance:mydb1] # ちゃんと削除された ]]></script><div class="blogger-post-footer"><img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/5665538881670842061-3029954839466780090?l=blog.j4f.jp' alt='' /></div> <p><a href="http://feedads.g.doubleclick.net/~a/e_TVGcch940DPPjgN3LJy-cEqco/0/da"><img src="http://feedads.g.doubleclick.net/~a/e_TVGcch940DPPjgN3LJy-cEqco/0/di" border="0" ismap="true"></img></a><br/> <a href="http://feedads.g.doubleclick.net/~a/e_TVGcch940DPPjgN3LJy-cEqco/1/da"><img src="http://feedads.g.doubleclick.net/~a/e_TVGcch940DPPjgN3LJy-cEqco/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/j4f/oeuE/~4/JjQKytDVLbg" height="1" width="1"/>MASAKI Asatonoreply@blogger.com0http://blog.j4f.jp/2012/05/boto-rds.htmltag:blogger.com,1999:blog-5665538881670842061.post-20112506646008062572012-05-18T14:58:00.000+09:002012-05-18T14:58:53.273+09:002012-05-18T14:58:53.273+09:00<h2>インスタンスの作成</h2> どんなリクエストをなげて、どんなレスポンスが返って来ているのか確認するために boto のデバッグレベルを 2 にしてあります。 <script type='syntaxhighlighter' class='brush:python'><![CDATA[ >>> import boto >>> conn = boto.connect_ec2() >>> req = conn.run_instances( ... 'ami-e47acbe5', # AMI ID ... key_name='awskey', # key pair ... instance_type='t1.micro', # インスタンスのタイプ ... security_groups=['default']) # セキュリティグループ send: 'POST / HTTP/1.1\r\nHost: ec2.ap-northeast-1.amazonaws.com\r\nAccept-Encoding: identity\r\nContent-Length: 316\r\nContent-Type: application/x-www-form-urlencoded; charset=UTF-8\r\nUser-Agent: Boto/2.4.1 (linux2)\r\n\r\n' send: 'AWSAccessKeyId=hagehogehagehoge&Action=RunInstances&ImageId=ami-e47acbe5&InstanceType=t1.micro&KeyName=awskey&MaxCount=1&MinCount=1&SecurityGroup.1=default&SignatureMethod=HmacSHA256&SignatureVersion=2&Timestamp=2012-05-18T05%3A07%3A10Z&Version=2012-03-01&Signature=hogehogehogehogehogehogehoge' reply: 'HTTP/1.1 200 OK\r\n' header: Content-Type: text/xml;charset=UTF-8 header: Transfer-Encoding: chunked header: Date: Fri, 18 May 2012 05:07:11 GMT header: Server: AmazonEC2 >>> print req.instances # 起動されたインスタンスの ID を確認 [Instance:i-a54f27a5] ]]></script> run_instances() に placement='アベイラリティゾーン名' のオプションを渡せばインスタンスが起動するアベイラリティゾーンを指定することも可能。指定がない場合は適当なゾーンが指定されるみたい。<br /> <h2>インスタンスの停止と起動</h2> 停止したインスタンスはまた起動してやれば使える。複数のインスタンスを停止したい場合は .stop_instances(instance_ids=['instance1-id','instance2-id','instance3-id']) な感じで <script type='syntaxhighlighter' class='brush: python'><![CDATA[ >>> conn.stop_instances(instance_ids=['i-a54f27a5']) send: 'POST / HTTP/1.1\r\nHost: ec2.ap-northeast-1.amazonaws.com\r\nAccept-Encoding: identity\r\nContent-Length: 241\r\nContent-Type: application/x-www-form-urlencoded; charset=UTF-8\r\nUser-Agent: Boto/2.4.1 (linux2)\r\n\r\n' send: 'AWSAccessKeyId=hagehogehagehoge&Action=StopInstances&InstanceId.1=i-a54f27a5&SignatureMethod=HmacSHA256&SignatureVersion=2&Timestamp=2012-05-18T05%3A31%3A46Z&Version=2012-03-01&Signature=hogehogehogehogehogehogehoge' reply: 'HTTP/1.1 200 OK\r\n' header: Content-Type: text/xml;charset=UTF-8 header: Transfer-Encoding: chunked header: Date: Fri, 18 May 2012 05:31:45 GMT header: Server: AmazonEC2 [Instance:i-a54f27a5] >>> conn.start_instances(instance_ids=['i-a54f27a5']) # 停止したインスタンスの起動 ]]></script> <h2>インスタンスの終了</h2> 終了したインスタンスは再利用できない。インスタンスの停止と同じように複数のインスタンスを終了することもできる。 <script type='syntaxhighlighter' class='brush:python'><![CDATA[ >>> conn.terminate_instances(instance_ids=['i-i-a54f27a5']) send: 'POST / HTTP/1.1\r\nHost: ec2.ap-northeast-1.amazonaws.com\r\nAccept-Encoding: identity\r\nContent-Length: 244\r\nContent-Type: application/x-www-form-urlencoded; charset=UTF-8\r\nUser-Agent: Boto/2.4.1 (linux2)\r\n\r\n' send: 'AWSAccessKeyId=hagehogehagehoge&Action=TerminateInstances&InstanceId.1=i-a54f27a5&SignatureMethod=HmacSHA256&SignatureVersion=2&Timestamp=2012-05-18T05%3A34%3A45Z&Version=2012-03-01&Signature=hogehogehogehogehogehogehoge' reply: 'HTTP/1.1 200 OK\r\n' header: Content-Type: text/xml;charset=UTF-8 header: Transfer-Encoding: chunked header: Date: Fri, 18 May 2012 05:34:45 GMT header: Server: AmazonEC2 [Instance:i-a54f27a5] ]]></script> <br /><div class="blogger-post-footer"><img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/5665538881670842061-2011250664600806257?l=blog.j4f.jp' alt='' /></div> <p><a href="http://feedads.g.doubleclick.net/~a/v4ctc_-3hOxjya-zEP778CbUv-8/0/da"><img src="http://feedads.g.doubleclick.net/~a/v4ctc_-3hOxjya-zEP778CbUv-8/0/di" border="0" ismap="true"></img></a><br/> <a href="http://feedads.g.doubleclick.net/~a/v4ctc_-3hOxjya-zEP778CbUv-8/1/da"><img src="http://feedads.g.doubleclick.net/~a/v4ctc_-3hOxjya-zEP778CbUv-8/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/j4f/oeuE/~4/5NMYZTlRa4w" height="1" width="1"/>MASAKI Asatonoreply@blogger.com0http://blog.j4f.jp/2012/05/boto-ec2_18.htmltag:blogger.com,1999:blog-5665538881670842061.post-48072753587293234252012-05-18T01:02:00.000+09:002012-05-18T01:02:00.442+09:002012-05-18T01:02:00.442+09:00<a href="http://blog.j4f.jp/2012/05/blog-post.html">前回</a>は python のビルトインの関数だけだったので nltk.text の関数も使ってみる。 <h2>単語の検索</h2> <script type='syntaxhighlighter' class='brush: python'><![CDATA[ >>> from nltk.book import * *** Introductory Examples for the NLTK Book *** Loading text1, ..., text9 and sent1, ..., sent9 Type the name of the text or sentence to view it. Type: 'texts()' or 'sents()' to list the materials. text1: Moby Dick by Herman Melville 1851 text2: Sense and Sensibility by Jane Austen 1811 text3: The Book of Genesis text4: Inaugural Address Corpus text5: Chat Corpus text6: Monty Python and the Holy Grail text7: Wall Street Journal text8: Personals Corpus text9: The Man Who Was Thursday by G . K . Chesterton 1908 >>> text6.concordance('spam') # Monty Python and the Holy Grail から 'spam' の単語を検索 Building index... Displaying 1 of 1 matches: # まぁ、アーサー王の話だし 1つしか見つからないのは当たり前か in Camelot . We eat ham and jam and spam a lot [ dancing ] We ' re knights of >>> text6.concordance('silly') # じゃあ 'silly' はどうなんだろと Displaying 8 of 8 matches: # 8つ見つかった let ' s not go to Camelot . It is a silly place . KNIGHTS : Right . Right SCEN I have this outrageous accent , you silly king - a ?! GALAHAD : What are you d Go and boil your bottom , sons of a silly person . I blow my nose at you , so alled Arthur King , you and all your silly English k - nnnnniggets . Thpppppt ! IM : It is the rabbit ! ARTHUR : You silly sod ! TIM : What ? ARTHUR : You got . Chop his head off ! BORS : Right ! Silly little bleeder . One rabbit stew com ut - clever us French folk with your silly knees - bent running about advancing d call your door - opening request a silly thing , you tiny - brained wipers of ]]></script> <!--- more ---> Text.concordance() は前後の文章とあわせて表示してくれるけど純粋に単語がいくつ含まれるか知りたい場合は Text.count() をつかえばいいみたいだけど、大文字と小文字区別する <script type='syntaxhighlighter' class='brush: python'><![CDATA[ >>> text6.count('silly') 7 >>> text6.count('Silly') 1 ]]></script> <a href="http://ja.wikipedia.org/wiki/%E9%80%A3%E8%AA%9E">連語</a>を抽出 <script type='syntaxhighlighter' class='brush:python'><![CDATA[ >>> text6.collocations() Building collocations list BLACK KNIGHT; HEAD KNIGHT; Holy Grail; FRENCH GUARD; Sir Robin; Run away; CARTOON CHARACTER; King Arthur; Iesu domine; Pie Iesu; DEAD PERSON; Round Table; OLD MAN; dramatic chord; dona eis; eis requiem; LEFT HEAD; FRENCH GUARDS; music stops; Sir Launcelot >>> text6.collocations(num=30) # num を指定しないと、最初の 20 しか表示されないのでそれ以上見たい場合はこんな感じで Building collocations list BLACK KNIGHT; HEAD KNIGHT; Holy Grail; FRENCH GUARD; Sir Robin; Run away; CARTOON CHARACTER; King Arthur; Iesu domine; Pie Iesu; DEAD PERSON; Round Table; OLD MAN; dramatic chord; dona eis; eis requiem; LEFT HEAD; FRENCH GUARDS; music stops; Sir Launcelot; MIDDLE HEAD; RIGHT HEAD; Sir Galahad; angels sing; Arthur music; Hand Grenade; Three questions; Heh heh; brave Sir; make sure ]]></script> 正規表現が使える Text.findall() <script type='syntaxhighlighter' class='brush:python'><![CDATA[ >>> text6.findall("<a.*>{3,}") # a から始まる単語が3回連続で使われているところを抽出 act as a; at all afraid; and argue about; and anchovies and ]]></script> text6 に含まれる単語をつかって、それっぽい文章の生成 <script type='syntaxhighlighter' class='brush:python'><![CDATA[ >>> text6.generate() Building ngram index... SCENE 1 : Right . How many did we lose ? LAUNCELOT : Farewell , sweet Concorde ! CONCORDE : No one live there . ARTHUR : Well , u -- um , riding north from Camelot , a swallow ' s no ordinary rabbit . ARTHUR : If you do doubt your courage or your strength , come no further , for beyond the cave of Caerbannog -- wherein , carved in the van . OFFICER # 1 : Get on with it thou mayest blow thine enemies to tiny bits , in which Arthur discovers a vital clue ]]></script><div class="blogger-post-footer"><img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/5665538881670842061-4807275358729323425?l=blog.j4f.jp' alt='' /></div> <p><a href="http://feedads.g.doubleclick.net/~a/loX37cgNXdY3LsD2U-xguv6v4CM/0/da"><img src="http://feedads.g.doubleclick.net/~a/loX37cgNXdY3LsD2U-xguv6v4CM/0/di" border="0" ismap="true"></img></a><br/> <a href="http://feedads.g.doubleclick.net/~a/loX37cgNXdY3LsD2U-xguv6v4CM/1/da"><img src="http://feedads.g.doubleclick.net/~a/loX37cgNXdY3LsD2U-xguv6v4CM/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/j4f/oeuE/~4/bFrLjbOVRZw" height="1" width="1"/>MASAKI Asatonoreply@blogger.com0http://blog.j4f.jp/2012/05/nltktext.htmltag:blogger.com,1999:blog-5665538881670842061.post-10594622242040529162012-05-18T00:00:00.000+09:002012-05-18T00:00:50.403+09:002012-05-18T00:00:50.403+09:00<a href="http://www.cloud-japan.jp/CLOUDJAPAN/Venue-and-Date/">先日のクラウドコンピューティング Expo</a> の<a href="http://classmethod.jp/">クラスメソッド</a>さんのブースでガチャ回したら、 <a href="http://classmethod.jp/service/voucher/">aws の1万円分のバウチャーチケット</a>もらった。<br /> なので、前から試したかった<a href="https://github.com/boto/boto">boto</a> で、いろいろやってます<br /> <h2>EC2 に接続</h2> <script type='syntaxhighlighter' class='brush:python'><![CDATA[ >>> import boto >>> conn = boto.connect_ec2('<AWS_ACCESS_KEY_ID>', '<AWS_SECRET_ACCESS_KEY>') >>> conn EC2Connection:ec2.us-east-1.amazonaws.com ]]></script> 標準だと 'us-east-1' に接続されるんだね<br /> どうやって接続先のリージョンかえるんだろと思ってドキュメントみたけど見つけらんなかったのでソース(boto/ec2/connection.py)みた <script type='syntaxhighlighter' class='brush:python'><![CDATA[ -- snip -- if not region: region = RegionInfo(self, self.DefaultRegionName, proxy=None, proxy_port=None, proxy_user=None, proxy_pass=None, debug=0, https_connection_factory=None, region=None, path='/', api_version=None, security_token=None): """ Init method to create a new connection to EC2. """ if not region: region = RegionInfo(self, self.DefaultRegionName, self.DefaultRegionEndpoint) self.region = region AWSQueryConnection.__init__(self, aws_access_key_id, aws_secret_access_key, is_secure, port, proxy, proxy_port, proxy_user, proxy_pass, self.region.endpoint, debug, https_connection_factory, path, security_token) -- snip -- ]]></script> boto.connect_ec2() にアクセスキーとかと一緒に渡せばいいみたいだけど、毎回書くのは面倒だしどうせ東京リージョンしか使わないので<br /> コンフィグを書いた <script type='syntaxhighlighter' class='brush: python'><![CDATA[ # ~/.boto [Credentials] aws_access_key_id = '<AWS_ACCESS_KEY_ID>' aws_secret_access_key = '<AWS_SECRET_ACCESS_KEY>' [Boto] debug = 0 num_retries = 10 ec2_region_name = 'ap-northeast-1' ec2_region_endpoint = 'ec2.ap-northeast-1.amazonaws.com' ]]></script> ec2_region_name, ec2_region_endpoint は<a href="http://docs.amazonwebservices.com/general/latest/gr/rande.html#ec2_region">ここ</a>で確認した。<br /> ちゃんと接続できるか確認 <script type='syntaxhighlighter' class='brush: php|python|html|css|bash|js'><![CDATA[ >>> conn = boto.connect_ec2() >>> conn EC2Connection:'ec2.ap-northeast-1.amazonaws.com' ]]></script> おｋ<br /> 次回はインスタンスの起動、停止と破棄など<br /><div class="blogger-post-footer"><img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/5665538881670842061-1059462224204052916?l=blog.j4f.jp' alt='' /></div> <p><a href="http://feedads.g.doubleclick.net/~a/hdbU67A-rvbhMrVXHqYelDdT_E8/0/da"><img src="http://feedads.g.doubleclick.net/~a/hdbU67A-rvbhMrVXHqYelDdT_E8/0/di" border="0" ismap="true"></img></a><br/> <a href="http://feedads.g.doubleclick.net/~a/hdbU67A-rvbhMrVXHqYelDdT_E8/1/da"><img src="http://feedads.g.doubleclick.net/~a/hdbU67A-rvbhMrVXHqYelDdT_E8/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/j4f/oeuE/~4/-eeo_5x9AsI" height="1" width="1"/>MASAKI Asatonoreply@blogger.com0http://blog.j4f.jp/2012/05/boto-ec2.htmltag:blogger.com,1999:blog-5665538881670842061.post-67917642664792631332012-05-12T01:57:00.000+09:002012-05-12T02:01:54.202+09:002012-05-12T02:01:54.202+09:00とりあえず<a href="http://blog.j4f.jp/2012/05/ubuntu-nltk.html">前回</a>ダウンロードしたデータで python のビルトインの関数だけを使っていろいろやってみる。<br> <a href="http://blog.j4f.jp/2012/05/blog-post.html#more">もっと読む »</a><div class="blogger-post-footer"><img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/5665538881670842061-6791764266479263133?l=blog.j4f.jp' alt='' /></div> <p><a href="http://feedads.g.doubleclick.net/~a/vJtqeU1-h0BwqRInfb_KBMwj7d0/0/da"><img src="http://feedads.g.doubleclick.net/~a/vJtqeU1-h0BwqRInfb_KBMwj7d0/0/di" border="0" ismap="true"></img></a><br/> <a href="http://feedads.g.doubleclick.net/~a/vJtqeU1-h0BwqRInfb_KBMwj7d0/1/da"><img src="http://feedads.g.doubleclick.net/~a/vJtqeU1-h0BwqRInfb_KBMwj7d0/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/j4f/oeuE/~4/NL1nORRxtk8" height="1" width="1"/>MASAKI Asatonoreply@blogger.com0http://blog.j4f.jp/2012/05/blog-post.htmltag:blogger.com,1999:blog-5665538881670842061.post-17961235708829169082012-05-08T00:46:00.000+09:002012-05-08T00:46:41.333+09:002012-05-08T00:46:41.333+09:00動作が確認出来ればいいだけなのでとりあえず<a href="http://www.tornadoweb.org/documentation/websocket.html">ドキュメント</a>からそのまんまこぴぺ <script type='syntaxhighlighter' class='brush:js'><![CDATA[ var ws = new WebSocket("ws://localhost:8080/"); ws.onopen = function() { ws.send("Hello, world"); }; ws.onmessage = function (evt) { alert(evt.data); }; ]]></script><div class="blogger-post-footer"><img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/5665538881670842061-1796123570882916908?l=blog.j4f.jp' alt='' /></div> <p><a href="http://feedads.g.doubleclick.net/~a/kgz3121XpzXYXwKkHeUJWQhuH6A/0/da"><img src="http://feedads.g.doubleclick.net/~a/kgz3121XpzXYXwKkHeUJWQhuH6A/0/di" border="0" ismap="true"></img></a><br/> <a href="http://feedads.g.doubleclick.net/~a/kgz3121XpzXYXwKkHeUJWQhuH6A/1/da"><img src="http://feedads.g.doubleclick.net/~a/kgz3121XpzXYXwKkHeUJWQhuH6A/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/j4f/oeuE/~4/dSkj_yKx5cU" height="1" width="1"/>MASAKI Asatonoreply@blogger.com0http://blog.j4f.jp/2012/05/websocket-js.htmltag:blogger.com,1999:blog-5665538881670842061.post-38385428476666988642012-05-08T00:27:00.001+09:002012-05-08T00:35:15.611+09:002012-05-08T00:35:15.611+09:00ひとまず <a href="http://www.tornadoweb.org/">tornado</a> でサーバサイドを<a href="http://www.tornadoweb.org/documentation/websocket.html">ドキュメント</a>見ながら書いてみた <script type='syntaxhighlighter' class='brush:python'><![CDATA[ # -*- coding: utf-8 -*- from tornado import ioloop, web, websocket, httpserver class EchoWebSocket(websocket.WebSocketHandler): def open(self): print "WebSocket Opend" def on_message(self, message): self.write_message(u"ウェブソケットのてすと" + message) def on_close(self): print "WebSocket Closed" application = web.Application([ (r'/', EchoWebSocket), ]) if __name__ == '__main__': http_server = httpserver.HTTPServer(application) http_server.listen(8080) ioloop.IOLoop.instance().start() ]]></script><div class="blogger-post-footer"><img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/5665538881670842061-3838542847666698864?l=blog.j4f.jp' alt='' /></div> <p><a href="http://feedads.g.doubleclick.net/~a/oz79ks9yC8H9MwaDK7-FBrgWitw/0/da"><img src="http://feedads.g.doubleclick.net/~a/oz79ks9yC8H9MwaDK7-FBrgWitw/0/di" border="0" ismap="true"></img></a><br/> <a href="http://feedads.g.doubleclick.net/~a/oz79ks9yC8H9MwaDK7-FBrgWitw/1/da"><img src="http://feedads.g.doubleclick.net/~a/oz79ks9yC8H9MwaDK7-FBrgWitw/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/j4f/oeuE/~4/cU6HxLbMrmI" height="1" width="1"/>MASAKI Asatonoreply@blogger.com0http://blog.j4f.jp/2012/05/tornado-websocket.htmltag:blogger.com,1999:blog-5665538881670842061.post-55722611916710511912012-05-07T14:40:00.004+09:002012-05-07T14:40:51.973+09:002012-05-07T14:40:51.973+09:00N・L・P！！N・L・P！！ <br /> 自然言語処理を勉強しようと ubuntu 10.04 へ<a href="http://www.nltk.org/">nltk(Natural Language Toolkit)</a> を導入しためも <script type='syntaxhighlighter' class='brush:bash'><![CDATA[ asato@localhost:~$ sudo aptitude install python-nltk ]]></script> 使えるデータが何もないので nltk のプロジェクトが提供しているデータをダウンロードします。<br /> ここから python のシェルで <script type='syntaxhighlighter' class='brush:python'><![CDATA[ >>> import nltk >>> nltk.download() # 実行するとダウンロードメニューが表示される NLTK Downloader --------------------------------------------------------------------------- d) Download l) List c) Config h) Help q) Quit --------------------------------------------------------------------------- Downloader> l # ダウンロード可能なパッケージ(データ)のリストを確認 Packages: /usr/lib/pymodules/python2.6/nltk/__init__.py:588: DeprecationWarning: object.__new__() takes no parameters [ ] conll2000........... CONLL 2000 Chunking Corpus [ ] conll2002........... CONLL 2002 Named Entity Recognition Corpus [ ] conll2007........... Dependency Treebanks from CoNLL 2007 (Catalan and Basque Subset) [ ] dependency_treebank. Dependency Parsed Treebank [ ] europarl_raw........ Sample European Parliament Proceedings Parallel Corpus [ ] floresta............ Portuguese Treebank [ ] gazetteers.......... Gazeteer Lists [ ] genesis............. Genesis Corpus [ ] gutenberg........... Project Gutenberg Selections [ ] ieer................ NIST IE-ER DATA SAMPLE [ ] inaugural........... C-Span Inaugural Address Corpus [ ] indian.............. Indian Language POS-Tagged Corpus [ ] jeita............... JEITA Public Morphologically Tagged Corpus (in ChaSen format) [ ] kimmo............... PC-KIMMO Data Files [ ] knbc................ KNB Corpus (Annotated blog corpus) [ ] langid.............. Language Id Corpus [ ] mac_morpho.......... MAC-MORPHO: Brazilian Portuguese news text with part-of-speech tags Hit Enter to continue: --- snip --- Collections: [ ] all-corpora......... All the corpora [ ] all................. All packages [ ] book................ Everything used in the NLTK Book ([*] marks installed packages) --------------------------------------------------------------------------- d) Download l) List c) Config h) Help q) Quit --------------------------------------------------------------------------- Downloader> d # d を入力するとダウンロードするパッケージを聞いてくる Download which package (l=list; x=cancel)? Identifier> book # 今回は book コレクションをダウンロード Downloading collection 'book' | | Downloading package 'brown' to /home/asato/nltk_data... | Unzipping corpora/brown.zip. | Downloading package 'chat80' to /home/asato/nltk_data... | Unzipping corpora/chat80.zip. | Downloading package 'cmudict' to /home/asato/nltk_data... | Unzipping corpora/cmudict.zip. | Downloading package 'conll2000' to /home/asato/nltk_data... | Unzipping corpora/conll2000.zip. | Downloading package 'conll2002' to /home/asato/nltk_data... | Unzipping corpora/conll2002.zip. | Downloading package 'dependency_treebank' to --- snip --- | Downloading package 'punkt' to /home/asato/nltk_data... | Unzipping tokenizers/punkt.zip. | Downloading package 'book_grammars' to | /home/asato/nltk_data... | Unzipping grammars/book_grammars.zip. | Downloading package 'tagsets' to /home/asato/nltk_data... | Done downloading collection 'book' --------------------------------------------------------------------------- d) Download l) List c) Config h) Help q) Quit --------------------------------------------------------------------------- Downloader> l # パッケージのリストを確認すると、すでに導入済みのパッケージは * でマークされている。 Packages: [*] conll2000........... CONLL 2000 Chunking Corpus [*] conll2002........... CONLL 2002 Named Entity Recognition Corpus [ ] conll2007........... Dependency Treebanks from CoNLL 2007 (Catalan and Basque Subset) [*] dependency_treebank. Dependency Parsed Treebank [ ] europarl_raw........ Sample European Parliament Proceedings Parallel Corpus [ ] floresta............ Portuguese Treebank [ ] gazetteers.......... Gazeteer Lists [*] genesis............. Genesis Corpus [*] gutenberg........... Project Gutenberg Selections [*] ieer................ NIST IE-ER DATA SAMPLE [*] inaugural........... C-Span Inaugural Address Corpus [ ] indian.............. Indian Language POS-Tagged Corpus [ ] jeita............... JEITA Public Morphologically Tagged Corpus (in --- snip --- ]]></script> とりあえずここまで<div class="blogger-post-footer"><img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/5665538881670842061-5572261191671051191?l=blog.j4f.jp' alt='' /></div> <p><a href="http://feedads.g.doubleclick.net/~a/8zDwpVRK81OQXy2XLwUsQgZt1bg/0/da"><img src="http://feedads.g.doubleclick.net/~a/8zDwpVRK81OQXy2XLwUsQgZt1bg/0/di" border="0" ismap="true"></img></a><br/> <a href="http://feedads.g.doubleclick.net/~a/8zDwpVRK81OQXy2XLwUsQgZt1bg/1/da"><img src="http://feedads.g.doubleclick.net/~a/8zDwpVRK81OQXy2XLwUsQgZt1bg/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/j4f/oeuE/~4/t2Xgjm3ED0Y" height="1" width="1"/>MASAKI Asatonoreply@blogger.com0http://blog.j4f.jp/2012/05/ubuntu-nltk.htmltag:blogger.com,1999:blog-5665538881670842061.post-57048408393168608282012-05-02T10:49:00.001+09:002012-05-02T10:49:01.852+09:002012-05-02T10:49:01.852+09:00<a href="https://github.com/codeinthehole/purl">purl</a> をつかって<br /> easy_install か pip でインストール <script type='syntaxhighlighter' class='brush: php|python|html|css|bash|js'><![CDATA[ asato@localhost:~$ sudo easy_install purl ]]></script> で、 <script type='syntaxhighlighter' class='brush: php|python|html|css|bash|js'><![CDATA[ >>> from purl import URL >>> BASE_URL = "http://192.168.0.xxx/db/coll/_action?query={ _id: -1}" >>> u = URL.from_string(BASE_URL) >>> u _URLTuple(host='192.168.0.xxx', username=None, password=None, scheme='http', port=None, path='/db/coll/_action', query='query={ _id: -1}', fragment='') >>> u.scheme() 'http' >>> u.host() '192.168.0.xxx' >>> u.domain() '192.168.0.xxx' >>> u.port() >>> u.path() '/db/coll/_action' >>> u.query() 'query={ _id: -1}' >>> u.fragment() '' ]]></script> 今度は組み立ててみる <script type='syntaxhighlighter' class='brush:python'><![CDATA[ >>> u = URL().scheme('http').host('192.168.0.xxx').path('/db/coll/_action').query('query={ _id: -1}') >>> u _URLTuple(host='192.168.0.xxx', username=None, password=None, scheme='http', port=None, path='/db/coll/_action', query='query={ _id: -1}', fragment=None) >>> print u.as_string() http://192.168.0.xxx/db/coll/_action?query={ _id: -1} ]]></script><div class="blogger-post-footer"><img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/5665538881670842061-5704840839316860828?l=blog.j4f.jp' alt='' /></div> <p><a href="http://feedads.g.doubleclick.net/~a/v5QosdjCCRv60dv7X8Tn2xn6I1c/0/da"><img src="http://feedads.g.doubleclick.net/~a/v5QosdjCCRv60dv7X8Tn2xn6I1c/0/di" border="0" ismap="true"></img></a><br/> <a href="http://feedads.g.doubleclick.net/~a/v5QosdjCCRv60dv7X8Tn2xn6I1c/1/da"><img src="http://feedads.g.doubleclick.net/~a/v5QosdjCCRv60dv7X8Tn2xn6I1c/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/j4f/oeuE/~4/fOrBHooaR5g" height="1" width="1"/>MASAKI Asatonoreply@blogger.com0http://blog.j4f.jp/2012/05/python-url-2.htmltag:blogger.com,1999:blog-5665538881670842061.post-63367898809064948482012-05-02T00:58:00.001+09:002012-05-02T00:58:17.357+09:002012-05-02T00:58:17.357+09:00標準のモジュール urlparse で<br /> <script type='syntaxhighlighter' class='brush:python'><![CDATA[ >>> from urlparse import urlparse >>> BASE_URL = "http://192.168.0.xxx/db/coll/_action?query={ _id: -1}" >>> res = urlparse(BASE_URL) >>> res ParseResult(scheme='http', netloc='192.168.0.xxx', path='/db/coll/_action', params='', query='query={ _id: -1}', fragment='') >>> res.scheme 'http' >>> res.netloc '192.168.0.xxx' >>> res.path '/db/coll/_action' >>> res.params '' >>> res.query 'query={ _id: -1}' >>> res.fragment '' ]]></script><div class="blogger-post-footer"><img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/5665538881670842061-6336789880906494848?l=blog.j4f.jp' alt='' /></div> <p><a href="http://feedads.g.doubleclick.net/~a/2_ubkwisgDTufTlLuJlbxinxYy8/0/da"><img src="http://feedads.g.doubleclick.net/~a/2_ubkwisgDTufTlLuJlbxinxYy8/0/di" border="0" ismap="true"></img></a><br/> <a href="http://feedads.g.doubleclick.net/~a/2_ubkwisgDTufTlLuJlbxinxYy8/1/da"><img src="http://feedads.g.doubleclick.net/~a/2_ubkwisgDTufTlLuJlbxinxYy8/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/j4f/oeuE/~4/NFJRkui8HEA" height="1" width="1"/>MASAKI Asatonoreply@blogger.com0http://blog.j4f.jp/2012/05/python-url.htmltag:blogger.com,1999:blog-5665538881670842061.post-90691147934673098812012-05-01T23:13:00.000+09:002012-05-01T23:13:05.800+09:002012-05-01T23:13:05.800+09:00だいたいの Linux のディストリなら最小限の構成で OS インストールした直後にソフトウェアを追加したりせずにすぐ使えるから :-)<br /> それじゃあ Perl でも（ｒｙ <br /> <b>参考：<a href="https://wiki.linuxfoundation.org/en/LSB_Wiki">LSB</a>、<a href="https://wiki.linuxfoundation.org/en/LsbPython">LSB Python</a></b><div class="blogger-post-footer"><img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/5665538881670842061-9069114793467309881?l=blog.j4f.jp' alt='' /></div> <p><a href="http://feedads.g.doubleclick.net/~a/UYUG3uEC8F2CYZwoxar3aR47zYA/0/da"><img src="http://feedads.g.doubleclick.net/~a/UYUG3uEC8F2CYZwoxar3aR47zYA/0/di" border="0" ismap="true"></img></a><br/> <a href="http://feedads.g.doubleclick.net/~a/UYUG3uEC8F2CYZwoxar3aR47zYA/1/da"><img src="http://feedads.g.doubleclick.net/~a/UYUG3uEC8F2CYZwoxar3aR47zYA/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/j4f/oeuE/~4/gpitlsfzp80" height="1" width="1"/>MASAKI Asatonoreply@blogger.com0http://blog.j4f.jp/2012/05/python.htmltag:blogger.com,1999:blog-5665538881670842061.post-49174763828790890492012-04-28T02:14:00.001+09:002012-04-28T02:16:56.717+09:002012-04-28T02:16:56.717+09:00CentOS5.x で、 sftp の転送ログというか操作ログ？を syslog に記録するめも<br /> 標準の /etc/ssh/sshd_config の Subsystem の項目はこうなっているはず <script type='syntaxhighlighter' class='brush:bash'><![CDATA[ -- snip -- # override default of no subsystems Subsystem sftp /usr/libexec/openssh/sftp-server ]]></script> これを <script type='syntaxhighlighter' class='brush:bash'><![CDATA[ -- snip -- # override default of no subsystems Subsystem sftp /usr/libexec/openssh/sftp-server -l INFO ]]></script> こう変更して sshd を再起動すると /var/log/messages に <script type='syntaxhighlighter' class='brush:bash'><![CDATA[ Mar 25 20:31:05 hoge sftp-server[16354]: session opened for local user asato from [192.168.0.xxx] Mar 25 20:31:05 hoge sftp-server[16354]: opendir "/home/asato" Mar 25 20:31:05 hoge sftp-server[16354]: closedir "/home/asato" Mar 25 20:31:31 hoge sftp-server[16354]: open "/home/asato/access_log.hoge.log" flags READ mode 0666 Mar 25 20:31:44 hoge sftp-server[16354]: close "/home/asato/access_log.hoge.log" bytes read 83197172 written 0 Mar 25 20:31:52 hoge sftp-server[16354]: remove name "/home/asato/access_log.hoge.log" Mar 25 20:31:52 hoge sftp-server[16354]: opendir "/home/asato" Mar 25 20:31:52 hoge sftp-server[16354]: closedir "/home/asato" Mar 25 20:32:03 hoge sftp-server[16354]: remove name "/home/asato/hoge.tgz" Mar 25 20:32:04 hoge sftp-server[16354]: opendir "/home/asato" Mar 25 20:32:04 hoge sftp-server[16354]: closedir "/home/asato" Mar 25 20:32:10 hoge sftp-server[16354]: session closed for local user asato from [192.168.0.xxx] ]]></script> こういう感じでログが記録されるようになる。<div class="blogger-post-footer"><img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/5665538881670842061-4917476382879089049?l=blog.j4f.jp' alt='' /></div> <p><a href="http://feedads.g.doubleclick.net/~a/UCNdmRd0eaQC2VmttwlrtWIhpEc/0/da"><img src="http://feedads.g.doubleclick.net/~a/UCNdmRd0eaQC2VmttwlrtWIhpEc/0/di" border="0" ismap="true"></img></a><br/> <a href="http://feedads.g.doubleclick.net/~a/UCNdmRd0eaQC2VmttwlrtWIhpEc/1/da"><img src="http://feedads.g.doubleclick.net/~a/UCNdmRd0eaQC2VmttwlrtWIhpEc/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/j4f/oeuE/~4/P8pBT13GCfQ" height="1" width="1"/>MASAKI Asatonoreply@blogger.com0http://blog.j4f.jp/2012/04/sftp-server.htmltag:blogger.com,1999:blog-5665538881670842061.post-43986654459297103532012-04-27T21:45:00.000+09:002012-04-27T21:45:21.059+09:002012-04-27T21:45:21.059+09:00前回は導入と Tripwire のデータベースの初期化まで行ったので、今回は Tripwire のレポートメール関連の設定を <script type='syntaxhighlighter' class='brush: bash'><![CDATA[ [asato@localhost ~]$ sudo tripwire --check ]]></script> メールが送信できるかテスト <script type='syntaxhighlighter' class='brush: bash'><![CDATA[ [asato@localhost ~]$ sudo tripwire --test --email someone@example.com Sending a test message to: someone@example.com ]]></script> メールが送信できない場合はローカルのMTAの設定を見直すか外部のSMTPを使用するように設定を変更 <script type='syntaxhighlighter' class='brush: bash'><![CDATA[ [asato@localhost ~]$ sudo vi /etc/tripwire/twcfgl.txt ]]></script> 標準のコンフィグ <script type='syntaxhighlighter' class='brush: bash'><![CDATA[ -- snip -- MAILMETHOD =SENDMAIL SYSLOGREPORTING =false MAILPROGRAM =/usr/sbin/sendmail -oi -t -- snip -- ]]></script> 外部の SMTP を使用するようにはコンフィグをこんな感じで <script type='syntaxhighlighter' class='brush: bash'><![CDATA[ -- snip -- MAILMETHOD =SMTP # SENDMAIL から SMTP へ変更 SMTPHOST = # IP アドレスかホスト名(fqdn) SMTPPORT =25 # ポート SYSLOGREPORTING =false MAILPROGRAM =/usr/sbin/sendmail -oi -t -- snip -- ]]></script> レポート全体をメールで受け取りたい場合は、ポリシーの "# Tripwire Binaries" の直前あたりと最後あたりに行を追加 <script type='syntaxhighlighter' class='brush: bash'><![CDATA[ -- snip -- SIG_MED = 66 ; # Non-critical files that are of significant security impact SIG_HI = 100 ; # Critical files that are significant points of vulnerability ( emailto = "someone@example.com" ) # 追加 { # 追加 # Tripwire Binaries ( rulename = "Tripwire Binaries", severity = $(SIG_HI) ) -- snip -- } } # 追加 # disabled-entries: 184 # license: #============================================================================= # -- snip -- ]]></script> コンフィグもポリシーも編集したら、"tw.pol" と "tw.cfg" の再生成とデータベースの初期化を忘れずに<div class="blogger-post-footer"><img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/5665538881670842061-4398665445929710353?l=blog.j4f.jp' alt='' /></div> <p><a href="http://feedads.g.doubleclick.net/~a/kghPFomW63wEKyJqaCnu-WPaq-8/0/da"><img src="http://feedads.g.doubleclick.net/~a/kghPFomW63wEKyJqaCnu-WPaq-8/0/di" border="0" ismap="true"></img></a><br/> <a href="http://feedads.g.doubleclick.net/~a/kghPFomW63wEKyJqaCnu-WPaq-8/1/da"><img src="http://feedads.g.doubleclick.net/~a/kghPFomW63wEKyJqaCnu-WPaq-8/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/j4f/oeuE/~4/bQBGWsa3IQg" height="1" width="1"/>MASAKI Asatonoreply@blogger.com0http://blog.j4f.jp/2012/04/centos-5x-de-tripwire-2.htmltag:blogger.com,1999:blog-5665538881670842061.post-85590582792046123362012-04-27T00:33:00.001+09:002012-04-27T00:33:57.986+09:002012-04-27T00:33:57.986+09:00nagios で使っている check_munin_rrd.pl が、何故かすんごい勢いでCPUを使いまくって監視サーバのロードアベレージの値が精神衛生上あまりよくない数字になっちゃっているので、 munin でやれることは munin で nagios はプラグインは極力使わずping監視くらいにしようと思いmuninで監視設定したったメモ<br> <br> <h2>エスカレーション先の定義</h2> munin.conf へ&quot;contact.<b>hogehoge</b>.command some_action&quot; という行を追加してエスカレーション先を指定していきます。<b>hogehoge</b> の部分は任意です。わかり易い名前がいいんでしょうね<br> command の後ろに色々書くことで自作のスクリプトをキックしたりnagiosと連携させることが出来るんだけれども、だけれども今回は単純にアラートメールを送信するだけにします。<br>こったことやりたかったらこんなチラ裏を参考にしないで、ちゃんと<a href="http://munin-monitoring.org/wiki/HowToContact">公式のドキュメント</a>読もうね♪<br> <a href="http://blog.j4f.jp/2012/04/munin.html#more">もっと読む »</a><div class="blogger-post-footer"><img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/5665538881670842061-8559058279204612336?l=blog.j4f.jp' alt='' /></div> <p><a href="http://feedads.g.doubleclick.net/~a/XOWlgWQAgLWTUkYUPMjlYPY7ZkA/0/da"><img src="http://feedads.g.doubleclick.net/~a/XOWlgWQAgLWTUkYUPMjlYPY7ZkA/0/di" border="0" ismap="true"></img></a><br/> <a href="http://feedads.g.doubleclick.net/~a/XOWlgWQAgLWTUkYUPMjlYPY7ZkA/1/da"><img src="http://feedads.g.doubleclick.net/~a/XOWlgWQAgLWTUkYUPMjlYPY7ZkA/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/j4f/oeuE/~4/5_XDaiOD4gA" height="1" width="1"/>MASAKI Asatonoreply@blogger.com0http://blog.j4f.jp/2012/04/munin.htmltag:blogger.com,1999:blog-5665538881670842061.post-44640307567384983712012-04-27T00:27:00.003+09:002012-04-27T00:27:57.887+09:002012-04-27T00:27:57.887+09:00<script type='syntaxhighlighter' class='brush: python'><![CDATA[ >>> def ping(addr): ... try: ... output = subprocess.check_output(['ping', addr, '-c 3']) ... except subprocess.CalledProcessError as err: ... print 'ERROR: ', err ... else: ... print output ... ]]></script><div class="blogger-post-footer"><img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/5665538881670842061-4464030756738498371?l=blog.j4f.jp' alt='' /></div> <p><a href="http://feedads.g.doubleclick.net/~a/bbj1lrR5Vlp1TJkkQ-NYE7vOqJY/0/da"><img src="http://feedads.g.doubleclick.net/~a/bbj1lrR5Vlp1TJkkQ-NYE7vOqJY/0/di" border="0" ismap="true"></img></a><br/> <a href="http://feedads.g.doubleclick.net/~a/bbj1lrR5Vlp1TJkkQ-NYE7vOqJY/1/da"><img src="http://feedads.g.doubleclick.net/~a/bbj1lrR5Vlp1TJkkQ-NYE7vOqJY/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/j4f/oeuE/~4/A1lSEW0hygY" height="1" width="1"/>MASAKI Asatonoreply@blogger.com0http://blog.j4f.jp/2012/04/python-subprocess.htmltag:blogger.com,1999:blog-5665538881670842061.post-6240187901620347042012-04-27T00:02:00.000+09:002012-04-27T00:02:37.647+09:002012-04-27T00:02:37.647+09:00mongodb のシェルで "db.collection.find()" とかやってもデータの件数が多いと最初の何件かが表示されて "has more" ってでて全件は表示されない。<br /> たまに ML とかでも全件表示するにはどうすれば〜っていうのを見かける。たしか公式のドキュメントに書いてあったと思うんだけど、全件表示させるには <script type='syntaxhighlighter' class='brush: js'><![CDATA[ > db.collection.find().forEach(printjson) ]]></script> とする。<div class="blogger-post-footer"><img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/5665538881670842061-624018790162034704?l=blog.j4f.jp' alt='' /></div> <p><a href="http://feedads.g.doubleclick.net/~a/959ekmYPr8iHkqqAdJYJ4bSl2NE/0/da"><img src="http://feedads.g.doubleclick.net/~a/959ekmYPr8iHkqqAdJYJ4bSl2NE/0/di" border="0" ismap="true"></img></a><br/> <a href="http://feedads.g.doubleclick.net/~a/959ekmYPr8iHkqqAdJYJ4bSl2NE/1/da"><img src="http://feedads.g.doubleclick.net/~a/959ekmYPr8iHkqqAdJYJ4bSl2NE/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/j4f/oeuE/~4/XLTs19dyUNQ" height="1" width="1"/>MASAKI Asatonoreply@blogger.com0http://blog.j4f.jp/2012/04/mongodb.htmltag:blogger.com,1999:blog-5665538881670842061.post-61729552925618591802012-04-26T23:35:00.000+09:002012-04-26T23:35:27.912+09:002012-04-26T23:35:27.912+09:00ちょっと前に <a href="http://blog.j4f.jp/2012/03/blog-post.html">Xcode Tools がインストールできなくて云々</a>と書いたんだけど、その後 <a href="http://rudix.org/">Rudix</a> とかいう素敵なパッケージ管理システムをみつけていろいろはかどっているのでめも<br /> <h2>Rudix のインストール</h2> <script type='syntaxhighlighter' class='brush:bash'><![CDATA[ mba-anr:~ asato$ curl -O http://rudix.googlecode.com/hg/Ports/rudix/rudix.py mba-anr:~ asato$ sudo python rudix.py install rudix ]]></script> <h2>パッケージの検索とインストール</h2> <script type='syntaxhighlighter' class='brush:bash'><![CDATA[ mba-anr:~ asato$ rudix search make # make コマンドのパッケージを検索 make-3.82-2 mba-anr:~ asato$ sudo rudix install make # パッケージのインストール Password: Downloading rudix-snowleopard.googlecode.com/files/make-3.82-2.pkg ######################################################################## 100.0% installer: Package name is GNU Make 3.82 installer: Installing at base path / installer: The install was successful. All done ]]></script> macports とかに比べるとパッケージ数が少ないみたいだけど、いまのところ不自由はしていないです。<br /> 一時期 make コマンドのためだけに Lion にバージョンアップしようかと本気で悩んでいたので、ほんと助かった<br /> これで Mountain Lion が出るまで Snow Leopard で戦える<div class="blogger-post-footer"><img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/5665538881670842061-6172955292561859180?l=blog.j4f.jp' alt='' /></div> <p><a href="http://feedads.g.doubleclick.net/~a/vj9teq8AEWfg541Qyhng0ddtswI/0/da"><img src="http://feedads.g.doubleclick.net/~a/vj9teq8AEWfg541Qyhng0ddtswI/0/di" border="0" ismap="true"></img></a><br/> <a href="http://feedads.g.doubleclick.net/~a/vj9teq8AEWfg541Qyhng0ddtswI/1/da"><img src="http://feedads.g.doubleclick.net/~a/vj9teq8AEWfg541Qyhng0ddtswI/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/j4f/oeuE/~4/HnZR552qmvI" height="1" width="1"/>MASAKI Asatonoreply@blogger.com0http://blog.j4f.jp/2012/04/rudix.htmltag:blogger.com,1999:blog-5665538881670842061.post-27743132725857003472012-04-20T16:46:00.002+09:002012-04-20T16:48:14.946+09:002012-04-20T16:48:14.946+09:00<a href="http://blog.j4f.jp/2012/04/jquery-getjson-sleepymongoose.html">前回の</a> jquery の getJSON() ではなく python でデータを取ってくる場合のめも <script type='syntaxhighlighter' class='brush:python'><![CDATA[ >>> import urllib2 >>> url = "http://192.168.0.xxx:27080/testdb/count_hourly/_find" >>> res = urllib2.urlopen(url) >>> res.read() '{"ok": 1, "results": [{"_id": "2011-04-18 09:00:00", "value": 439.0}, {"_id": "2011-04-18 10:00:00", "value": 322.0}, {"_id": "2011-04-18 11:00:00", "value": 250.0}, {"_id": "2011-04-18 12:00:00", "value": 643.0}, {"_id": "2011-04-18 13:00:00", "value": 20.0}, {"_id": "2011-04-18 14:00:00", "value": 252.0}, {"_id": "2011-04-18 15:00:00", "value": 747.0}, {"_id": "2011-04-18 16:00:00", "value": 486.0}, {"_id": "2011-04-18 17:00:00", "value": 2097.0}, {"_id": "2011-04-18 18:00:00", "value": 3437.0}, {"_id": "2011-04-18 19:00:00", "value": 20018.0}, {"_id": "2011-04-18 20:00:00", "value": 2060.0}, {"_id": "2011-04-18 21:00:00", "value": 655.0}, {"_id": "2011-04-18 22:00:00", "value": 950.0}, {"_id": "2011-04-18 23:00:00", "value": 1164.0}], "id": 61}' ]]></script> http://192.168.0.xxx:27080/testdb/count_hourly/_find?sort={"_id": -1} みたいに query をいじりたい場合は <script type='syntaxhighlighter' class='brush:python'><![CDATA[ >>> import urllib, urllib2 >>> url = "http://192.168.0.xxx:27080/testdb/count_hourly/_find?" >>> str = '{"_id": -1}' >>> query = { 'sort' : str } >>> opt = urllib.urlencode(query) >>> req = url + opt >>> req 'http://192.168.0.xxx:27080/testdb/count_hourly/_find?sort=%7B%22_id%22%3A+-1%7D' >>> res = urllib2.urlopen(req) >>> res.read() {"ok": 1, "results": [{"_id": "2012-04-20 06:00:00", "value": 807.0}, {"_id": "2012-04-20 05:00:00", "value": 1154.0}, {"_id": "2012-04-20 04:00:00", "value": 1019.0}, {"_id": "2012-04-20 03:00:00", "value": 778.0}, {"_id": "2012-04-20 02:00:00", "value": 1520.0}, {"_id": "2012-04-20 01:00:00", "value": 1145.0}, {"_id": "2012-04-20 00:00:00", "value": 1961.0}, {"_id": "2012-04-19 23:00:00", "value": 2214.0}, {"_id": "2012-04-19 22:00:00", "value": 2133.0}, {"_id": "2012-04-19 21:00:00", "value": 1951.0}, {"_id": "2012-04-19 20:00:00", "value": 1859.0}, {"_id": "2012-04-19 19:00:00", "value": 3476.0}, {"_id": "2012-04-19 18:00:00", "value": 3082.0}, {"_id": "2012-04-19 17:00:00", "value": 3703.0}, {"_id": "2012-04-19 16:00:00", "value": 4837.0}], "id": 63} ]]></script> javascript だとこんな感じか <script type='syntaxhighlighter' class='brush:js'><![CDATA[ $.getJSON("http://192.168.0.xxx:27080/testdb/count_hourly/_find?sort="+ encodeURIComponent('{"_id": -1}'), ]]></script><div class="blogger-post-footer"><img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/5665538881670842061-2774313272585700347?l=blog.j4f.jp' alt='' /></div> <p><a href="http://feedads.g.doubleclick.net/~a/31CgUEWan4jakxAUHXn7yuXpZCY/0/da"><img src="http://feedads.g.doubleclick.net/~a/31CgUEWan4jakxAUHXn7yuXpZCY/0/di" border="0" ismap="true"></img></a><br/> <a href="http://feedads.g.doubleclick.net/~a/31CgUEWan4jakxAUHXn7yuXpZCY/1/da"><img src="http://feedads.g.doubleclick.net/~a/31CgUEWan4jakxAUHXn7yuXpZCY/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/j4f/oeuE/~4/Ze5W-UW-gwA" height="1" width="1"/>MASAKI Asatonoreply@blogger.com0http://blog.j4f.jp/2012/04/python-urllib2urlopen.htmltag:blogger.com,1999:blog-5665538881670842061.post-17738469272733019662012-04-19T22:15:00.000+09:002012-04-19T22:15:13.020+09:002012-04-19T22:15:13.020+09:00<a href="https://github.com/kchodorow/sleepy.mongoose">sleepy.mongoose</a> が吐き出してくれる JSON のデータを使ってかっちょいいグラフを javascript で表示したいと思い<br /> jquery の getJSON を初めて使ってみたのでめも<br /> sleepy.mongoose が出力しているのはこんな形式 <script type='syntaxhighlighter' class='brush:js'><![CDATA[ {"ok": 1, "results": [{"_id": "2011-11-09 18:00:00", "value": 149.0}, {"_id": "2011-11-09 19:00:00", "value": 4028.0}, {"_id": "2011-11-14 17:00:00", "value": 35.0}, {"_id": "2011-11-17 15:00:00", "value": 479.0}, {"_id": "2011-11-17 16:00:00", "value": 170.0}, {"_id": "2011-11-17 17:00:00", "value": 295.0}, {"_id": "2011-11-17 18:00:00", "value": 279.0}, {"_id": "2011-11-17 19:00:00", "value": 380.0}, {"_id": "2011-11-17 20:00:00", "value": 37.0}, {"_id": "2011-11-17 21:00:00", "value": 97.0}, {"_id": "2011-11-17 22:00:00", "value": 80.0}, {"_id": "2011-11-17 23:00:00", "value": 7.0}, {"_id": "2011-11-18 00:00:00", "value": 10.0}, {"_id": "2011-11-18 01:00:00", "value": 10.0}, {"_id": "2011-11-18 02:00:00", "value": 9.0}], "id": 59} ]]></script> で、 getJSON の使い方はこんな感じで <script type='syntaxhighlighter' class='brush:js'><![CDATA[ $.getJSON("http://192.168.0.xxx:27080/DB/COLLECTION/_find?callback=?", null, function (data) { $.each(data.results, function(i, result) { // データを加工したり }); }); ]]></script> callback=? がポイント<div class="blogger-post-footer"><img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/5665538881670842061-1773846927273301966?l=blog.j4f.jp' alt='' /></div> <p><a href="http://feedads.g.doubleclick.net/~a/4WKAqSOVUTgo5MVyf8jPuwRCGcA/0/da"><img src="http://feedads.g.doubleclick.net/~a/4WKAqSOVUTgo5MVyf8jPuwRCGcA/0/di" border="0" ismap="true"></img></a><br/> <a href="http://feedads.g.doubleclick.net/~a/4WKAqSOVUTgo5MVyf8jPuwRCGcA/1/da"><img src="http://feedads.g.doubleclick.net/~a/4WKAqSOVUTgo5MVyf8jPuwRCGcA/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/j4f/oeuE/~4/DRKARqbMF94" height="1" width="1"/>MASAKI Asatonoreply@blogger.com0http://blog.j4f.jp/2012/04/jquery-getjson-sleepymongoose.htmltag:blogger.com,1999:blog-5665538881670842061.post-52949525618914669692012-04-19T15:29:00.002+09:002012-04-19T15:29:36.565+09:002012-04-19T15:29:36.565+09:00<script type='syntaxhighlighter' class='brush: python'><![CDATA[ >>> import time >>> t = time.time() >>> print t 1334816889.71 >>> type(t) <type 'float'> >>> t = str(t) >>> print t 1334816889.71 >>> type(t) <type 'str'> ]]></script><div class="blogger-post-footer"><img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/5665538881670842061-5294952561891466969?l=blog.j4f.jp' alt='' /></div> <p><a href="http://feedads.g.doubleclick.net/~a/TEH5q9JabRSHksU2-On2H4MZHag/0/da"><img src="http://feedads.g.doubleclick.net/~a/TEH5q9JabRSHksU2-On2H4MZHag/0/di" border="0" ismap="true"></img></a><br/> <a href="http://feedads.g.doubleclick.net/~a/TEH5q9JabRSHksU2-On2H4MZHag/1/da"><img src="http://feedads.g.doubleclick.net/~a/TEH5q9JabRSHksU2-On2H4MZHag/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/j4f/oeuE/~4/TWo_trsnRoU" height="1" width="1"/>MASAKI Asatonoreply@blogger.com0http://blog.j4f.jp/2012/04/python-float-str.htmltag:blogger.com,1999:blog-5665538881670842061.post-7001358962891467752012-04-18T12:49:00.000+09:002012-04-18T12:49:14.986+09:002012-04-18T12:49:14.986+09:00munin-node は telnet で接続して"fetch <b>PLUGINNAME</b>"とコマンドを入力すると、その plugin で取得できる値を一覧で出力してくれる。<br /> この値を python から参照したい場合はこんな感じで <script type='syntaxhighlighter' class='brush: python'><![CDATA[ import telnetlib HOST = '192.168.0.xxx' PORT = '4949' tel = telnetlib.Telnet() tel.open(HOST, PORT) tel.read_until("munin node") tel.write("fetch PLUGINNAME¥n") res = tel.read_until(".¥n") tel.close() ]]></script> あとは res をいじって扱いやすい形式にする。<div class="blogger-post-footer"><img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/5665538881670842061-700135896289146775?l=blog.j4f.jp' alt='' /></div> <p><a href="http://feedads.g.doubleclick.net/~a/Ps-1hXomgwSzhOqgzEWjWcuDKNE/0/da"><img src="http://feedads.g.doubleclick.net/~a/Ps-1hXomgwSzhOqgzEWjWcuDKNE/0/di" border="0" ismap="true"></img></a><br/> <a href="http://feedads.g.doubleclick.net/~a/Ps-1hXomgwSzhOqgzEWjWcuDKNE/1/da"><img src="http://feedads.g.doubleclick.net/~a/Ps-1hXomgwSzhOqgzEWjWcuDKNE/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/j4f/oeuE/~4/oY8lzmXn_wg" height="1" width="1"/>MASAKI Asatonoreply@blogger.com0http://blog.j4f.jp/2012/04/python-munin-node.htmltag:blogger.com,1999:blog-5665538881670842061.post-17238529923206543872012-04-18T00:42:00.001+09:002012-04-18T00:42:23.927+09:002012-04-18T00:42:23.927+09:00例えばこんなリストがあったとして <script type='syntaxhighlighter' class='brush: python'><![CDATA[ list = ["", "1", "2", "3", "", "4"] ]]></script> このリストから空の要素("")を削除するには <script type='syntaxhighlighter' class='brush: python'><![CDATA[ while list.count("") > 0: list.remove("") print list #['1', '2', '3', '4'] ]]></script> か <script type='syntaxhighlighter' class='brush: python'><![CDATA[ while (True): try: list.remove("") except: break print list #['1', '2', '3', '4'] ]]></script> とする。<div class="blogger-post-footer"><img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/5665538881670842061-1723852992320654387?l=blog.j4f.jp' alt='' /></div> <p><a href="http://feedads.g.doubleclick.net/~a/6gm9Ge1Lph-RgkwNLBjfuPofF-Q/0/da"><img src="http://feedads.g.doubleclick.net/~a/6gm9Ge1Lph-RgkwNLBjfuPofF-Q/0/di" border="0" ismap="true"></img></a><br/> <a href="http://feedads.g.doubleclick.net/~a/6gm9Ge1Lph-RgkwNLBjfuPofF-Q/1/da"><img src="http://feedads.g.doubleclick.net/~a/6gm9Ge1Lph-RgkwNLBjfuPofF-Q/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/j4f/oeuE/~4/LJRn5MwotRo" height="1" width="1"/>MASAKI Asatonoreply@blogger.com0http://blog.j4f.jp/2012/04/python.htmltag:blogger.com,1999:blog-5665538881670842061.post-81833104065296044212012-04-12T21:55:00.000+09:002012-04-12T21:55:00.475+09:002012-04-12T21:55:00.475+09:00epel のリポジトリから tripwire をインストール <script type='syntaxhighlighter' class='brush: php|python|html|css|bash|js'><![CDATA[ [asato@localhost ~]$ sudo yum install tripwire ]]></script> ローカルキーの作成 <script type='syntaxhighlighter' class='brush: php|python|html|css|bash|js'><![CDATA[ [asato@localhost ~]$ sudo twadmin --generate-keys -L /etc/tripwire/local.key (When selecting a passphrase, keep in mind that good passphrases typically have upper and lower case letters, digits and punctuation marks, and are at least 8 characters in length.) Enter the local keyfile passphrase: #パスフレーズの入力 Verify the local keyfile passphrase: #もう一度入力 Generating key (this may take several minutes)...Key generation complete. ]]></script> サイトキーの作成 <script type='syntaxhighlighter' class='brush: php|python|html|css|bash|js'><![CDATA[ [asato@localhost ~]$ sudo twadmin --generate-keys -S /etc/tripwire/site.key (When selecting a passphrase, keep in mind that good passphrases typically have upper and lower case letters, digits and punctuation marks, and are at least 8 characters in length.) Enter the site keyfile passphrase: #パスフレーズの入力 Verify the site keyfile passphrase: #もう一度入力 Generating key (this may take several minutes)...Key generation complete. ]]></script> <script type='syntaxhighlighter' class='brush: php|python|html|css|bash|js'><![CDATA[ [asato@localhost ~]$ twadmin -m F -c /etc/tripwire/tw.cfg -S /etc/tripwire/site.key /etc/tripwire/twcfg.txt Please enter your site passphrase: #サイトキーのパスフレーズを入力 Wrote configuration file: /etc/tripwire/tw.cfg ]]></script> 設定ファイルの編集 <script type='syntaxhighlighter' class='brush: php|python|html|css|bash|js'><![CDATA[ [asato@localhost ~]$ sudo vi /etc/tripwire/twcfg.txt ]]></script> LOCALKEYFILE が標準だと /etc/tripwire/$(HOSTNAME)-local.key になっているが、 今回は /etc/tripwire/local.key としてローカルキーを作成しているので変更 <script type='syntaxhighlighter' class='brush: php|python|html|css|bash|js'><![CDATA[ ROOT =/usr/sbin POLFILE =/etc/tripwire/tw.pol DBFILE =/var/lib/tripwire/$(HOSTNAME).twd REPORTFILE =/var/lib/tripwire/report/$(HOSTNAME)-$(DATE).twr SITEKEYFILE =/etc/tripwire/site.key LOCALKEYFILE =/etc/tripwire/local.key EDITOR =/bin/vi LATEPROMPTING =false LOOSEDIRECTORYCHECKING =false MAILNOVIOLATIONS =true EMAILREPORTLEVEL =3 REPORTLEVEL =3 MAILMETHOD =SENDMAIL SYSLOGREPORTING =false MAILPROGRAM =/usr/sbin/sendmail -oi -t ]]></script> 修正したらコンフィグファイルを生成 <script type='syntaxhighlighter' class='brush: php|python|html|css|bash|js'><![CDATA[ [asato@localhost ~]$ sudo twadmin -m F -c /etc/tripwire/tw.cfg -S /etc/tripwire/site.key /etc/tripwire/twcfg.txt Please enter your site passphrase: Wrote configuration file: /etc/tripwire/tw.cfg ]]></script> ポリシーファイルを生成 <script type='syntaxhighlighter' class='brush: php|python|html|css|bash|js'><![CDATA[ [asato@localhost ~]$ sudo twadmin -m P -p /etc/tripwire/tw.pol -S /etc/tripwire/site.key /etc/tripwire/twpol.txt Please enter your site passphrase: Wrote policy file: /etc/tripwire/tw.pol ]]></script> 初期化を実行 <script type='syntaxhighlighter' class='brush: php|python|html|css|bash|js'><![CDATA[ [asato@localhost ~]$ sudo tripwire --init Please enter your local passphrase: Incorrect local passphrase. Please enter your local passphrase: Parsing policy file: /etc/tripwire/tw.pol Generating the database... *** Processing Unix File System *** ### Warning: File system error. ### Filename: /dev/kmem --- snip --- ### Continuing... ### Warning: File system error. ### Filename: /dev/cua0 ### \\xe3\\x81\\x9d\\xe3\\x81\\xae\\xe3\\x82\\x88\\xe3\\x81\\x86\\xe3\\x81\\xaa\\xe3\\x83\\x95\\xe3\\x82\\xa1\\x e3\\x82\\xa4\\xe3\\x83\\xab\\xe3\\x82\\x84\\xe3\\x83\\x87\\xe3\\x82\\xa3\\xe3\\x83\\xac\\xe3\\x82\\xaf\\xe3\\x83 \\x88\\xe3\\x83\\xaa\\xe3\\x81\\xaf\\xe3\\x81\\x82\\xe3\\x82\\x8a\\xe3\\x81\\xbe\\xe3\\x81\\x9b\\xe3\\x82\\x93 ### Continuing... Wrote database file: /var/lib/tripwire/localhost.localdomain.twd The database was successfully generated. ]]></script><div class="blogger-post-footer"><img width='1' height='1' src='https://blogger.googleusercontent.com/tracker/5665538881670842061-8183310406529604421?l=blog.j4f.jp' alt='' /></div> <p><a href="http://feedads.g.doubleclick.net/~a/4wbjnVNg5tk6b1w7yiMY8SQ9Osc/0/da"><img src="http://feedads.g.doubleclick.net/~a/4wbjnVNg5tk6b1w7yiMY8SQ9Osc/0/di" border="0" ismap="true"></img></a><br/> <a href="http://feedads.g.doubleclick.net/~a/4wbjnVNg5tk6b1w7yiMY8SQ9Osc/1/da"><img src="http://feedads.g.doubleclick.net/~a/4wbjnVNg5tk6b1w7yiMY8SQ9Osc/1/di" border="0" ismap="true"></img></a></p><img src="http://feeds.feedburner.com/~r/j4f/oeuE/~4/BxWY9Bti_m4" height="1" width="1"/>MASAKI Asatonoreply@blogger.com0http://blog.j4f.jp/2012/04/centos-5x-de-tripwire-1.html