Joshi's Tech Blog

Installing Android 2.2 on HTC Aria

noreply@blogger.com (Neuro Yogi) — Wed, 01 Dec 2010 12:28:52 PST

Hi Guys,
I was able to successfully root/jailbreak my HTC Aria phone and install Android 2.2. Here are the steps. (Please try it at your own risk).

Install unrevoked3 to root the phone.
Download CyanogenMod for your version of the handset.
Copy it into your phones SDcard and rename to update.zip
Power off your phone and keep pressing power button (on top) and volume button (on side)
It will reboot with recovery options with multiple menu options.
Select option 6: nandroid to take backup
Select option to 3: "wipe data/factory reset"
Select option 4: "wipe cache partition"
Select option 8: "Advance" and select option "wipe delvik cache".
Selection option "reboot recovery"
Now select option to install update.zip from sdcard.
Reboot the phone and you will have andorid 2.2 install.

Once I installed, everything worked fine except android market place.
13. Enable your wifi internet connection
14. Goto ROM Manager and upgrade FlashClockworkMode version
15. Download market fix to your sd card. Market_fix_bgill55.zip
16. Again follow 5,7,8,9 and 10
17. Go back to ROM manager and select option install from SD card.
18. Select Market_fix_bgill55.zip
19. once installation is done, reboot.

I have no issues so far. Let me know if you find any issue or need help installing it.

boost object pool destroy performance

noreply@blogger.com (Neuro Yogi) — Mon, 17 May 2010 12:41:10 PDT

In one of my application, we wanted to achieve 8000 TPS (Transactions per second) where every second, 8000 session objects will be created and destroyed.
To achieve this performance number, I wanted to optimize memory allocation and deallocation so started looking for existing memory pool class particularly in boost libraries (assuming it would be faster) and I am already using few classes from boost.

I found boost::object_pool. It is a header only file so no need to include link library and I included into my application. At the same time, I used boost::multi_index_container to store session object with multiple indexes. The performance was degrading as number of object increases in the container. I thought that is due to boost multi-index-container.

So I created two separate test applications to measure performance of boost object pool and boost multi-index-container and found that boost object_pool was the bottleneck.

Here is the performance number of destroying 10K, 20K and 30K object from object_pool and using standard c++ delete.

./object_pool_test 10000
Total time to destroy 10000 using delete: 0.3158860
Total time to destroy 10000 from object_pool: 1.447002736 sec

./object_pool_test 20000
Total time to destroy 20000 using delete: 0.6340170
Total time to destroy 20000 from object_pool: 9.624879974 sec

./object_pool_test 30000
Total time to destroy 30000 using delete: 0.10413087
Total time to destroy 30000 from object_pool: 32.150515048 sec

///////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////
// File: test_object_pool.cpp
// Description: Test performance of deleting object from boost::object_pool versus standard delete operator.
// Author: Rohit Joshi
////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////

#include <iostream>
#include <vector>
#include <time.h>
#include <boost/pool/object_pool.hpp>

class Test
{
char buffer[1024];
unsigned long id;
};

int main(int argc, char** argv) {
   if(argc < 2) {
     std::cout << "Usage: "<< argv[0] << " NumObjects\n";
     return 0;
}

int num_objs = atoi(argv[1]);
/////////////////////////////////////////////////////////////////////////////////////////////////
//test1: using standard delete to delete objects
////////////////////////////////////////////////////////////////////////////////////////////////
std::vector<Test*> vDelTest;
vDelTest.reserve(num_objs);
for(int i = 0; i < num_objs; ++i) {
    Test *pTest = new Test();
    vDelTest.push_back(pTest);
}
timespec tv;
tv.tv_sec = 0;
tv.tv_nsec = 0;

clock_settime(CLOCK_PROCESS_CPUTIME_ID, &tv);

for(int i = 0; i < num_objs; ++i) {
    delete vDelTest[i];
}
clock_gettime(CLOCK_PROCESS_CPUTIME_ID, &tv);

std::cout << "Total time to destroy "<< num_objs << " using delete: " << tv.tv_sec << "." << tv.tv
_nsec << "\n";

//////////////////////////////////////////////////////////////////////////////////////////////////
//delete using object_pool
/////////////////////////////////////////////////////////////////////////////////////////////////
boost::object_pool<Test> m_oPool;
std::vector<Test*> vTest;
vTest.reserve(num_objs);

for(int i = 0; i < num_objs; ++i) {
    Test *pTest = m_oPool.construct();
    vTest.push_back(pTest);
}

clock_gettime(CLOCK_PROCESS_CPUTIME_ID, &tv);

std::cout << "Total time to destroy "<< num_objs << " from object_pool: " << tv.tv_sec << "." << tv.tv_nsec << "\n";

return 0;

}

To compile, copy this source into test_object_pool.cpp
g++ -c test_object_pool.cpp
g++ -o test_object_pool test_object_pool.o -lrt

Expose stop working after connecting to external monitor

noreply@blogger.com (Neuro Yogi) — Fri, 29 Jan 2010 11:20:14 PST

When ever I unplug my MacBook from an external monitor, Expose stops working. The solution to this problem is to kill "Dock" application. To make it easier, I have created a script which allows you to do the same.

set app_name to "/System/Library/CoreServices/Dock.app/Contents/MacOS/Dock"
set the_pid to (do shell script "ps ax | grep " & (quoted form of app_name) & " | grep -v grep | awk '{print $1}'")
display dialog "Killingn the application Dock with PID:" & the_pid
if the_pid is not "" then do shell script ("kill -9 " & the_pid)

Copy following lines of code into text editor and copy under $HOME/Library/Scripts/killdock.scpt. Now you can see the script listed under scripts as an shortcut. You can see "kill dock" listed at the end.

Does Internet Speed check varies based on the browser

noreply@blogger.com (Neuro Yogi) — Sun, 10 Jan 2010 09:09:31 PST

I wanted to see whether browser makes different while checking the speed of the internet. I did speed check test using speedtest.net and four different browser and surprisingly all of them gave different results.

1: Safari Version 4.0.3 (5531.9)
Download Speed: 17.16 Mb/s
Upload speed: 4.08 Mb/s

2. Firefox Version 3.6 (rv:1.9.2 Gecko 20100105)
Download Speed:15.84 Mb/s
Upload Speed:4.25 Mb/s

3. Chrome Version 4.0.246.0 (31780)
Download Speed:15.47 Mb/s
Upload Speed:2.17 Mb/s

4. Chrome Version 4.0.249.43:
Download speed: 17.65 Mb/s
Upload speed: 3.98 Mb/s

Looking at the results, it seems speeds varies based on the browser. You can see latest version of the Google Chrome has improves and you can see both the upload and download speed has increased.

Why google search engine is better than bing for technical information?

noreply@blogger.com (Neuro Yogi) — Fri, 02 Oct 2009 20:23:45 PDT

When Microsoft launched bing search engine, I started using it. I really liked the picture on main page and results are good when I am searching non-technical information. So I changed my default search engine to Bing and set home page as http://www.bing.com.

But when it comes to technical information, bing couldn't provide me information I wanted. It seems it doesn't display the latest information.
E.g I was working on dbxml (Berkeley DB XML) and posted a question to the "dbxml forum". When I searched "dbxml forum" (without quotes), bing fetches following first five search results.

sourceforge.net/projects/dbxml-core
rubyforge.org/forum/?group_id=1643
sourceforge.net/projects/dbxml
dbxml-core.wiki.sourceforge.net/space/stats
eiffel-dbxml.wiki.sourceforge.net

When I search "dbxml forum" (without quotes), it fetches following results.

forums.oracle.com/forums/forum.jspa?forumID=274
www.nabble.com/Berkeley-DB-Xml-f730.html
www.nabble.com/Berkeley-DB-XML-mailing-list-transition-td5475353.html
www.mombu.com/.../t-getting-started-with-berkeley-db-xml-806334.html
www.eosdirectory.com/project/196/Berkeley+DB+XML.html

You can see the difference. The first link is for berkeley db xml forum even though you don't see the dbxml word in the link. Google search engine has latest information about Berkeley DB XML including information that it is bought by Oracle and forums.oracle.com is the latest page for Berkeley DB XML. So every time I search in bing, I had to search it again in google to get the dbxml forum page which was waste of my time. Eventually, I decided had to switch back to google search engine.

Glassfish Application Server Performance tunings

noreply@blogger.com (Neuro Yogi) — Fri, 02 Oct 2009 20:23:06 PDT

If you want to improve performance of your application running on Glassfish application server, you can try out following JVM options. We got significant performance improvement by using them.

<jvm-options>-server</jvm-options>

<jvm-options>-Xms3000m</jvm-options>

<jvm-options>-Xmx3000m</jvm-options>

<jvm-options>-XX:MaxPermSize=192m</jvm-options> 

<jvm-options>-XX:NewRation=2</jvm-options> 

<jvm-options>-XX:+AggressiveHeap</jvm-options>

<jvm-options>-XX:+AggressiveOpts</jvm-options>

<jvm-options>-XX:+UseParallelGC</jvm-options>

<jvm-options>-XX:+UseParallelOldGC</jvm-options>

<jvm-options>-XX:ParallelGCThreads=5</jvm-options>

By using these performance tunings, we are able to get almost 30% more TPS (Transactions per Seconds).If I can be helpful, please do let me know. I have spent enough time on Glassfish and OpenESB performance tunings.

Absolute Singleton. Not Really...

noreply@blogger.com (Neuro Yogi) — Tue, 29 Sep 2009 14:12:24 PDT

Singleton are not true singleton and there are many reasons: One of them is multiple class loaders can have their own copy of singleton. See How single can your singleton instance be?. I started googling for true singleton and came across Absolute Singleton.

When I use this approach in my product, it didn't work instead it was throwing exception java.lang.ClassNotFoundException on the Singleton class.

java.lang.ClassNotFoundException: com.example.common.utils.JCSCache at com.sun.enterprise.util.ConnectorClassLoader.loadClass(ConnectorClassLoader.java:222)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at com.example.common.utils.JCSCache.getInstance(JCSCache.java:131)

After looking at the exception and class initialization, I found that what happens if the first instance is initiated by custom class loader and not the default one?

It will not find an existing instance because while creating the instance, due to custom class loader, it will go into "if (! myClassLoader.toString().startsWith("sun.")) {" (see the Absolute Singleton) condition and try to find existing instance instead of creating new which doesn't exits yet so it throws the java.lang.ClassNotFoundException.

The work around I found is to catch the exception and create the instance of AbsoluteSingleton class.

But next time, custom class loader try to get the instance, again it's not going to find it and create it's own instance.
See the below log.

First instance of JCSCache ( com.example.common.utils.JCSCache@124adaf) created by class loader: org.glassfish.openesb.pojose.jbi.su.SUClassLoader@1b78d60
and

2nd instance (com.example.common.utils.JCSCache@1a859dc) is created by EJBClassLoader.

So Absolute singleton is not really absolute singleton.

[2009-09-27 21:56:04,713 | Thread-79 | common.utils.JCSCache | ENTRY] -->getInstance()
[2009-09-27 21:56:04,713 | Thread-79 | common.utils.JCSCache | DEBUG] Class Loader:org.glassfish.openesb.pojose.jbi.su.SUClassLoader@1b78d60
[2009-09-27 21:56:04,713 | Thread-79 | common.utils.JCSCache | ERROR] Exception:com.example.common.utils.JCSCache
[2009-09-27 21:56:04,713 | Thread-79 | common.utils.JCSCache | ENTRY] -->JCSCache()
[2009-09-27 21:56:04,713 | Thread-79 | common.utils.JCSCache | DEBUG] JCSCache constructor called.
[2009-09-27 21:56:04,713 | Thread-79 | common.utils.JCSCache | EXIT] <--JCSCache() [2009-09-27 21:56:04,713 | Thread-79 | common.utils.JCSCache | ENTRY] -->init()
[2009-09-27 21:56:04,713 | Thread-79 | common.utils.JCSCache | DEBUG] Setting the cache configuratio name:/cache.ccf
[2009-09-27 21:56:04,721 | Thread-79 | common.utils.JCSCache | DEBUG] Initializing region base cache objects.
[2009-09-27 21:56:04,786 | Thread-79 | common.utils.JCSCache | EXIT] <--init() true [2009-09-27 21:56:04,786 | Thread-79 | common.utils.JCSCache | EXIT] <--getInstance() com.example.common.utils.JCSCache@124adaf

2nd instance:

2009-09-27 21:56:06,812 | httpSSLWorkerThread-8080-0 | common.utils.JCSCache | ENTRY] -->getInstance()
[2009-09-27 21:56:06,813 | httpSSLWorkerThread-8080-0 | common.utils.JCSCache | DEBUG] Class Loader:EJBClassLoader :
[2009-09-27 21:56:06,813 | httpSSLWorkerThread-8080-0 | common.utils.JCSCache | ERROR] Exception:com.example.common.utils.JCSCache
[2009-09-27 21:56:06,813 | httpSSLWorkerThread-8080-0 | common.utils.JCSCache | ENTRY] -->JCSCache()
[2009-09-27 21:56:06,813 | httpSSLWorkerThread-8080-0 | common.utils.JCSCache | DEBUG] JCSCache constructor called.
[2009-09-27 21:56:06,813 | httpSSLWorkerThread-8080-0 | common.utils.JCSCache | EXIT] <--JCSCache() [2009-09-27 21:56:06,813 | httpSSLWorkerThread-8080-0 | common.utils.JCSCache | ENTRY] -->init()
[2009-09-27 21:56:06,813 | httpSSLWorkerThread-8080-0 | common.utils.JCSCache | DEBUG] Setting the cache configuratio name:/cache.ccf
[2009-09-27 21:56:06,818 | httpSSLWorkerThread-8080-0 | common.utils.JCSCache | DEBUG] Initializing region base cache objects.
[2009-09-27 21:56:06,926 | httpSSLWorkerThread-8080-0 | common.utils.JCSCache | EXIT] <--init() true [2009-09-27 21:56:06,926 | httpSSLWorkerThread-8080-0 | common.utils.JCSCache | EXIT] <--getInstance() com.example.common.utils.JCSCache@1a859dc

How to Enabled logging in OpenLdap

noreply@blogger.com (Neuro Yogi) — Thu, 15 Oct 2009 08:12:39 PDT

I am working on performance improvement task for our new product where I wanted avoid duplicate Ldap seaches. To view the ldap searches in sldap log file, we have to enable the logging. This is how you do it.

To enabled logging:

ldapmodify -x -H ldap://ldaphost -D cn=directory\ manager,cn=config -w password
dn: cn=Config
replace: olcLogLevel
olcLogLevel: Stats Stats2 None
Ctrl+d

Now you can view the log file at /var/log/slapd.log. You will need a root/sudo access to view this log file.

To disabled logging:
ldapmodify -x -H ldap://ldaphost -D cn=directory\ manager,cn=config -w password
dn: cn=Config
replace: olcLogLevel
olcLogLevel: None
Ctrl+d

NOTE: Here is None is used for reporting errors so don't forget to specify None when you enable or disable logging.

If you want to modify existing subscriber data in ldap, you can use this command
ldapmodify -x -H ldap://host -D cn=directory\ manager,o=example.com -w password123 -f modifieddata.ldif

where modifieddata.ldif would contain
dn: uniqueIdentifier=0209091514-1015999999,ou=subscribers,ou=OU,o=example.com
changetype: modify
replace:
:

dn: uniqueIdentifier=0209091514-1016000000,ou=subscribers,ou=OU,o=example.com
changetype: modify
replace:
:

Berkeley DBXML and thread deadlock

noreply@blogger.com (Neuro Yogi) — Thu, 24 Sep 2009 19:41:55 PDT

For my XCAPServer project, I use Berkeley DB XML for XML document repository. I am kind of stuck due to all threads goes into deadlock while adding and removing documents.

See more information on dbxml forum at: DBXML 2.4.16: Accessing containers from multiple threads and deadlock

Solution: To avoid the deadlock, call set_lk_detect(DB_LOCK_MINWRITE) on DbEnv variable. Also make sure when exceptions are thrown, transactions must be either aborted or committed.

Here is a link to the source code: dbxml_db.cpp

XPATH Library performance

noreply@blogger.com (Neuro Yogi) — Wed, 23 Sep 2009 17:48:32 PDT

I am working on a project which requires invoking multiple JBI endpoints based on routing requirements and type of input message. It is developed using heavy xpath expressions to choose the right path in the routing logic.

I started with default XPath library which is part of the JDK 1.6. To avoid the performance problem, I pre-compiled all the xpath expressions at startup time.

When I ran performance test on this router application, I was getting around 670 TPS (transactions per second) with 20% CPU idle (it's a 8 core machine) which is much slower than what I expected.

So I started looking for alternate XPATH libraries and I found VDT-XML benchmark where you can see VDT-XML outperforms jaxen and default jkd xpath implementation.

VDT-XML seem to be much faster (based on benchmark results :) )but due to it's license, I decided not to use for my project so I only option left was to try jaxen xpath library.

When I replaced default xpath library with jaxen, performance numbers changes drastically. Now I get 800 TPS with 70% CPU idle. In-fact I couldn't drive more CPU usage with my jmeter running on one machine.

So I would recommend jaxen library to anyone who is looking high performance, open source/free xpath library.

Boost Logging Library

noreply@blogger.com (Neuro Yogi) — Tue, 04 May 2010 12:06:26 PDT

I was evaluating boost log library for my upcoming project XCAPServer. When I googled for boost and logging, I found two boost based logging library.

1. http://torjo.com/log2/doc/html/index.html
2. https://sourceforge.net/projects/boost-log/.

I started with torjo's log library documentation but it looked more complex so I gave up on that.

boost-log library documentation is really good and getting started was much easier so I downloaded the boost-log source and compiled along with my other boost libraries. You can find how to compile boost libraries here.

After spending some time on this library what I realized is that it doesn't support basic logging requirements for my multi-threading application so I had to use C++ macros to achieve what I wanted.

Here is my logger files:
xcap_logger.hpp

xcap_logger.cpp

I just don't understand why logging libraries have to be so complex and still doesn't provide basic logging features e.g file-name, line-number, thread-id etc..we need to learn from java community.

Sometime I feel that boost community should define the interface and let people implement rather than people contributing the implementations and boost community keep on rejecting :)

Here is what I am looking in boost logging library.

My basic requirements for logging libraries are below.

1. Date and Time
2. File Name. Similar to __FILE__ macro
3. Line Number. Similar to __LINE__ macro
4. Current thread id. (pthread_self)
5. Parent thread id. (getpid())
6. Log level (from trace, debug, info, warn, error, critical)
7. Module name
8. Data
e.g
|2009-Sep-22 22:04:47.340047|file.cpp:212|0xb0103000:0xb01020000|INFO|XCAP|test-data

Compiling Boost libraries on Mac/Linux

noreply@blogger.com (Neuro Yogi) — Tue, 22 Sep 2009 19:28:53 PDT

1. Download/checkout the boost source code. Let's say we are downloading it at /opt/boost directory
>cd /opt/boost
>svn co http://svn.boost.org/svn/boost/trunk boost-trunk
2. Download following external source libraries at /opt/boost directory and unzip and compile them.
a. bzip
b. expat
c. icu
d. zlib
3. cd to boost-trunk directory and run ./bootstrap.sh (you might have to execute chmod 755 bootstrap.sh)
4. Below is the script which sets the environments and compiles the boost libraries.
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/lib:/usr/local/lib:/usr/lib:.
export DYLD_LIBRARY_PATH=$LD_LIBRARY_PATH
export BOOST_BIN_ROOT=/opt/boost/boost-binary
export BOOST_INSTALL_DIR=/opt/boost/boost-trunk
export PATH=$PATH:/opt/boost/bjam
export EXPAT_INCLUDE=/opt/boost/expat/include
export EXPAT_LIBPATH=/opt/boost/expat/lib
export HAVE_ICU=1
export BZIP2_SOURCE=/opt/boost/bzip2-1.0.5
export ZLIB_SOURCE=/opt/boost/zlib-1.2.3
export ICU_PATH=/opt/boost/icu/source
cd $BOOST_INSTALL_DIR
bjam threading=multi variant=release link=shared --build-dir=$BOOST_BIN_ROOT --prefix=$BOOST_INSTALL_DIR --without-mpi toolset=darwin install

5. If you want to compile specific library, replace bjam command from above script
bjam threading=multi variant=release link=shared --with-$1 --build-dir=$BOOST_BIN_ROOT --prefix=$BOOST_INSTALL_DIR toolset=darwin install

Here in --with-$1 where $1 would be your library name.

Performance Comparison: Apache ODE versus Sun's BPEL Engine

noreply@blogger.com (Neuro Yogi) — Tue, 22 Sep 2009 19:26:25 PDT

We are evaluating Apache ODE and Sun BPEL Engine for our Service Orchestration application. I read in many blogs that ODE out performs other BPEL engine (no one gave real numbers) but we found Sun's BPEL outperforms Apache ODE in terms of performance comparison as well as stability when persistent was enabled.

We ran two tests. One with ServiceMix/ODE and other with glassfish ESB/Sun-bpel.
Server: RedHat AS (Linux quad core)
Client: 4 client machine running jmeter with 25 threads (Total 100 threads)

JDK 1.5_0_16

Service 3.2.2 : Standalone mode :
http://www.apache.org/dyn/closer.cgi?path=%2Fservicemix%2Fservicemix-3%2F3.2.2%2Fapache-servicemix-3.2.2.tar.gz
Apache Ode 1.2 http://www.apache.org/dyn/closer.cgi/ode/apache-ode-jbi-1.2.zip

Glassfish: V2-UR2-b4-20080411
OpenESB:080909
Sun-bpel: 080909 release
Test case:
One incoming SOAP request with 1st parameter as a number and 2nd as a String.
Inside BPEL, based on 1st parameter, we are executing while loop of that many times. Psuedo code:
function testLoop(int iteration, string data) {
int index = 0, count = 0;
int length = data.length;
while (index++ < iteration) { count = (index + 1) % length ; } } To can read more about performance comparison and download a sample BPEL file and a service assembly at Apache Ode User Forum

HSQLDB support for OpenESB's BPEL-SE Persistent

noreply@blogger.com (Neuro Yogi) — Sat, 30 May 2009 12:53:56 PDT

Currently BPEL-SE only supports MySQL and Derby databases for its persistent feature. I have implemented support for HSQLDB by modifying the BPEL-SE source code and also fixing some issues in HSQLDB which eventually incorporated in HSQLDB by Fred.

See the HSQLDB support patch for BPLE-SE submitted to OpenESB forum. You will have to download latest BPEL-SE source code and apply this patch untill it is incorporated into mainline.

See patches 2783683 and 2786071 submitted to HSQLDB forum.
Fred has incorporated/fixed all the pending issues related to BPEL-SE support. So download latest code and try it out !!

IMS Training: Worth it !!

noreply@blogger.com (Neuro Yogi) — Sat, 30 May 2009 12:54:22 PDT

My company invited Christophe Gourraud; author of The IMS Lantern to give us three days training on The IMS Application Layer. We thoroughly enjoyed this course. The course doesn't only describe IMS application related specification but also helps understanding what lies behind by providing insights on historical time lines, assumptions, mistakes, conflicts between companies and reason behind that and most importantly his personal view on certain IMS specifications and what is the best way to implement it.

I would personally recommend Christophe and his course on the IMS Application Layer to any one who want to understand why IMS !!

DLink DWL-G120 B1 Wireless Adapter installation guide

noreply@blogger.com (Neuro Yogi) — Tue, 14 Aug 2007 21:18:38 PDT

Since I installed Ubnutu 7.0.4, I lost my wireless connectivity and had to stay in my bedroom where my network hub is installed. I had been trying to get it working but was not successful.
I came across Sam Liu's blog about installing the wireless adapter which is a step by step tutorial to install the driver.
It uses ndiswrapper and prism02 driver from windows.

If I remember correctly, earlier I followed his steps but didn't work and that was because I didn't follow his steps to reboot the laptop. So follow his steps and have wireless access to net !!