Mini's Programming

[OpenCV] Comparing Image Similarity Using Feature Matching In Java

2015-09-22T10:06:00.003-07:00

It's comparing image similarity using feature matching.
I've used OpenCV and converted c language to java.

The source is as follows:

package kr.co.acronym;

import org.opencv.core.Core;
import org.opencv.core.CvType;
import org.opencv.core.DMatch;
import org.opencv.core.Mat;
import org.opencv.core.MatOfDMatch;
import org.opencv.core.MatOfKeyPoint;
import org.opencv.features2d.DescriptorExtractor;
import org.opencv.features2d.DescriptorMatcher;
import org.opencv.features2d.FeatureDetector;
import org.opencv.imgcodecs.Imgcodecs;

public class Mini {

 public static void main(String[] args) {
  // Set image path
  String filename1 = "C:\\images\\iphone1.jpeg";
  String filename2 = "C:\\images\\iphone2.jpeg";

  int ret;
  ret = compareFeature(filename1, filename2);
  
  if (ret > 0) {
   System.out.println("Two images are same.");
  } else {
   System.out.println("Two images are different.");
  }
 }

 /**
  * Compare that two images is similar using feature mapping  
  * @author minikim
  * @param filename1 - the first image
  * @param filename2 - the second image
  * @return integer - count that has the similarity within images 
  */
 public static int compareFeature(String filename1, String filename2) {
  int retVal = 0;
  long startTime = System.currentTimeMillis();
  
  System.loadLibrary(Core.NATIVE_LIBRARY_NAME);
  
  // Load images to compare
  Mat img1 = Imgcodecs.imread(filename1, Imgcodecs.CV_LOAD_IMAGE_COLOR);
  Mat img2 = Imgcodecs.imread(filename2, Imgcodecs.CV_LOAD_IMAGE_COLOR);

  // Declare key point of images
  MatOfKeyPoint keypoints1 = new MatOfKeyPoint();
  MatOfKeyPoint keypoints2 = new MatOfKeyPoint();
  Mat descriptors1 = new Mat();
  Mat descriptors2 = new Mat();

  // Definition of ORB key point detector and descriptor extractors
  FeatureDetector detector = FeatureDetector.create(FeatureDetector.ORB); 
  DescriptorExtractor extractor = DescriptorExtractor.create(DescriptorExtractor.ORB);

  // Detect key points
  detector.detect(img1, keypoints1);
  detector.detect(img2, keypoints2);
  
  // Extract descriptors
  extractor.compute(img1, keypoints1, descriptors1);
  extractor.compute(img2, keypoints2, descriptors2);

  // Definition of descriptor matcher
  DescriptorMatcher matcher = DescriptorMatcher.create(DescriptorMatcher.BRUTEFORCE_HAMMING);

  // Match points of two images
  MatOfDMatch matches = new MatOfDMatch();
//  System.out.println("Type of Image1= " + descriptors1.type() + ", Type of Image2= " + descriptors2.type());
//  System.out.println("Cols of Image1= " + descriptors1.cols() + ", Cols of Image2= " + descriptors2.cols());
  
  // Avoid to assertion failed
  // Assertion failed (type == src2.type() && src1.cols == src2.cols && (type == CV_32F || type == CV_8U)
  if (descriptors2.cols() == descriptors1.cols()) {
   matcher.match(descriptors1, descriptors2 ,matches);
 
   // Check matches of key points
   DMatch[] match = matches.toArray();
   double max_dist = 0; double min_dist = 100;
   
   for (int i = 0; i < descriptors1.rows(); i++) { 
    double dist = match[i].distance;
       if( dist < min_dist ) min_dist = dist;
       if( dist > max_dist ) max_dist = dist;
   }
   System.out.println("max_dist=" + max_dist + ", min_dist=" + min_dist);
   
      // Extract good images (distances are under 10)
   for (int i = 0; i < descriptors1.rows(); i++) {
    if (match[i].distance <= 10) {
     retVal++;
    }
   }
   System.out.println("matching count=" + retVal);
  }
  
  long estimatedTime = System.currentTimeMillis() - startTime;
  System.out.println("estimatedTime=" + estimatedTime + "ms");
  
  return retVal;
 }
}

I created a new function, compareFeature that is compared two images.
It calculates the distance of the feature in those images.

If you check the last of the source, I decide the similarity by the minimum distance of two images.
The distance value that I choose is 10.
But if you try more and more, the value is more precise.

The return value is the count of the distance under 10.
If it is one more, I think that the two images are similar.

I tested next 3 images.

When I checked image1.jpeg and image1.jpeg, the result is identical.

If I checked image1.jpeg and image2.jpeg, the result is similar.

If I checked image1.jpeg and image3.jpeg, the result is not similar.

R installation and usage for data analysis

2013-11-06T04:50:00.000-08:00

Introduction R

Today I provide a brief introduction about recent popular R language.
R is very an effective tool for statistics and graphics.
There are existing statistical programs such as SAS, SPSS.
However R is open source and it has a lot of packages.

The site of R is http://r-project.org.
You can download R program, documents, add-on packages, etc.

If you need to search for R, visit http://rseek.org.

Using R for Big-Data

You should consider something when R is used by Hadoop for big data processing.
R works based on a single core and in memory.
In other words, it is not composed of the distributed environment.

Thus some vendors are using R-Hadoop, R-Hive.

R Installation

Installation of R is very simple.
When you get install file from the R project site, you can install any OS like Mac, Windows, and Linux.

Now you can test R programming.

Real-Time Technology for Big Data

2013-11-02T07:55:00.000-07:00

Hadoop is used to process big-data.
However according to the needs for real-time, there is growing interest in the in-memory technology.

OLTP Database for real-time processing was used in times past.
We need a new approach in order to handle quickly data stream in Big data era.

Google is often processed numerous data in a short period through Dremel.
Let's look at technologies for real-time.

Redis

Redis is BSD-based open source and is an acronym for "Remote Dictionary System".
It classifies as No-SQL database because it has a key-value store.
It is also used for Message Queue and Shared Memory.
So it's sometimes used as a real-time processing.

This is architecture using node.js and redis. (Source: http://simonhampshire.wordpress.com/)

It is similar to memcached in the part of in-memory technology but it has saved the data onto disk unlike memcached.

Apache Kafka

Kafka was made by Linkedin for improving their log and tracking system.
Now it works on Apache Project.

It is Publish/Subscribe messaging system and it is used in conjunction with Hadoop.

I discovered that Netflix processes data log using Kafaka.

Esper

I beleive that the best technology about in-memory and real-time is the CEP(Complex Event Processing).
Oracle and SAP are now focused on CEP technology.

As an open source, Esper has a configuration of EPL such as SQL like script language.

CEP is the technology to filter specific event from numerous event.
It's a real-time processing using event-driven architecture.

Esper has architecture like this.

Sometimes to get the data into Espter used "storm".

Using eclipse shorcut!

2013-10-14T09:18:00.000-07:00

Why do we often use shortcut key during programming?
It maybe reduce the time of coding and reduce mistake.

It is not necessary to make use of shortcut, but we have to know essential shortcut.

Blue are often used.

단축키	설명
F3	Open Declaration: Jump to Declaration of selected class, method, or parameter [Ctrl + Mouse Click is the same]
F4	Open Type Hierarchy window for selected item
F5	Step Into function in debug
F6	Next step (line by line) in debug
F7	Step out in debug
F8	Skip to next Breakpoint in debug
F11	Debug
F12	Jump to Editor Window
Ctrl + 1	Open Quick Fix and Quick Assist
Ctrl + 7	Comment / uncomment line or selection ( adds '//' )
Ctrl + . (next) Ctrl + , (previous)	Jump to next / jump to previous compiler syntax warning or error
Ctrl + Space	Opens Content Assist (e.g. show available methods or field names)
Ctrl + T	Show / open Quick Type Hierarchy for selected item
Ctrl + O	Show code outline / structure
Ctrl + L	Jump to Line Number. To hide/show line numbers, press ctrl+F10 and select 'Show Line Numbers'
Ctrl + F	Open find and replace dialog
Ctrl + J Ctrl + Shift + J	Incremental search forward / backward. Type search term after pressing ctrl+j, there is now search window
Ctrl + K Ctrl + Shift + K	Find previous / find next occurrence of search term (close find window first)
Ctrl + H	Search Workspace (Java Search, Task Search, and File Search)
Ctrl + F6	Show list of open Editors. Similar to ctrl+e but switches immediately upon release of ctrl
Ctrl + F7 Ctrl + Shift + F7	Switch forward / backward between views (panels). Useful for switching back and forth between Package Explorer and Editor.
Ctrl + F8 Ctrl + Shift + F8	Switch forward / backward between perspectives
Ctrl + F11	Save and launch application (run)
Ctrl + Shft + F	Autoformat all code in Editor using code formatter
Ctrl + Shift + O	Remove unnecessary import declare
Ctrl + Alt + H	Open Call Hierarchy
Alt + Enter	Show and access file properties
Alt + Arrow Left Alt + Arrow Right	Go to previous / go to next Editor Window
Alt + Shift + R	Rename selected element and all references
Alt + Shift + M	Extract selection to method

The Code that remove HTML tag using regular expression

2013-10-06T07:17:00.003-07:00

I need some source code that extract text from HTML.
Using regular expression it is very simple.

It removes scripts, style, tags, entities, and whitespace.

 private String getText(String content) {  
      Pattern SCRIPTS = Pattern.compile("&lt;(no)?script[^&gt;]*&gt;.*?&lt;/(no)?script&gt;",Pattern.DOTALL);  
      Pattern STYLE = Pattern.compile("&lt;style[^&gt;]*&gt;.*&lt;/style&gt;",Pattern.DOTALL);  
      Pattern TAGS = Pattern.compile("&lt;(\"[^\"]*\"|\'[^\']*\'|[^\'\"&gt;])*&gt;");  
      Pattern nTAGS = Pattern.compile("&lt;\\w+\\s+[^&lt;]*\\s*&gt;");  
      Pattern ENTITY_REFS = Pattern.compile("&amp;[^;]+;");  
      Pattern WHITESPACE = Pattern.compile("\\s\\s+");  
        
      Matcher m;  
        
      m = SCRIPTS.matcher(content);  
      content = m.replaceAll("");  
      m = STYLE.matcher(content);  
      content = m.replaceAll("");  
      m = TAGS.matcher(content);  
      content = m.replaceAll("");  
      m = ENTITY_REFS.matcher(content);  
      content = m.replaceAll("");  
      m = WHITESPACE.matcher(content);  
      content = m.replaceAll(" ");             
        
      return content;  
 }

If you are interested, please try to test it.

The Function That Changes Global Time to Local Time in Java

2013-09-30T08:02:00.000-07:00

The time zone is the issue when you make global service.

There are four time zone in U.S.
PSF: Pacific Standard Time
MST: Mountain Standard Time
CST: Central Standard Time
EST: Eastern Standard Time

The function of transformation from UTC/GMT to local time

Sometimes you need to transform from standard time to local time.
You can use the function bellow.

 // Local Time -> UTC/GMT Time  
 public static long convertLocalTimeToUTC(long pv_localDateTime)  
 {  
   long lv_UTCTime = pv_localDateTime;  
     
   TimeZone z = TimeZone.getDefault();  
   //int offset = z.getRawOffset(); // The offset not includes daylight savings time  
   int offset = z.getOffset(pv_localDateTime); // The offset includes daylight savings time  
   lv_UTCTime = pv_localDateTime - offset;  
   return lv_UTCTime;  
 }  
   
 // UTC/GMT Time -> Local Time  
 public static long convertUTCToLocalTime(long pv_UTCDateTime)  
 {  
   long lv_localDateTime = pv_UTCDateTime;  
     
   TimeZone z = TimeZone.getDefault();  
   //int offset = z.getRawOffset(); // The offset not includes daylight savings time  
   int offset = z.getOffset(pv_UTCDateTime); // The offset includes daylight savings time  
     
   lv_localDateTime = pv_UTCDateTime + offset;  
     
   return lv_localDateTime;  
 }

It is very easy to understand.
You carefully check that the parameter with long type is return value from getDate() method in Date format.

Transform from UTC/GMT to local time using Date Format

Actually there is a need to change the form of the type such as "20120713064755".
This is the solution using SimpleDateFormat.

 import java.text.ParseException;  
 import java.text.SimpleDateFormat;  
 import java.util.Date;  
 import java.util.TimeZone;  
   
 public class ConverTimeZone {  
   
      public static void main(String[] args) {  
           // changes from UTC to local time  
           //String utcTime = "20120713184755";  
           String utcTime = "20120713064755";  
             
           String localTime = convertUtcToLocal(utcTime);  
             
           System.out.println("GMT/UTC: " + utcTime + ", local time: " + localTime);  
      }  
   
      /**  
       * the function that changes from UTC to local time   
       * @author xmlmanager  
       * @param utcTime GMT/UTC (format: 20120713064755)  
       * @return String local time   
       */  
      private static String convertUtcToLocal(String utcTime) {  
           String localTime = "";  
             
           // declare date format   
           SimpleDateFormat dateFormat = new SimpleDateFormat("yyyyMMddHHmmss");  
             
           try {  
                // changes from UTC to Date format  
                Date dateUtcTime = dateFormat.parse(utcTime);  
                  
                // changes from UTC Date format to the time of long type  
                long longUtcTime = dateUtcTime.getTime();  
                  
                // calculate the difference through TimeZone (if it is summer time, use getOffset than getRawOffset)  
                TimeZone zone = TimeZone.getDefault();  
                int offset = zone.getOffset(longUtcTime);  
                long longLocalTime = longUtcTime + offset;  
                  
                // changes from local time of long type to Date format  
                Date dateLocalTime = new Date();  
                dateLocalTime.setTime(longLocalTime);  
                  
                // return the string of local time  
                localTime = dateFormat.format(dateLocalTime);  
                  
           } catch (ParseException e) {  
                e.printStackTrace();  
           }             
             
           return localTime;  
      }  
 }

That's all!!

The Tip of Programming Comment

2013-09-29T08:39:00.000-07:00

There are two type of comments in java and C.
"//" is the inline comment and "/* .. */" is the block comment.

Sometimes mixing the two type of comments is very useful.

If you use like this, the first line is comment and second line runs.
/*
This is comment.
/*/
This runs.
//*/

When you add "/" in front of the "/*" at the beginning, it changes.

//*
This runs.
/*/
This is comment.
//*/

I used usually it when I need the test account.

Some problems of float and double variables in java

2012-03-31T07:58:00.000-07:00

You must not use the float or double datatype for accurate calculations.
At java programming, it doesn't get exact number to use the float or double datatype.

For example, if you had 1.03 dollars and used 42 cents, you remained 61 cents.
Using java programming answers as follows.

System.out.println(1.03 - .42);

---------- Execute ----------
0.6100000000000001

Not exactly what you want.

Because the float and double was designed for science and engineering, it calculates so fast as an approximate value.

So the float and double variables are imprecise.

What you use for accurate calculations?

The answer is int, long, and bigdecimal.

I refer to the book of effective java programming language guide.

How to verify country through Internet Protocol (IP)

2012-03-13T06:36:00.001-07:00

Many global homepages support various languages such as English, French, Spanish, etc.
I wondered that it verified the languages according to visitor.

By using cookies can be selected when the user had already visited.
If the user have visited at the homepage for the first time,
it will verify the country by user's IP address.

The MaxMind(http://www.maxmind.com/) is provided APIs that verified the country by IP address.

There are two APIs for geolocation solutions."GeoIP City" and "GeoLite City".
GeoLite City is for free and less accurate than GeoIP City.
I think GeoLite City is too good to achieve our goals.

Now I use the GeoLite City API to get the country into an IP address.
The API has supported for multiple program languages.
I use PHP programming language for this sample.
You go to http://www.maxmind.com/app/php and download Pure PHP Module.

I download "sample.php" of many sources.
The content of sample.php is as follows.

#!/usr/bin/php -q
<?php

// This code demonstrates how to lookup the country by IP Address

include("geoip.inc");

// Uncomment if querying against GeoIP/Lite City.
// include("geoipcity.inc");

$gi = geoip_open("/usr/local/share/GeoIP/GeoIP.dat",GEOIP_STANDARD);

echo geoip_country_code_by_addr($gi, "24.24.24.24") . "\t" .
geoip_country_name_by_addr($gi, "24.24.24.24") . "\n";
echo geoip_country_code_by_addr($gi, "80.24.24.24") . "\t" .
geoip_country_name_by_addr($gi, "80.24.24.24") . "\n";

geoip_close($gi);

?>

Look at the source. It includes "geoip.inc" file.
I download "geoip.inc" from Pure PHP Module.

Also we need to download "GeoIP.dat" files. It is binary format database.
You can download it next link.
http://geolite.maxmind.com/download/geoip/database/GeoLiteCountry/GeoIP.dat.gz

Unzip that file and copy it in server.

This example shows the country code and name.
For global homepage, I just need to know the country code.

I make PHP source to verify country through IP address and redirect to each language page.

<?
include("geoip.inc");

$gi = geoip_open("/usr/local/geoip/GeoIP.dat",GEOIP_STANDARD);
$addr = $_SERVER["REMOTE_ADDR"];

if (geoip_country_code_by_addr($gi, $addr) == "FR") {
header("Location: http://xmlmanager.blogspot.com/fr/");
exit;
}
else {
header("Location: http://xmlmanager.blogspot.com/en/");
exit;
}
?>

Using SwipeView for a swipe gesture in mobile web

2012-02-22T19:57:00.040-08:00

In mobile web, the swipe is the most commonly used features.
However, It is difficult to implement it.
It need to write many javascript code.

I introduce the SwipeView service.
It provide some script that handle swipe features.

http://cubiq.org/swipeview

The video is as follows.

It contains various contents such as image, text, and so on.

The image demo is as follows.
http://cubiq.org/dropbox/SwipeView/demo/gallery/

The text demo is as follows.
http://cubiq.org/dropbox/SwipeView/demo/ereader/

A test of blog's BGM using HTML5

2012-02-08T02:14:00.000-08:00

It can not be used this HTML5 test at current web browser (Use chrome, Safari, and firefox)

W3Schools.com have had many information about standard of W3C.
Especially It announced HTML5 tutorials. It's very useful for me.

http://www.w3schools.com/html5/default.asp

Some blogs have a background music such as BGM.
Most of all are used windows media player in Internet Explorer.

This sample used <audio> tag of HTML5.
I set auto play and hided controls. Maybe you can listen to music in this post.

Of course, It can be played in a browser that support <audio> tag of HTML5.
Under Internet Explorer 8, you saw just some text.

The source is as follows.
In the below source it is set control and repeat.

<audio autoplay="autoplay" loop="loop" controls="controls">
<source src="rain.mp3" type="audio/mpeg" />
<source src="rain.ogg" type="audio/ogg" />
</audio>

I tested at mobile environment.
Android is a fully working auto play.
Though iPhone support HTML5, it is not working auto play.
Only when the user clicks, the music is playing.

XML Quiz...

2012-02-06T03:48:00.000-08:00

Please answer next items as O or X

1) XML stands for “Example Markup Language”.

2) XML uses a DTD to describe the data.

3) XML’s goal is to replace HTML.

4) DTD stands for “Dynamic Type Definition”.

5) All XML documents must have a DTD.

6) All XML elements must be properly closed.

7) XML documents must have a root tag.

8) XML elements cannot be empty.

.
.
.
.
.
.
.
.

The answer is as follows.

1) XML stands for “Example Markup Language”. (X)
XML stands for "eXtensible Markup Language".

2) XML uses a DTD to describe the data. (O)

3) XML’s goal is to replace HTML. (X)
XML's goal is to replace SGML.

4) DTD stands for “Dynamic Type Definition”. (X)
DTD stands for "Document Type Definition".

5) All XML documents must have a DTD. (X)
Well-formed XML documents have not a DTD.

6) All XML elements must be properly closed. (O)

7) XML documents must have a root tag. (O)

8) XML elements cannot be empty. (X)
XML elements can be empty.