Bhupendra Kanojiya

How Drupal Cache Works..Varnish, Memcache, Drupal Internal Cache and CDN...

2017-05-14T01:26:00.001-07:00

How to do the performance tuning in your Drupal website ?

Yep, everyone wants their site to be loaded withing some millisecond. No one have to time to wait Correct.

I was working on Acquia environment and was really pissed off to understand why there are multilevel of Cache. So guys first check the below diagram.

What is CDN and how does it works ?

CDN referred the domain name server(DNS) to their server once the end user access the site. It’s a layer of caching before request reached the actual server. CDN server located in different regions worldwide.

a. Its consuming 60%-70% requests every day of your site.

b. It can cache the static pages html, css, javascript files, images, json etc. and dynamic request go to next level of caching.

When resources on site are cached on CDN data centers, it allows CDN to send those resources to our visitors from a location closest to them. This will increase our domain's loading speed and save your origin server bandwidth. If no settings are changed and no headers that prevent caching are sent from the origin server, then CDN caches all static content with the extensions that CDN will cache by default. This includes images, CSS, and JavaScript.

Source

Varnish Cache

This cache stored in load balancer server in Acquia. So when the request come to load balancer it check the cache if page exist in varnish it return the response.

Single page varnish purge is possible to clear through the site UI.

Varnish stores data in virtual memory and leaves the task of deciding what is stored in memory and what gets paged out to disk to the operating system. This helps avoid the situation where the operating system starts caching data while it is moved to disk by the application

Varnish is heavily threaded, with each client connection being handled by a separate worker thread. When the configured limit on the number of active worker threads is reached, incoming connections are placed in an overflow queue; when this queue reaches its configured limit incoming connections will be rejected.

The principal configuration mechanism is Varnish Configuration Language (VCL), a domain-specific language (DSL) used to write hooks that are called at critical points in the handling of each request. Most policy decisions are left to VCL code, making Varnish more configurable and adaptable than most other HTTP accelerators. When a VCL script is loaded, it is translated to C, compiled to a shared object by the system compiler, and loaded directly into the accelerator which can thus be reconfigured without a restart.

A number of run-time parameters control things such as the maximum and minimum number of worker threads, various timeouts, etc. A command-line management interface allows these parameters to be modified, and new VCL scripts to be compiled, loaded and activated, without restarting the accelerator.

In order to reduce the number of system calls in the fast path to a minimum, log data is stored in shared memory, and the task of monitoring, filtering, formatting and writing log data to disk is delegated to a separate application.

Memchached

Ø Memchached stored the database queries value in RAM memory so the data comes from cache instead of db server. Memchached store in memory of application server.

Ø Memcached is a general-purpose memory cache server daemon. It can improve Drupal application performance by moving Drupal's standard caches out of the database and by caching the results of other expensive database operations.

Ø “memcached is an in-memory key value store for small chunks of arbitrary data (strings, object) from result of database calls, API calls, or Page rendering”- Memcached.org

Ø A system to cache data in RAM rather in database.

Ø Replaces Drupal’s default database cache.

Ø Just one component of your high performance scalable architecture.

Why use memcached

ü Improves cache read/write performance.

ü Reduces the number of database queries.

ü Reduces database load.

ü Can improve page load performance.

ü Allows distributing the cache load to separate servers

ü Moves the threshold for performance degradation to a higher number of concurrent users.

Install PHPUnit using composer in 3 steps

2015-03-05T10:51:00.000-08:00

Note : I am assuming composer already installed in your system, and composer environment variable added(Windows)

1. Create a folder phpunit to install "PHPUnit"
C://phpunit/
create a composer.json file in phpunit folder and past below code

{
    "require-dev": {
        "phpunit/phpunit": "4.5.*"
    }
}

2. Open command prompt go to your phpunit folder path

cd C://phpunit

composer install

3. Create enviorment variable C:\phpunit\vendor\bin and test in command prompt

phpunit -v

BAKE CAKEPHP WINDOWS XAMPP STEP BY STEP

2013-06-15T21:32:00.000-07:00

1. Open the command prompt and move to the directory where you installed XAMPP. Usually people installed in C drive. I installed in E drive so write C: in stead of E:

Step by step Bake cakephp windows XAMPP.

2. C:\cd xampp

3. C:\xampp>cd php

4. C:\xampp/php>php.exe C:/xampp/htdocs/projectfolder/lib/cake/console/cake.php bake

Happy Baking...

Bake CAKEPHP Linux in 4 lines

2013-05-16T03:13:00.000-07:00

BAKE CAKEPHP LINUX

1.You have to connect the server through terminal. example: ssh FTP Username@Host (ssh xyz@192.168.1.1)

2. Please give your FTP password

3. Please provide the PHP path and cakePHP console path.

exp: /usr/bin/php lib/cake/console/cake.php bake all
/usr/bin/php -> The server PHP path
cake/console/cake.php -> The cakePHP console path

4. You will get the message
Welcome to CakePHP v2.3.0.0 Console

--------------------------------------------------------------
App : app
Path: /var/www/html/project/app
---------------------------------------------------------------
Interactive Bake Shell
---------------------------------------------------------------
[D]atabase Configuration
[M]odel
[V]iew
[C]ontroller
[P]roject
[F]ixture
[Q]uit
What would you like to Bake? (D/M/V/C/P/Q)
>
Here you will find the complete instruction how to Bake.

Select Date Range From Jquery Date-Picker

2013-04-17T05:10:00.001-07:00

<input type="text" name="txtdate_0" id="dp1310711996720" autocomplete="off"/>

<script>

$(function(){
var cur = -1, prv = -1;
$( "#dp1310711996720" ).datepicker({
close:false,
changeMonth: true,
changeYear: true,
showButtonPanel: true,
beforeShowDay: function ( date ) {
return [true, ( (date.getTime() >= Math.min(prv, cur) && date.getTime() <= Math.max(prv, cur)) ? 'date-range-selected' : '')];
},
onSelect: function ( dateText, inst ) {
var d1, d2;

prv = cur;
cur = (new Date(inst.selectedYear, inst.selectedMonth, inst.selectedDay)).getTime();
if ( prv == -1 || prv == cur ) {
prv = cur;
$('#dp1310711996720').val( dateText );

this._updateDatepicker(inst);

$("#dp1310711996720").datepicker( "show" );
} else {
d1 = $.datepicker.formatDate( 'mm/dd/yy', new Date(Math.min(prv,cur)), {} );
d2 = $.datepicker.formatDate( 'mm/dd/yy', new Date(Math.max(prv,cur)), {} );
$('#dp1310711996720').val( d1+' - '+d2 );
}
},
onClose: function(date,b){

var dat=$("#dp1310711996720").val();
if(dat.length=='10'){
/*alert("here");
return false;*/
$("#dp1310711996720").datepicker("refresh").show();
}
}
});
});

</script>

Get latitude and longitude from zip code google api

2013-03-11T22:52:00.000-07:00

Use this api for getting latitude and longitude from zip code

http://maps.googleapis.com/maps/api/geocode/json?address=zipcode&sensor=false

Example

http://maps.googleapis.com/maps/api/geocode/json?address=482002&sensor=false

SIMPLE PIE CHART

2013-03-01T04:54:00.004-08:00

<?php
// create image
$image = imagecreatetruecolor(300, 300);

$bg = imagecolorallocate ( $image, 255, 255, 255 );
imagefill ( $image, 0, 0, $bg );

// allocate some colors
$white    = imagecolorallocate($image, 0xFF, 0xFF, 0xFF);
$gray     = imagecolorallocate($image, 0xC0, 0xC0, 0xC0);
$darkgray = imagecolorallocate($image, 0x90, 0x90, 0x90);
$navy     = imagecolorallocate($image, 0x00, 0x00, 0x80);
$darknavy = imagecolorallocate($image, 0x00, 0x00, 0x50);
$red      = imagecolorallocate($image, 0xFF, 0x00, 0x00);
$green = imagecolorallocate($image, 116, 232, 70);

$darkgreen = imagecolorallocate($image, 19, 94, 6);

// make the 3D effect
for ($i = 160; $i > 150; $i--) {
   imagefilledarc($image, 150, $i, 250, 200, 0, 90, $darknavy, IMG_ARC_PIE);
   imagefilledarc($image, 150, $i, 250, 200, 45, 120 , $darkgray, IMG_ARC_PIE);
imagefilledarc($image, 150, $i, 250, 200, 120, 240 , $darkgreen, IMG_ARC_PIE);
   imagefilledarc($image, 150, $i, 250, 200, 240, 360 , $darkred, IMG_ARC_PIE);
}

imagefilledarc($image, 150, 150, 250, 200, 0, 90, $navy, IMG_ARC_PIE);
imagefilledarc($image, 150, 150, 250, 200, 45, 120 , $white, IMG_ARC_PIE);
imagefilledarc($image, 150, 150, 250, 200, 120, 240 , $green, IMG_ARC_PIE);
imagefilledarc($image, 150, 150, 250, 200, 240, 360 , $red, IMG_ARC_PIE);
// Create a new image instance
// $im = imagecreatetruecolor(50, 20);
// $black = imagecolorallocate($im, 0, 0, 0);
// $white = imagecolorallocate($im, 255, 255, 255);

// // Make the background white
// imagefilledrectangle($im, 0, 0, 49, 19, $white);

// Load the gd font and write 'Hello'
$font = imageloadfont('./04b.gdf');
imagestring($image, $font, 150, 120, 'Hello again', $green);
imagestring($image, $font, 150, 180, 'Hello', $green);

// Output to browser
// header('Content-type: image/png');

// flush image
header('Content-type: image/png');
imagepng($image);
imagedestroy($image);

function hex2rgb($hex) {
   $hex = str_replace("#", "", $hex);

   if(strlen($hex) == 3) {
      $r = hexdec(substr($hex,0,1).substr($hex,0,1));
      $g = hexdec(substr($hex,1,1).substr($hex,1,1));
      $b = hexdec(substr($hex,2,1).substr($hex,2,1));
   } else {
      $r = hexdec(substr($hex,0,2));
      $g = hexdec(substr($hex,2,2));
      $b = hexdec(substr($hex,4,2));
   }
   $rgb = array($r, $g, $b);
   //return implode(",", $rgb); // returns the rgb values separated by commas
   return $rgb; // returns an array with the rgb values
}

?>

BKLibrary will release soon for pie chart....

Split a huge file in parts : PHP SCRIPT

2013-02-27T23:39:00.001-08:00

I had a file of more than 200mb which were unable to process even I was getting the problem while opening that. Below function will change you file to different parts.

<?php
error_reporting(E_ALL);

split_file('/images.txt');
echo $filePath;
exit;
/**
*
* Split large files into smaller ones
* @param string $source Source file
* @param string $targetpath Target directory for saving files
* @param int $lines Number of lines to split
* @return void
*/
function split_file($source, $targetpath='/split/', $lines=1000){
// echo $source."/".$targetpath;
// exit;
    $i=0;
    $j=1;
    $date = date("m-d-y");
    $buffer='';

    $handle = fopen ($_SERVER['DOCUMENT_ROOT'].$source, "r");

    while (!feof ($handle)) {
        $buffer .= fgets($handle, 4096);
        $i++;
        if ($i >= $lines) {
            $fname = $_SERVER['DOCUMENT_ROOT'].$targetpath."part_".$date.$j.".txt";

$fhandle = fopen($fname, "w") or die($php_errormsg);

            if (!$fhandle) {
                echo "Cannot open file ($fname)";
                //exit;
            }

//     chmod($fname,2);
            if (!fwrite($fhandle, $buffer)) {
                echo "Cannot write to file ($fname)";
                //exit;
            }
            fclose($fhandle);
            $j++;
            $buffer='';
            $i=0;
            $line+=10; // add 10 to $lines after each iteration. Modify this line as required
        }
    }
    fclose ($handle);
}
?>

Import CSV file PHP EXAMPLE

2013-02-06T22:06:00.000-08:00

To import an Excel file through PHP, first export it as a CSV file. Remove the CSV headers from the generated CSV file along with empty data that Excel may have put at the end of the CSV file. This php script will ignore the first row of CSV.

/*PHP CODE in post section*/

<?php

echo $_FILES['import']['tmp_name'];
      $filename=mktime().'_'.$_FILES['import']['name'];
      $path='common/csv/'.$filename;
    if(move_uploaded_file($_FILES['import']['tmp_name'],$path))
{
    if(mysql_query("load data local infile '".$path."' INTO TABLE tbl_customer FIELDS TERMINATED BY ',' enclosed by '\"' LINES TERMINATED BY '\n' IGNORE 1 LINES (`location`, `maildropdate`,`contact_number`,`first_name`,`mname`,`lastname`,`suffix`,`address`,`city`,`state`,`zip`)"))
    {
      echo "imported successfully";
      }

echo "<br>"."Uploaded Successfully".$path;
}

Clear cache of Ajax in IE

2012-12-12T02:25:00.000-08:00

$.ajaxSetup({ cache: false });

Today while working in a simple ajax functionality feel too much frustration when the script was working fine on all browser except IE. I tried many times, then I remove the cache and got the output on IE.

I try to remove browser cache using below meta

<meta http-equiv='cache-control' content='no-cache'>
<meta http-equiv='expires' content="-1">
<meta http-equiv='pragma' content='no-cache'>

but didn't get success. Because I was using the ajax and got the solution in 1 line after spent 2 hours. So never forget if ajax not giving the updated result use $.ajaxSetup({ cache: false });

Simple class to remove mobile number and email PHP

2012-10-19T02:32:00.000-07:00

<?php

class removeEmailMob
{
function parseTextForEmail($text) {
    $email = array();
    $invalid_email = array();

    $text = ereg_replace("[^A-Za-z._0-9@ ]"," ",$text);

    $token = trim(strtok($text, " "));

    while($token !== "") {

        if(strpos($token, "@") !== false) {

            $token = ereg_replace("[^A-Za-z._0-9@]","", $token);

            //checking to see if this is a valid email address
            if($this->is_valid_email($email) !== true) {
                $email[] = strtolower($token);
            }
            else {
                $invalid_email[] = strtolower($token);
            }
        }

        $token = trim(strtok(" "));
    }

    $email = array_unique($email);
    $invalid_email = array_unique($invalid_email);

    return $email;
//     return array("valid_email"=>$email, "invalid_email" => $invalid_email);

}

function is_valid_email($email) {
    if (eregi("^[_a-z0-9-]+(\.[_a-z0-9-]+)*@[a-z0-9-]+(\.[a-z0-9-]+)*(\.([a-z]){2,4})$",$email)) return true;
    else return false;
}

//$str = 'In My Cart : 11 12 items';

function removeEmail($text)
{

$emails=$this->parseTextForEmail($text);

/*Remove email*/

if(!empty($emails))
{
$string=str_replace(array_values($emails),"xxx@xxx.com",$text);
}

preg_match_all('!\d+!', $string, $matches);

/*Remove Mob Numbers*/
foreach($matches['0'] as $mobNum)
{
$numbers=strlen($mobNum);
if($numbers >= 10 && $numbers <=12 )
{
// echo "its a mobile number<br>".$mobNum;
    $string=str_replace($mobNum,"XXXXXXXXXX",$string);
}

}

return $string;

}
}

?>

<?php
ini_set( "display_errors", 0);

$obj=new removeEmailMob;
echo $obj->removeEmail(' email@domain.com aaj 9827575817 testing content should write here bhupendrakanojiya@gmail.com 9425412535 123 ravik@gmail.in');
?>

Output

xxx@xxx.com aaj XXXXXXXXXX testing content should write here xxx@xxx.com XXXXXXXXXX 123 xxx@xxx.com

li tag without bullets

2012-08-29T16:34:00.002-07:00

Hide bullets of li

ul li
{
list-style:none;
}

Resolve-Google Maps API SSL SEcuirty Alert message in IE

2012-08-02T13:22:00.002-07:00

Getting SECURITY ALERT on IE 9 while displaying Google map

use

<script src="https://maps.google.com/maps?file=api&v=2&hl=en&tab=wl&z=6&sensor=true&key=<?php echo $key;?>
" type="text/javascript"></script>

instead of

<script src="https://maps.googleapis.com/maps/api/js?key=YOUR_API_KEY&sensor=SET_TO_TRUE_OR_FALSE"
  type="text/javascript"></script>