Knowledge Management IT for you

Welcome to KMIT4U

2012-12-31T21:09:00.001+07:00

Knowledge Management Information Technology for you.

This blog is written for share the knowledge in everything. Knowledge about how to Implement various issues ,Problem Solving ,System Architecture Design,Solution Design,Infrastructure Hardware,Storage,SAN,Operating system,Database,Backup for Consultant,Administration,Operation.
Aim to provide. Anyone read to help issue. Learning to solve problems improves.

Sign   ** Myself ** wrote myself.   #เขียนด้วยตัวเอง
     ** Credit **  for copy from other article.   #นำข้อมูลมาจาก web ต่างๆ เพื่อเผยแพร่
     ** Credit (Mr/K/Web) **  for Author article or any source. #จากผู้ที่ต้องการ share ข้อมูลครับ
[Thai Version] Post Thai language
#[Thai Version] สำหรับภาษาไทย

#Thank you for sender article for post .that here who want to share the articles for submitted and articles from experience of working.
# Thanks ! Interested
#ขอบคุณสำหรับผู้ส่งบทความหรือต้องการ เผยแพร่ครับ

Step by Step Single Node Cluster OpenAIS Suse 11 with Oracle11g & SAPInst

2012-01-21T03:13:00.000+07:00

**Myself

OpenAIS Cluster Environment

Cluster information

host01 information :

- hostname=host01

- ip= 172.10.10.10

- virtual IP=172.10.10.11

- heartbeat ip=No

- eth0=172.10.10.10 (data no heartbeat)

- eth1=Not use ,

- vgshare=qasdatavg

lv=lvol1,lvol2

- Oracle sid = QAS [Mcod csd,csq,bcd,bcq,j2d,j2q,ecd,ecq]

- SAP sid = j2d,j2q,trex_90,trex_92

- disk on qasdatavg= md0/md1/md2/md3/md4

Create OpenAIS cluster

Create a shared volume group.
Create a OpenAIS Cluster.
Create an application package.
Dependency or Constraints of Resource cluster startup.
Maintain cluster.

1. Create a shared volume group

1. Install multipath and configuration mpio/lvm	(SLES 9 only) Changing system configuration Using an editor of your choice, within /etc/sysconfig/hotplug set this value: `HOTPLUG_USE_SUBFS=no` On SLES: rpm -ivh multipath-tools-0.X.X-XX.X.i586.rpm On Red Hat: rpm -ivh device-mapper-multipath-0.X.X-XX.elX.x86_64.rpm - Load driver for the HBA is added to INITRD_MODULES in /etc/sysconfig/kernel INITRD_MODULES="cciss reiserfs piix megaraid_sas mptspi siimage processor thermal fan jbd ext3 dm_mod edd dm-multipath qla2xxx" - Ensure that boot.multipath and multipathd are set to start on boot: MPIO Services chkconfig boot.multipath on chkconfig multipathd on The services can be started immediately with: /etc/init.d/boot.multipath start /etc/init.d/multipathd start To verify chkconfig --list \| grep multipath - Configuring multipath-tools /etc/multipath.conf. “failback 60” # incase san not stable Suse if the /etc/multipath.conf file does not exist, copy the example to create the file: cp /usr/share/doc/packages/multipathtools/multipath.conf.synthetic /etc/multipath.conf Edit Backlist blacklist { *devnode "^(ram\|raw\|loop\|fd\|md\|dm-\|sr\|scd\|st\|sda)[0-9]" devnode "^hd[a-z][0-9]"* *devnode "^cciss!c[0-9]d[0-9]." } - MD RAID Preconfiguration chkconfig boot.md off It is still possible to use local MD devices. These can be configured in the file /etc/mdadm.conf.localdevices, which uses the same syntax as the /etc/mdadm.conf. The cluster tools RPM package contains a new initscript called boot.md-localdevices. Copy this file to the /etc/init.d directory and enable it using the command chkconfig boot.md-localdevices on** - Using LVM2 on top of the MPIO devices modify`/etc/lvm/lvm.conf` filter = [ "a\|/dev/sda[1-4]\|", "a\|/dev/md.\|", "r\|/dev/.\|" ] - Reboot
2 Create *md Configuration*	Check DM multipath *multipath -l* 600507680281816384000000000000dc dm-27 ABC,1234 size=200G features='1 queue_if_no_path' hwhandler='0' wp=rw \|-+- policy='round-robin 0' prio=50 status=active \| \|- 3:0:0:4 sdf 8:80 active ready running \| `- 4:0:0:4 sdp 8:240 active ready running `-+- policy='round-robin 0' prio=10 status=enabled \|- 3:0:1:4 sdk 8:160 active ready running `- 4:0:1:4 sdu 65:64 active ready running 3600507680281816384000000000000cc dm-26 ABC,1234 size=200G features='1 queue_if_no_path' hwhandler='0' wp=rw \|-+- policy='round-robin 0' prio=50 status=active \| \|- 3:0:1:3 sdj 8:144 active ready running \| `- 4:0:1:3 sdt 65:48 active ready running `-+- policy='round-robin 0' prio=10 status=enabled \|- 3:0:0:3 sde 8:64 active ready running `- 4:0:0:3 sdo 8:224 active ready running 3600507680281816384000000000000cb dm-25 ABC,1234 size=200G features='1 queue_if_no_path' hwhandler='0' wp=rw \|-+- policy='round-robin 0' prio=50 status=active \| \|- 3:0:0:2 sdd 8:48 active ready running \| `- 4:0:0:2 sdn 8:208 active ready running `-+- policy='round-robin 0' prio=10 status=enabled \|- 3:0:1:2 sdi 8:128 active ready running `- 4:0:1:2 sds 65:32 active ready running 3600507680281816384000000000000ca dm-23 ABC,1234 size=200G features='1 queue_if_no_path' hwhandler='0' wp=rw \|-+- policy='round-robin 0' prio=50 status=active \| \|- 3:0:1:1 sdh 8:112 active ready running \| `- 4:0:1:1 sdr 65:16 active ready running `-+- policy='round-robin 0' prio=10 status=enabled \|- 3:0:0:1 sdc 8:32 active ready running `- 4:0:0:1 sdm 8:192 active ready running 3600507680281816384000000000000c9 dm-24 ABC,1234 size=200G features='1 queue_if_no_path' hwhandler='0' wp=rw \|-+- policy='round-robin 0' prio=50 status=active \| \|- 3:0:0:0 sdb 8:16 active ready running \| `- 4:0:0:0 sdl 8:176 active ready running `-+- policy='round-robin 0' prio=10 status=enabled \|- 3:0:1:0 sdg 8:96 active ready running `- 4:0:1:0 sdq 65:0 active ready runnin #Create MD arrays using mdadm. mdadm --create /dev/md0 --raid-devices=1 --level=0 --metadata=1.2 --force /dev/mapper/3600507680281816384000000000000c9 mdadm --create /dev/md1 --raid-devices=1 --level=0 --metadata=1.2 --force /dev/mapper/3600507680281816384000000000000ca mdadm --create /dev/md2 --raid-devices=1 --level=0 --metadata=1.2 --force /dev/mapper/3600507680281816384000000000000cb mdadm --create /dev/md3 --raid-devices=1 --level=0 --metadata=1.2 --force /dev/mapper/3600507680281816384000000000000cc mdadm --create /dev/md4 --raid-devices=1 --level=0 --metadata=1.2 --force /dev/mapper/3600507680281816384000000000000dc #Create md for reboot /clusterconf/QAS/mdadm.conf ARRAY /dev/md0 UUID=cb6443ea:7a85f171:3dfca667:723eb9c9 ARRAY /dev/md1 UUID=fd640129:153c4dd5:0a7b2596:44c1584f ARRAY /dev/md2 UUID=e8c6b9d2:14f71cee:f27dc725:c452ea1e ARRAY /dev/md3 UUID=8158487c:5ea824ee:fe01fca9:32dc5cbd ARRAY /dev/md4 UUID=2e152c68:2f72bfb8:4373b348:1164ddc6 #manually start and stop md devices like this: # to stop md scan mdadm --stop -scan # to verify stop md more /proc/mdstat mdadm --detail /dev/md0 for DEVICE in /dev/md0 /dev/md1 /dev/md2 /dev/md3 /dev/md4; do mdadm --assemble "${DEVICE}" --config=/clusterconf/QAS/mdadm.conf; done; ## to scan md -> mdadm --assemble --scan
3. create physical volumn	for i in 0 1 2 3 4 do pvcreate -f /dev/md$i done
4. create vg	vgcreate /dev/qasdatavg /dev/md0 /dev/md1 /dev/md2 /dev/md3 /dev/md4
5. create lv	lvcreate -L 20G -n lvorahomeQAS /dev/qasdatavg lvcreate -L 1G -n lvQASoriglogA /dev/qasdatavg lvcreate -L 1G -n lvQASoriglogB /dev/qasdatavg lvcreate -L 1G -n lvQASmirrlogA /dev/qasdatavg lvcreate -L 1G -n lvQASmirrlogB /dev/qasdatavg lvcreate -L 30G -n lvQASoraarch /dev/qasdatavg lvcreate -L 130G -n lvQASsapdata1 /dev/qasdatavg lvcreate -L 130G -n lvQASsapdata2 /dev/qasdatavg lvcreate -L 130G -n lvQASsapdata3 /dev/qasdatavg lvcreate -L 130G -n lvQASsapdata4 /dev/qasdatavg
6. create file system	mkfs.ext3 /dev/qasdatavg/lvorahomeQAS mkfs.ext3 -b 1024 /dev/qasdatavg/lvQASoriglogA mkfs.ext3 -b 1024 /dev/qasdatavg/lvQASoriglogB mkfs.ext3 -b 1024 /dev/qasdatavg/lvQASmirrlogA mkfs.ext3 -b 1024 /dev/qasdatavg/lvQASmirrlogB mkfs.ext3 /dev/qasdatavg/lvQASoraarch mkfs.ext3 /dev/qasdatavg/lvQASsapdata1 mkfs.ext3 /dev/qasdatavg/lvQASsapdata2 mkfs.ext3 /dev/qasdatavg/lvQASsapdata3 mkfs.ext3 /dev/qasdatavg/lvQASsapdata4 #verify blocksize dumpe2fs -h /dev/mapper/qasdatavg-lvQASmirrlogA \|grep "Block size" dumpe2fs -h /dev/mapper/qasdatavg-lvQASoraarch \|grep "Block size"
7. create layout fs	mkdir -p /oracle/QAS mkdir -p /oracle/QAS/sapdata1 mkdir -p /oracle/QAS/sapdata2 mkdir -p /oracle/QAS/sapdata3 mkdir -p /oracle/QAS/sapdata4 mkdir -p /oracle/QAS/origlogA mkdir -p /oracle/QAS/origlogB mkdir -p /oracle/QAS/mirrlogA mkdir -p /oracle/QAS/mirrlogB mkdir -p /oracle/QAS/oraarch

2. Create a OpenAIS Cluster

1. Create file authentication key 2 node ( ทำ ที่ host01 )	host01# ssh-keygen -t rsa # Copy from put to authorized cp -rp /root/ssh/id_rsa.pub /root/ssh/authorized_keys # Test know host ssh host01
2. configuration cluster information	Yast2->other->cluster Generate chkconfig csync2 on chkconfig xinetd on # start OpenAIS rcopenais start
3. Set hacluster password connection	host01# passwd hacluster password
4. Set stonith and quorum to single node	crm configure property stonith-enabled="false" crm configure property expected-quorum-votes="1" crm configure show property $id="cib-bootstrap-options" \ dc-version="1.1.2-ecb1e2ea172ba2551f0bd763e557fccde68c849b" \ cluster-infrastructure="openais" \ expected-quorum-votes="1" \ stonith-enabled="false" #restart rcopenais stop; rcopenais start
5. Start pacemaker configuration	Yast2->other->pacemaker --or-- hb_gui
6. Add Resource virtual ip	Resources->Add->group primitive ADD OK->Apply
7. Add Resource disk resource [md disk]	Resources->Add->group primitive ADD Name:Raidconf Value:/clusterconf/QAS/mdadm.conf Name:raiddev Value:/dev/md0 Add primitive md1,md2,md3,md4 OK->Apply Cancel->apply
8. Add volume group and logical volume resource [lvm]	Resources->Add->group ora_vg_qasdb primitive ADD Name:volgrpname Value:qasdatavg OK->Apply Cancel->apply #### Add File system map logical volume Resources ora_vg_qasdb->Add->primitive Device: /dev/qasdatavg/lvorahomeQAS Directory: /oracle/QAS Fstype: ext3 ##Add all lv/FS ID=qas_lvQASoriglogA [ocf,heartbeat,Filesystem] Device: /dev/qasdatavg/lvQASoriglogA Directory: /oracle/QAS/origlogA Fstype: ext3 ID=qas_lvQASoriglogB [ocf,heartbeat,Filesystem] Device: /dev/qasdatavg/lvQASoriglogB Directory: /oracle/QAS/origlogB Fstype: ext3 ID=qas_lvQASmirrlogA [ocf,heartbeat,Filesystem] Device: /dev/qasdatavg/lvQASmirrlogA Directory: /oracle/QAS/mirrlogA Fstype: ext3 ID=qas_lvQASmirrlogB [ocf,heartbeat,Filesystem] Device: /dev/qasdatavg/lvQASmirrlogB Directory: /oracle/QAS/mirrlogB Fstype: ext3 ID=qas_lvQASoraarch [ocf,heartbeat,Filesystem] Device: /dev/qasdatavg/lvQASoraarch Directory /oracle/QAS/oraarch Fstype: ext3 ID=qas_lvQASsapdata1 [ocf,heartbeat,Filesystem] Device: /dev/qasdatavg/lvQASsapdata1 Directory /oracle/QAS/sapdata1 Fstype: ext3 ID=qas_lvQASsapdata2 [ocf,heartbeat,Filesystem] Device: /dev/qasdatavg/lvQASsapdata2 Directory /oracle/QAS/sapdata2 Fstype: ext3 ID=qas_lvQASsapdata3 [ocf,heartbeat,Filesystem] Device: /dev/qasdatavg/lvQASsapdata3 Directory /oracle/QAS/sapdata3 Fstype: ext3 ID=qas_lvQASsapdata4 [ocf,heartbeat,Filesystem] Device: /dev/qasdatavg/lvQASsapdata4 Directory /oracle/QAS/sapdata4 Fstype: ext3
9. Add logical volume group resource [lvm]	ora_vg_qasdb primitive ADD Name:volgrpname Value:qasdatavg OK->Apply Cancel->apply

3. Create an application package.

1. Add primitive oracle listener  ora_list_vhost1

Resources-> ora_list_vhost1 ->Edit-> primitive->add

ID: listener_crmqasdb

Class: ocf

Provider:heartbeat

Type: oralsnr

SID=QAS

Add

Name=listener

Value=LISTENER

Name=home

Value=/oracle/QAS/112_64

OK

#Start listener resource

host01:~ # crm resource start  ora_list_crmqasdb

2. Create New Group Oracle Instant [QAS]

Resources-> Add->group->

 ora_inst_QAS_crmqasdb

primitive

ora_QAS_crmqasdb

ADD

Sid:QAS

Home:/oracle/QAS/112_64

User:oraqas

Shutdown_method:immediate

OK->Apply

Cancel->apply

#Start oracle instant resource

host01:~ # crm resource start  ora_inst_QAS_crmqasdb

3. [Option] Create New Group SAP CI/ACS [J2D and TREX] Instant

Note 995116 - Backward porting of sapstartsrv for earlier releases

Manual postprocessing in Release 6.40 for non-Windows platforms

1. Set the "SAPSYSTEM" profile parameter in the start profile in accordance with the value in the relevant instance profile for each instance.

2. The Unicode version of sapstartsrv requires the shared library librfcum. In Release 6.40, this was originally not included in all replication lists (for example, scs.lst and scsclient.lst). After you import Support Package 20, these lists are updated and exist in librfcum. If you want to activate sapstartsrv only by applying the relevant kernel patch or importing sapexe.sar, you can manually copy librfcum until you import Support Package 20.

3. Set up the autostart of sapstartsrv in accordance with Note 823941. You can do this by once installing sapinit on each application server (the required scripts are available in the attachment to this note) and enter the start of sapstartsrv in /usr/sap/sapservices for each instance. During the following OS boot, the start services are started. You can also start the services by executing /usr/sap/sapservices. All entered sapstartsrv are executed as root and started for all systems and instances. The start services are executed as <sid>adm and started for the relevant system. You can also use "sapcontrol -nr <instance no.> -function StartService <SID>" to manually start individual services. For Release 6.40, we currently do not intend to provide an autostart of sapstartsrv using startsap (as in Release 700).

Note 823941 - SAP start service on Unix platforms

Summary

Symptom

After an SAP upgrade, the SAP Start Service (sapstartsrv) on UNIX platforms is not automatically started when the operating system is started.

Other terms

sapstartsrv, sapinit, installsapinit.sh, configure sapstartsrv as a boot service, sapstartsrv as an SYSV service.

Solution

In order to configure the SAP Start Service (sapstartsrv) as boot service, you must make some manual changes after the upgrade.

First, you must copy the 'sapinit' script to the correct location. This takes place automatically by using the 'installsapinit.sh' script. In the case of IBM i, you can skip this step.

Log on to the operating system as user 'root'.

Execute the following command in the 'DIR_PUT/bin' directory (or /usr/sap/jupgrade/exe in the case of a Java upgrade):

./installsapinit.sh

The 'sapinit' script was now copied to the correct location and the runlevel directories updated accordingly, so that sapinit is called automatically when the operating system is restarted and starts sapstartsrv.

If sapinit/installsapinit.sh does not exist, download the
attached sapinit.tgz (or sapinit.sar). The archive

contains both scripts. Extract the archive to a temporary

directory and proceed as described above.

Create a file called 'sapservices' in the '/usr/sap/' directory. The file should contain the corresponding commands to be able to start the SAP Start Service (sapstartsrv) for each installed SAP instance on the server.

Since 'sapservices' is read by 'sapinit', the file permissions should be set to 0755 (rwxr-xr-x).

For IBM i, you must set the owner to QSECOFR and the file permissions to 0644 (-rw-r--r--).

With an ABAP-only installation, the file should look as follows:

#!/bin/sh

LD_LIBRARY_PATH=<DIR_EXECUTABLE>:$LD_LIBRARY_PATH;export LD_LIBRARY_PATH;<DIR_EXECUTABLE>/sapstartsrv pf=<DIR_PROFILE>/<INSTANCE_START_profile> -D -u <sid>adm

# if exists:

LD_LIBRARY_PATH=<DIR_EXECUTABLE>/:$LD_LIBRARY_PATH;export LD_LIBRARY_PATH;<DIR_EXECUTABLE>/sapstartsrv pf=<DIR_PROFILE>/<ASCS_START_profile> -D -u <sid>adm

With a J2EE-only installation, the file should look as follows:

#!/bin/sh

LD_LIBRARY_PATH=<DIR_EXECUTABLE>:$LD_LIBRARY_PATH;export LD_LIBRARY_PATH;<DIR_EXECUTABLE>/sapstartsrv pf=<DIR_PROFILE>/<INSTANCE_START_PROFILE> -D -u <sid>adm

LD_LIBRARY_PATH=<DIR_EXECUTABLE>:$LD_LIBRARY_PATH;export LD_LIBRARY_PATH;<DIR_EXECUTABLE>/sapstartsrv pf=<DIR_PROFILE>/<SCS_START_profile> -D -u <sid>adm

Replace <DIR_EXECUTABLE> and <DIR_PROFILE> with the value of SAP profile parameters DIR_EXECUTABLE or DIR_PROFILE, and replace the profile files with the relevant file names.

This syntax is applicable to Linux and Solaris/SunOS operating systems. On AIX, replace 'LD_LIBRARY_PATH' with 'LIBPATH', for HP-UX replace 'LD_LIBRARY_PATH' with 'SHLIB_PATH'.

For IBM i, the following settings are sufficient:

In the case of an ABAP-only installation:

< DIR_EXECUTABLE>/sapstartsrv pf=<DIR_PROFILE>/<INSTANCE_START_profile> -D -u <sid>adm

If available:

< DIR_EXECUTABLE>/sapstartsrv pf=<DIR_PROFILE>/<ASCS_START_profile> -D -u <sid>adm

In the case of J2EE-only or dual-stack installation:

< DIR_EXECUTABLE>/sapstartsrv pf=<DIR_PROFILE>/<INSTANCE_START_PROFILE> -D -u <sid>adm

< DIR_EXECUTABLE>/sapstartsrv pf=<DIR_PROFILE>/<SCS_START_profile> -D -u <sid>adm

< DIR_EXECUTABLE> and <DIR_PROFILE> must be replaced accordingly.

After that, sapstartsrv is fully functional as start service.

Comments:

The entry for starting an SAP start service in /usr/sap/sapservices must be made in a single text line without other line breaks.

Instead of making the entry yourself manually in /usr/sap/sapservices, you can also use the sapstartsrv as of Kernel Release 7.01 by executing "sapstartsrv pf=<INSTANCE_START_PROFILE> -reg".

As of Release 7.10, start profiles are no longer used in general. The start entries are in the instance profile instead. In this case, you must specify the relevant instance profile instead of the start profile. However, the start profiles may still be active depending on the upgrade history and upgrade options that were used. Proceed as follows to determine which profile is to be specified. If there are entries in the instance profile "Start_Program" or "Restart_Program", specify the instance profile. Otherwise, specify the start profile.Example for /usr/sap/sapservices:

ABAP-only (Linux/Solaris-Syntax):

#!/bin/sh

LD_LIBRARY_PATH=/usr/sap/LNX/DVEBMGS00/exe:$LD_LIBRARY_PATH; export LD_LIBRARY_PATH;/usr/sap/LNX/DVEBMGS00/exe/sapstartsrv pf=/usr/sap/LNX/SYS/profile/START_DVEBMGS00_lnxhost -D -u lnxadm

Java-only (Linux/Solaris-Syntax):

#!/bin/sh

LD_LIBRARY_PATH=/usr/sap/LNX/JC00/exe:$LD_LIBRARY_PATH; export LD_LIBRARY_PATH; /usr/sap/LNX/JC00/exe/sapstartsrv pf=/usr/sap/LNX/SYS/profile/START_JC00_lnxhost -D -u lnxadm

LD_LIBRARY_PATH=/usr/sap/LNX/SCS01/exe:$LD_LIBRARY_PATH; export LD_LIBRARY_PATH;/usr/sap/LNX/SCS01/exe/sapstartsrv pf=/usr/sap/LNX/SYS/profile/START_SCS01_lnxhost -D -u lnxadm

Examples for /usr/sap/sapservices for IBM i:

ABAP-only:

/usr/sap/DB4/DVEBMGS00/exe/sapstartsrv pf=/usr/sap/DB4/SYS/profile/START_DVEBMGS00_db4host -D -u db4adm

Java-only or dual-stack:

/usr/sap/DB4/JC00/exe/sapstartsrv pf=/usr/sap/DB4/SYS/profile/START_JC00_db4host -D -u db4adm

/usr/sap/DB4/SCS01/exe/sapstartsrv pf=/usr/sap/DB4/SYS/profile/START_SCS01_db4host -D -u db4adm

#Need to download sapstartsrv/ sapcontrol

#Need download sapinit and installsapinit.sh to /tmp

#From Root user

1)       chmod 777 installsapinit.sh

2)       ./installsapinit.sh

#create file sapservices in the '/usr/sap/'

3)

#!/bin/sh

#!/bin/sh

LD_LIBRARY_PATH=/usr/sap/J2D/SYS/exe/run; export LD_LIBRARY_PATH; /usr/sap/J2D/SYS/exe/run/sapstartsrv pf=/usr/sap/J2D/SYS/profile/S

TART_SCS71_vhost1 -D -u j2dadm

LD_LIBRARY_PATH=/usr/sap/J2D/SYS/exe/run; export LD_LIBRARY_PATH; /usr/sap/J2D/SYS/exe/run/sapstartsrv pf=/usr/sap/J2D/SYS/profile/S

TART_JC80_vhost1 -D -u j2dadm

4)       chmod 755 sapservices

#Extract from download or copy from CSD sapstartsrv/sapcontrol /librfccm.so

5)       cp /sapmnt/CSD/exe/sapstartsrv  /sapmnt/CSD/exe/sapcontrol /sapmnt/CSD/exe/librfcum.so /sapmnt/J2D/exe

6)       chown j2dadm:sapsys /sapmnt/CSD/exe/sapstartsrv  /sapmnt/CSD/exe/sapcontrol /sapmnt/CSD/exe/librfcum.so

Resources-> Add->group->

 sap_inst_CI_QAS_crmqasdb

primitive

### ADD  SCS of J2D

sap_inst_SCS_J2D

InstanceName J2D_SCS71_vhost1

START_PROFILE  /sapmnt/J2D/profile/START_SCS71_vhost1

### ADD J2D and TREX

For CI of J2D and script start TREX

sap_inst_CI_J2D_TREX

ADD

InstanceName J2D_JC80_vhost1

PRE_START_USEREXIT   /clusterconf/QAS/script/startTREX90J2D.sh

START_PROFILE  /sapmnt/J2D/profile/START_JC80_vhost1

PRE_STOP_USEREXIT  /clusterconf/QAS/script/stopTREX90J2D.sh

AUTOMATIC_RECOVER     true

Remove monitoring resource

Set start and stop timeout=480

OK->Apply

Cancel->apply

#Start SAP J2D instant resource

crm resource start  sap_inst_CI_QAS_crmqasdb

!!Disable sap_inst_J2D_TREX_crmqasdb resource group

4. Dependency or Constraints of Resource cluster startup.

!!Disable Resource SAP Instant and start manual

Order Constraints

1. Add Order Constraints

MD disk to VG->LV->FS

Constraints-> add resource order

Disk_fs

ora_data_qasdb to ora_vg_qasdb

2. Add Order Constraints

Oracle Instant

Constraints-> add resource order

Oracle_QAS_Service

ora_vg_qasdb to ora_inst_QAS_crmqasdb

3. Add Order Constraints

Oracle Listener Service

Constraints-> add resource order

Oracle_Listener_Service

ora_vg_qasdb to ora_list_crmqasdb

4. Add Order Constraints

SAP J2D/TREX Service

Constraints-> add resource order

sap_J2D_TREX_List_service

ora_list_crmqasdb to sap_inst_J2D_TREX_crmqasdb

and Constraints-> add resource order

sap_J2D_TREX_Ora_service

ora_list_crmqasdb to sap_inst_J2D_TREX_crmqasdb

Summary constraint

5. Maintain cluster.

Normal Status : crm_mon

Maintain

Detail	Command
Start cluster	rcopenais start
Start SAP after cluster all resource on	su - j2dadm startsap r3 vhost1 exit su – trexadm TREX start exit
Stop cluster	rcopenais stop
Stop SAP	su - j2dadm stopsap r3 vhost1 exit su – trexadm TREX stop exit
Start resource [qas]	# DM [Disk raid] crm resource start ora_data_qasdb # FS/LV/VG crm resource start qas_qasdatavg # Oracle instant [QAS] crm resource start ora_inst_QAS_crmqasdb # Virtual IP and Oracle listener [Disk raid] crm resource start ora_list_crmqasdb # resource disable SAP [J2D,TREX90] crm resource start sap_inst_J2D_TREX_crmqasdb
Stop resource [qas]	# resource disable SAP [J2D,TREX90] crm resource stop sap_inst_J2D_TREX_crmqasdb # Virtual IP and Oracle listener [Disk raid] crm resource stop ora_list_crmqasdb # Oracle instant [QAS] crm resource stop ora_inst_QAS_crmqasdb # FS/LV/VG crm resource stop qas_qasdatavg # DM [Disk raid] crm resource stop ora_data_qasdb
Cleanup resource [qas] # Case change status not save/un commit/abnormal	# FS/LV/VG crm resource cleanup qas_qasdatavg # DM [Disk raid] crm resource cleanup ora_data_qasdb # Virtual IP and Oracle listener [Disk raid] crm resource cleanup ora_list_crmqasdb # Oracle instant [QAS] crm resource cleanup ora_inst_QAS_crmqasdb # resource disable SAP [J2D,TREX90] crm resource cleanup sap_inst_J2D_TREX_crmqasdb

Cluster Commands

Useful crm commands :

cibadmin -Q : List the xml configuration of the cluster

cibadmin -Q > cib-backup.xml : Save the configuration of the cluster in the given file

cibadmin -E –force : Delete the complete cluster information (immediately)

If you want to reset the whole configuration you should also delete /var/lib/heartbeat/crm/* on all nodes

crm_mon : Displays the cluster state of hosts and resources

crm_verifiy -LV : Check the xml for errors or orphaned resources

crm_resource -M -r resource_virtual_ip -H hacluster1 : Migrate the resource resource_irtual_ip to hacluster1

Script lib agent path

/usr/lib/ocf/resource.d/heartbeat/

SAP Version Naming Metrix

2012-01-20T10:43:00.000+07:00

** Credit Web

Year	UI Type	Edition	Major Version	Minor Version	BASIS	WebAS	ECC	NetWeaver	Solution Manager	Remark
	Terminal	R/2	-	-
1992	Desktop	R/3	1	-	1
	Desktop	R/3	2.0, 2.1	-	2.0, 2.1
1997	Desktop	R/3	3.0, 3.1	3.1I	3.1I
1998	Desktop	R/3	4	4.0B	4.0B
2000	Desktop	R/3	4.5	4.5B	4.5B
2001	Desktop	R/3	4.6	4.6B, 4.6C	4.6B, 4.6C
2001	Desktop	R/3	4.6D*	4.6D	4.6D, 610	6.1
2003	Web	R/3 Enterprise	1.1	4.7×110	620	6.2		NetWeaver (2003)	2.1
	Web	R/3 Enterprise	2	4.7×200	630	6.3		NetWeaver (2003)	2.2, 3.1,3.2
2005	Web	mySAP	2004	-	640	6.4	ECC 5.0	NetWeaver 04	4.0	* SAP appears to support 4.6D on BASIS server and WebAS
2006	Web	mySAP	2005	-	700	7.0 (AS)	ECC 6.0	NetWeaver 04S	4.0	SAP Netweaver 7 (Previously called Netweaver 04S

Unix Linux check Lan and Fiber port (FC)

2012-01-06T13:29:00.000+07:00

** Myself

# check lan and usb class net

systool -c net

Class = "net"

Class Device = "eth0"

Device = "0000:01:00.0"

Class Device = "eth1"

Device = "0000:01:00.1"

Class Device = "lo"

Class Device = "usb0"

Device = "6-2:1.0"

systool -c fc_host -v

# check Fiber port

Class = "fc_host"

Class Device = "host3"

Class Device path = "/sys/devices/pci0000:00/0000:00:03.0/0000:09:00.0/host3/fc_host/host3"

fabric_name = "0x100000051e904cfb"

issue_lip = <store method only>

max_npiv_vports = "254"

node_name = "0x20000024ff2fae40"

npiv_vports_inuse = "0"

port_id = "0x321c00"

port_name = "0x21000024ff2fae40"

port_state = "Online"

port_type = "NPort (fabric via point-to-point)"

speed = "4 Gbit"

supported_classes = "Class 3"

supported_speeds = "1 Gbit, 2 Gbit, 4 Gbit, 8 Gbit"

symbolic_name = "QLE2562 FW:v5.03.02 DVR:v8.03.01.08.11.1-k8"

system_hostname = ""

tgtid_bind_type = "wwpn (World Wide Port Name)"

uevent =

vport_create = <store method only>

vport_delete = <store method only>

Device = "host3"

Device path = "/sys/devices/pci0000:00/0000:00:03.0/0000:09:00.0/host3"

edc = <store method only>

fw_dump =

nvram = "ISP "

optrom =

optrom_ctl = <store method only>

reset = <store method only>

sfp = ""

uevent = "DEVTYPE=scsi_host"

vpd = "‚("

Class Device = "host4"

Class Device path = "/sys/devices/pci0000:00/0000:00:03.0/0000:09:00.1/host4/fc_host/host4"

fabric_name = "0x100000053368638e"

issue_lip = <store method only>

max_npiv_vports = "254"

node_name = "0x20000024ff2fae41"

npiv_vports_inuse = "0"

port_id = "0x0a3500"

port_name = "0x21000024ff2fae41"

port_state = "Online"

port_type = "NPort (fabric via point-to-point)"

speed = "8 Gbit"

supported_classes = "Class 3"

supported_speeds = "1 Gbit, 2 Gbit, 4 Gbit, 8 Gbit"

symbolic_name = "QLE2562 FW:v5.03.02 DVR:v8.03.01.08.11.1-k8"

system_hostname = ""

tgtid_bind_type = "wwpn (World Wide Port Name)"

uevent =

vport_create = <store method only>

vport_delete = <store method only>

Device = "host4"

Device path = "/sys/devices/pci0000:00/0000:00:03.0/0000:09:00.1/host4"

edc = <store method only>

fw_dump =

nvram = "ISP "

optrom =

optrom_ctl = <store method only>

reset = <store method only>

sfp = ""

uevent = "DEVTYPE=scsi_host"

vpd = "‚("

Oracle Screenshot Install oracle11g on SAP Linux [Oracle part]

2011-11-17T09:06:00.001+07:00

**Myself

/oracle/stage/112_64/database/SAP/RUNINSTALLER

Yes

Note 7400897 SAP license scope

No tuning

# root user
/oracle/oraInventory/orainstRoot.sh
Changing permissions of /oracle/oraInventory.
Adding read,write permissions for group.
Removing read,write,execute permissions for world.
Changing groupname of /oracle/oraInventory to dba.
The execution of the script is complete.

# root user
/oracle/QAS/112_64/root.sh
Running Oracle 11g root.sh script...
The following environment variables are set as:
ORACLE_OWNER= oraqas
ORACLE_HOME= /oracle/QAS/112_64
Enter the full pathname of the local bin directory: [/usr/local/bin]:
Copying dbhome to /usr/local/bin ...
Copying oraenv to /usr/local/bin ...
Copying coraenv to /usr/local/bin ...
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root.sh script.
Now product-specific root actions will be performed.
Finished product-specific root actions.

Install bundle patch
# Pre task download mopatch
/bin/sh $ORACLE_HOME/MOPatch/mopatch.sh -v -d -s SAP_112023_201109.zip

Oracle Example Export ddl for table/index

2011-11-09T17:58:00.001+07:00

** Myself

Export ddl for table [USR02]

set feedback off heading off pages 0 lines 3000 long 400000
# dbms_metadata.get_ddl = 'table','table name','schema'

select dbms_metadata.get_ddl('TABLE','USR02','SAPSR3') from dual;

Query index of table [USR02]

SQL>

select INDEX_NAME from dba_indexes

where

TABLE_OWNER='SAPSR3'

and TABLE_NAME='USR02' ;

INDEX_NAME

------------------------------

USR02~0

USR02~001

USR02~002

Export ddl for index USR02~0/ USR02~001/ USR02~002

set feedback off heading off pages 0 lines 3000 long 400000

# dbms_metadata.get_ddl = 'index','index name','schema'

select dbms_metadata.get_ddl('INDEX','USR02~0','SAPSR3') from dual;

select dbms_metadata.get_ddl('INDEX','USR02~001','SAPSR3') from dual;

select dbms_metadata.get_ddl('INDEX','USR02~002','SAPSR3') from dual;

SAP Error R3load Phase from Installation New or Export/Import Heterogeneous System copy (Not Recommend may be duplicate/lost some data)

2011-09-02T17:52:00.002+07:00

** Myself
Message

(TSK) ERROR: TSK.bck file already seems to exist a previous run may not have been finished cleanly file .TSK possibly corrupted job finished with error(s)

Example

File name = SAPAPPL2_1.TSK.bck and SAPAPPL2_1.TSK

Solve

Run R3load for merge file then rerun sapinst or R3setup

Logon <sidadm>

->go to install/export/import directory from sapinst or R3setup

->run R3load to merge TSK and TSK.bck file

# Case Export heterogeneous with command file

R3load -merge_bck -e SAPAPPL2_1.cmd

# Case Import heterogeneous with command file

SAP Enhancement exit smod/cmod Logon Page

2011-08-24T10:01:00.001+07:00

** Myself
Tcode CMOD
-> zlogon ->create

Save->back

-> change

-> components
-> Enhancement: SUSR0001

-> save -> back
Tcode SMOD

-> components
-> Enhancement: SUSR0001

->Double click EXIT_SAPLSUSF_001
->Double click ZXUSRU01
->Show warning -> press “Enter”
->Insert -> include ZXUSRU01.

->select package (can be transport )

.

######### Source Code #######

*&---------------------------------------------------------------------*

*& Include ZXUSRU01

*&---------------------------------------------------------------------*

CALL FUNCTION 'POPUP_TO_INFORM'

EXPORTING

    TITEL         = 'Hello World สวัสดีชาวโลก'
    TXT1          = 'สวัสดีชาวโลก'
    TXT2          = ' '
*   TXT3          = ' '
*   TXT4          = ' '

->Save & activate include
Cmod
-> Zlogon ->activate
->Test logon Gui

How to check SAP Standard SAP*, DDIC, SAPCPIC and EARLYWATCH user use default password or not

2011-08-02T15:20:00.003+07:00

** Myself

SE38

-> RSUSR003

-> uncheck “Display Profile Parameters”

-> execute

SAP Transport Request "Running" status "Hang" "Stuck"

2011-07-09T00:44:00.001+07:00

** Myself

1)Delete this request from STMS.
STMS->
import overview->
select system(DEV,QAS,PRD) ->
import monitor ->
select running -> delete entry

2)Check /usr/sap/trans/tmp and find XX.LOC (Transport Lock file)
in /usr/sap/trans/tmp rename XX.LOC to XX.LOC.old

3)Check tables TMSTLOCKR and TMSTLOCKP in SE16.
Delete record if not 0

MS SQL server Restore multiple device files

2011-07-08T17:53:00.000+07:00

** Myself
## Query Tools
## Restore to QAS database multiple file of B1.bak,B2,bak,B3.bak,B4.bak

RESTORE DATABASE QAS
FROM
DISK='F:\Backup\B1\B1.bak',
DISK='F:\Backup\B2\B2.bak',
DISK='F:\Backup\B3\B3.bak',
DISK='F:\Backup\B4\B4.bak'
WITH
MOVE 'PRDDATA1' TO 'E:\SAPDATA\QASDATA\QASDATA1.mdf',
MOVE 'PRDDATA2' TO 'E:\SAPDATA\QASDATA\QASDATA2.ndf',
MOVE 'PRDDATA3' TO 'G:\SAPDATA\QASDATA\QASDATA3.ndf',
MOVE 'PRDLOG1' TO 'G:\SAPDATA\QASDATA\QASLOG1.ldf'

MS SQL server Backup multiple device files

2011-07-08T11:57:00.001+07:00

** Myself

Pros

- Backup fasters

- Each files small and can be separate drive letter (average db size to multiple file size)

Cons

- Restore slow than single

Add Drive B1,B2,B3,and B4 to D:E:F:

Select & Add Drive B1,B2,B3,and B4 to Backup master DB

How To Flush DNS Cache (NAME SERVICE) Windows/UNIX

2011-06-23T21:30:00.001+07:00

** Myself

Windows

Start->run->cmd->

ipconfig /flushdns

UNIX

service nscd restart

-- or --

sudo /etc/init.d/nscd restart

Oracle DataGuard Administration on Solaris Simulators

2011-06-15T11:30:00.001+07:00

** Credit Vladimir Grigorian (http://vgrigorian.com)
- Oracle10g on Solaris - DataGuard Switchover
- DataGuard Troubleshooting

DataGuard Configuration on RedHat Simulators

2011-06-15T11:29:00.000+07:00

** Credit Vladimir Grigorian (http://vgrigorian.com)
- DataGuard Configuration
- DataGuard Troubleshooting

Shell Script Example Oracle Export dumpfile(exp or expdp)

2011-05-31T14:27:00.000+07:00

**Myself

#!/usr/bin/sh
#########   ENV ##############
backup_dir=/backup/expdump #Dumpfile directory
blog=/backup/expdump/backup_expdump.log
orasid[0]=orcl1    #oracle sid1
orasid[1]=orcl2    #oracle sid2
orasid[2]=orcl3    #oracle sid3
orauser[0]=oraorcl1
orauser[1]=oraorcl2
orauser[2]=oraorcl1
orahome[0]=/app/oracle/orcl1/10g
orahome[1]=/app/oracle/orcl2/10g
orahome[2]=/app/oracle/orcl3/10g
############### Main ##################
export i=0
while (( i < ${#orasid[*]} ))
do
    su - ${orauser[${i}]} << BOF >> ${blog}
        export ORACLE_SID=${orasid[${i}]}
        echo ${orasid[${i}]} >> ${blog}
        ${orahome[${i}]}/bin/exp system/system file='${backup_dir}/${orasid[${i}]}.dmp' full=y
    BOF
(( i = i + 1 ))
done

Shell Script Menu for Start up/Shutdown SAP with Oracle and other process (saposcol,sapstartsrv,hostctl for NW7.1)

2011-05-30T18:36:00.000+07:00

** Myself
#====================================================================
#
# MAIN PROGRAM: Operator Menu
#
# PURPOSE: Checks for system instances and
#           startup/shutdown system instances
#
#====================================================================
#====================================================================
# Environment
#====================================================================
#
#
#
# oracle user ,Please change
orasid=dev
# sap user ,Please change
sapsid=dev
# SAP StartSRV MC Console Instant Name ,Please change ,for more instant add array
SAPINST[0]=DVEBMGS02
SAPINST[1]=ASCS00
SAPINST[2]=SCS01
#
#====================================================================
#====================================================================
# Main
#====================================================================
operation_menu=0
while [[ ! "x${operation_menu}x" = "x99x" ]] ; do
clear
echo "========================================"
echo "|--- Operation Menu (`hostname`) "
echo "========================================"
echo "(1) Start SAP"
echo "(2) Shutdown SAP"
echo "(99) Exit"
echo "Please select a number from the Operation Menu: "
read operation_menu
case ${operation_menu} in
        1)
                su - ora${orasid} -c "lsnrctl start"
                su - ${sapsid}adm -c "startsap"
                echo "SAP Startup"
                echo "Please key to Main Menu: "

               read
                ;;
        2)
                echo "Are you sure you want to Stop SAP ? [N/y]: "
                read Answer
                if [ "${Answer:="N"}" = "y" -o "${Answer:="N"}" = "Y" -o "${Answer:="N"}" = "yes" -o "${Answer:="N"}" = "Yes" ] ; then
                        su - ${sapsid}adm -c "stopsap"
                        su - ${sapsid}adm -c "saposcol -k"
            i=0
            while (( i < ${#SAPINST[*]} ))
            do
                su - ${sapsid}adm -c "stopsap sapstartsrv ${SAPINST[${i}]}"
                        echo "SAP Stop StartSRV MC Console"
                        echo "============================="
            (( i = i + 1 ))
            done
### For NW 7.1 Stop hostCTL by saphostexec -stop by enable below line
#/usr/sap/hostctrl/exe/saphostexec -stop
            su - ora${orasid} -c "lsnrctl stop"
                    echo "SAP Stop"
                        echo "Press enter to continue: \c"
                        read waiting
                elif [ "${Answer:="N"}" != "n" -a "${Answer:="N"}" != "N" -a "${Answer:="N"}" != "no" -a "${Answer:="N"}" != "No" ] ; then
                        echo "!!! Please choose Yes or No !!!"
                        sleep 1
                fi
                ;;
        99)
                ;;
        *)
                echo "!!! Please select a number from the list !!!"
                sleep 1
                ;;
esac
done