Karl Arao's TiddlyWiki

MySQL DW, Mysql Datawarehouse

Mon, 23 Aug 2021 18:12:59 GMT

data warehouse in mysql http://mysql.rjweb.org/doc.php/datawarehouse
https://dba.stackexchange.com/questions/75550/is-data-warehousing-possible-in-mysql-and-postgressql
https://blog.panoply.io/mysql-as-a-data-warehouse-is-it-really-your-best-option
https://www.zdnet.com/article/oracle-takes-a-new-twist-on-mysql-adding-data-warehousing-to-the-cloud-service/
https://cloudwars.co/oracle/oracle-unleashes-heatwave-mysql-thumps-amazon-redshift-aurora/

mysql heatwave whitepaper https://www.oracle.com/a/ocom/docs/mysql-database-service-technical-paper.pdf
https://github.com/oracle/heatwave-tpch
Getting Started to MySQL HeatWave for Analytics https://www.youtube.com/watch?v=Xk6ZeO-tHz8
https://juliandontcheff.wordpress.com/2021/06/07/heatwave-mysql-db-systems-in-oci/
https://medium.com/oracledevs/connect-tableau-to-oracle-mysql-database-service-powered-by-heatwave-5d18bb4a1b5c
https://gitlab.oracle.k8scloud.site/devops_admin/mysql-heatwave-workshop

https://druid.apache.org/docs/latest/ingestion/schema-design.html
https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.5/adding-druid/content/druid_ingest.html
https://metatron.app/2019/05/24/what-to-keep-in-mind-when-ingesting-a-data-source-to-druid-from-metatron-discovery/
https://dzone.com/articles/ultra-fast-olap-analytics-with-apache-hive-and-dru
hive druid integration https://gist.github.com/rajkrrsingh/f01475f4bfa4a33240134561171f378f
https://stackoverflow.com/questions/58693625/need-to-load-data-from-hadoop-to-druid-after-applying-transformations-if-i-use
https://stackoverflow.com/questions/51106037/upload-data-to-druid-incrementally
https://druid.apache.org/docs/latest/querying/sql.html
https://druid.apache.org/docs/latest/querying/joins.html

BI ENGINE
https://cloud.google.com/bi-engine/docs/optimized-sql#unsupported-features

..

Golden Gate

Fri, 23 Jul 2021 03:32:00 GMT

/* Table of Contents */

golden gate health check
[top]

• Latest GoldenGate/Database (OGG/RDBMS) Patch recommendations (Doc ID 2193391.1)
• Oracle GoldenGate Performance Data Gathering (Doc ID 1488668.1)
• https://www.ateam-oracle.com/loren-penton
• https://www.oracle.com/technetwork/database/availability/maa-gg-performance-1969630.pdf
• https://www.oracle.com/a/tech/docs/maa-goldengate-hub.pdf
• SRDC: Oracle GoldenGate Integrated Extract and Replicat Performance Diagnostic Collector (Doc ID 2262988.1)
• Master Note for Streams Recommended Configuration (Doc ID 418755.1)

MOS Note:1298562.1:
Oracle GoldenGate database Complete Database Profile check script for Oracle DB (All Schemas) Classic Extract

MOS Note: 1296168.1
Oracle GoldenGate database Schema Profile check script for Oracle DB

MOS Note: 1448324.1
GoldenGate Integrated Capture and Integrated Replicat Healthcheck Script

Enkitec materials
[top]

https://connectedlearning.accenture.com/curator/chanea-heard
https://connectedlearning.accenture.com/learningboard/goldengate-administration

Oracle youtube materials
[top]

other youtube materials
[top]

Oracle Goldengate Installation and COnfiguration https://www.youtube.com/watch?v=XnyqS6_IVMQ
Oracle GoldenGate 12c Installation/Walkthrough on VirtualBox https://www.youtube.com/watch?v=c4NxBTnJYvo
11 part series - MS SQL Server to Oracle GG https://www.youtube.com/playlist?list=PLbkU_gVPZ7OTgLRLABah9kdrJ07Tml8E4
6 part series - GoldenGate Tutorial goldengate installation on linux https://www.youtube.com/watch?v=lb3UKpgCA1U&list=PLZSKX9aay1XvIQjy0lWJ5RSn0iuCWGrnL

golden gate waits
[top]

Integrated Replicat Stuck With REPL Capture/Apply: flow control (Doc ID 2354344.1)

oracle autostart

Thu, 22 Jul 2021 16:34:00 GMT

https://oracle-base.com/articles/linux/automating-database-startup-and-shutdown-on-linux
https://unknowndba.blogspot.com/2021/07/systemd-service-to-stopstart-oracle.html

oci vs snowflake, adw vs snowflake

Tue, 20 Jul 2021 23:28:00 GMT

https://www.oracle.com/autonomous-database/autonomous-data-warehouse/oracle-vs-snowflake/
https://www.oracle.com/a/ocom/docs/database/oracle-adw-vs-snowflake-infographic.pdf

oci vs aws

Tue, 20 Jul 2021 23:28:00 GMT

https://www.oracle.com/cloud/oci-vs-aws/
https://www.oracle.com/a/ocom/docs/cloud/oci-vs-aws.pdf

oci vs gcp

Tue, 20 Jul 2021 22:37:00 GMT

https://www.oracle.com/cloud/oci-vs-google-cloud/
https://www.oracle.com/a/ocom/docs/cloud/oci-vs-gcp.pdf

oci vs azure, hybrid cloud

Tue, 20 Jul 2021 22:37:00 GMT

https://www.facebook.com/charlton.h.lopez/posts/10216627862754561

azure

https://blogs.oracle.com/cloud-infrastructure/overview-of-the-interconnect-between-oracle-and-microsoft
https://docs.microsoft.com/en-us/azure/virtual-machines/workloads/oracle/oracle-oci-overview

Overview of Oracle Applications and solutions on Azure
https://docs.microsoft.com/en-us/azure/virtual-machines/workloads/oracle/oracle-overview?fbclid=IwAR2W-MWpNAzuTbsUi_sNFRXsGpJWsVqBojQZx8LrbRlgxIXM-sDTgtJYelg

https://www.google.com/search?q=hybrid+cloud+azure+and+oracle+database&sxsrf=ALeKk01bmg2bgOwQeNrwZHnLYMbQW1-JBg:1585551072877&source=lnms&tbm=isch&sa=X&ved=2ahUKEwidiOODzsHoAhU_hHIEHXtkCKoQ_AUoAnoECA0QBA&biw=1701&bih=978

networking

https://docs.cloud.oracle.com/en-us/iaas/Content/Network/Concepts/fastconnectoverview.htm
https://docs.microsoft.com/en-us/azure/expressroute/expressroute-introduction

oci comparison

Tue, 20 Jul 2021 22:37:00 GMT

ORDS json api

Tue, 20 Jul 2021 18:53:00 GMT

/* Table of Contents */

ORDS for REST API ?
[top]

I would say ORDS for convenience so you don't have to manually create the JSON API

There's a nice pluralsight ORDS course out there to get started with code examples to practice. It also shows how to secure (oauth2) and deploy ords to a webtier
https://www.pluralsight.com/courses/oracle-rest-data-services

Dan McGhan did a presentation at OOW that shows how to create REST API the manual way using node-oracledb (https://oracle.github.io/node-oracledb/) and also using ORDS. 
Creating RESTful Web Services the Easy Way with Node.js https://www.youtube.com/watch?v=tSW72IlTJGw
code examples: https://github.com/oracle/node-oracledb/issues/962, https://github.com/oracle/oracle-db-examples/tree/master/javascript/rest-api, http://web.archive.org/web/20201128020553/https://jsao.io/2018/03/creating-a-rest-api-with-node-js-and-oracle-database/



And just for completeness, if you are using one of the web frameworks out there like Ember, Angular, React, etc. here's how everything will be glued together from DB to frontend. Example below uses Ember.js app

Oracle DB <-> REST JSON API (node-oracledb or ORDS) <-> built-in Ember JSONAPIAdapter <-> Ember Data <-> Ember


Just for comparison if you are using Postgres as DB and Django for creating REST API, here's how it will look like
Postgresql <-> REST JSON API (Django) <-> built-in Ember JSONAPIAdapter <-> Ember Data <-> Ember


If you are using Postgres as DB and Rails REST API
Postgresql <-> REST JSON API (rails) <-> built-in JSONAPIAdapter <-> Ember Data <-> Ember


Then the old school app architecture using Postgres as DB and Rails ORM
Postgresql <-> ActiveRecord ORM (in a Rails Controller) <-> ActiveModel::Serializers <-> Ember Data (with active-model-adapter) <-> Ember

references
[top]

https://www.oracle.com/database/technologies/databaseappdev-vm.html

https://www.pluralsight.com/courses/oracle-rest-data-services

https://www.thatjeffsmith.com/oracle-rest-data-services-ords/
https://oracle-base.com/articles/misc/articles-misc#ords

Creating a REST API with Node.js and Oracle Database http://web.archive.org/web/20201128020553/https://jsao.io/2018/03/creating-a-rest-api-with-node-js-and-oracle-database/
https://github.com/oracle/oracle-db-examples/tree/master/javascript/rest-api
https://github.com/oracle/node-oracledb/issues/962
Creating RESTful Web Services the Easy Way with Node.js https://www.youtube.com/watch?v=tSW72IlTJGw
https://blogs.oracle.com/author/dan-mcghan-3
https://oracle.github.io/node-oracledb/

https://developer.oracle.com/dsl/haefel-oracle-ruby.html

.

tpc-H and tpc-DS

Mon, 12 Jul 2021 16:16:00 GMT

/* Table of Contents */

disclaimer
[top]

Benchmarking SQL-on-Hadoop Systems: TPC or not TPC?
https://pdfs.semanticscholar.org/3c92/54ee62c8cab6a341c3ca19f277df245c194a.pdf

tpc-H
[top]

https://husnusensoy.wordpress.com/tag/tpc-h/
http://people.apache.org/~gopalv/tpch-plans/
https://github.com/rxin/TPC-H-Hive
https://github.com/hortonworks/hive-testbench-carter-fork
https://github.com/hortonworks/hive-testbench
https://community.hortonworks.com/questions/82918/how-to-perform-tpch-on-hive.html
https://github.com/t3rmin4t0r?utf8=%E2%9C%93&tab=repositories&q=tp&type=&language=

tpc-DS
[top]

tpc-H vs tpc-DS
[top]

https://www.theregister.co.uk/2012/05/04/is_tpc_ds_worthy_of_weaponising/

Behold the TPC-DS, a new weapon in the global Big Data war
Seeking the 'game-proof' benchmark

There isn’t anything inherently evil about industry standard benchmarks, just as there isn’t anything inherently evil about guns. You know the saying: “Guns don’t kill people – people kill people.” (What about bullets? No, they’re not inherently evil either.)

But in the hands of motivated vendors, benchmarks are weapons to be wielded against competitors with great gusto. So why am I writing about benchmarks? It’s because the Transaction Processing Council (TPC) has released a new major benchmark, TPC-DS, which aims to provide a level playing field for vendors warring over their Big Data prowess.

El Reg's Timothy Prickett Morgan wrote about this new benchmark at length here. In his inimitable way, Tim captured the meat of the story, plus the marrow, gristle, hooves and hide of it too.

I talked with TPC reps last week about TPC-DS and benchmarks in general – learning quite a bit along the way about how TPC-DS is different (and better) than what we’ve seen before. In my years on the vendor side of the industry, there was nothing better than using a shiny new TPC-C or TPC-D score to smite the living hell out the server competition. But my efforts to learn enough to explain the results in customer presentations taught me bit about how vendors perform benchmarks. It’s like learning how sausage is made, but with more acronyms.

There were lots and lots of ways to put together stellar benchmark results on system configurations that a real customer would never buy, with software optimised in ways that won’t work in production environments, all offered at prices they’ll never see.

But benchmarks are a necessary evil, like the Irish and the Dutch. There are differences between systems and the ways vendors implement similar or even identical technology. Two Xeon processors might perform exactly the same when they roll out of Intel’s fab. But after they’ve been incorporated into various ‘industry standard’ systems, get their software loads and start running apps, there will be differences in performance and certainly price/performance.

In a perfect world, customers would be able to do ‘bake-offs’ or ‘try and buy’ exercises before issuing a PO. But these are time-consuming and expensive for both the vendor and customer. It’s worth the effort for a very large or mission-critical installation, but not so much when the deal size and importance is lesser. This is where standard benchmarks come in: they give buyers a few more data points to use in their decision making process.

Benchmark organisations like TPC and SPEC (Standard Performance Evaluation Council) arose from industry need for standardized and valid comparisons between systems and solutions. These consortiums are primarily vendor-funded, and vendors certainly play a role in helping shape the benchmarks.

If a benchmark's results are printed in a forest and no one reads them, does it exist?
Building standard benchmarks isn’t easy. Tests need to stress the right parts of the system/solution – mimicking real-world processing as much as possible. They need to be complex enough to stress even the largest system, but at the same time scalable and reasonably easy and inexpensive to run. Safeguards have to be built in so that vendors can’t rig the results or game the tests. And, finally, the rules need to be documented and enforced.

But for a benchmark to be truly successful, it has to be used by vendors and customers alike.

What jumped out during my briefing with TPC was the size and complexity of TPC-DS. Lots of tables, lots of data, and lots of operations. It’s much more complete and complex than TPC-H, with 99 queries compared to only 22 for the venerable H.

One of the newest wrinkles with DS is that the ‘ad hoc’ queries are truly ad hoc. In TPC-D and, to a lesser extent, TPC-H, ad hoc queries could be anticipated and planned for by canny benchmark engineers. With DS, the ad hoc queries are randomized, and there are too many potential permutations to allow for pre-positioning data accurately.

The TPC-DS ‘number’ is a bit complicated to understand – it’s a combination of the single user time to run through 99 queries, multiple users running through 99 queries, and database load times. A valid TPC-DS run has to have the single user run results plus a multi-user run with at least four streams.

There isn’t a maximum number of streams (which is the same as users) that need to be tested. There also is no minimum response time goal that needs to be satisfied in the multi-user runs, like in other benchmarks. The metric is heavily influenced by the multi-user results, rewarding scalability and optimised use of shared resources.

Given that there aren’t maximum response time rules, vendors will end up doing lots of TPC-DS multi-user runs in order to find the sweet spot where they’re supporting a large number of users and achieving their best overall score. The executive summary of the mandatory benchmark disclosure document shows the numbers that went into the overall metric, including number of users supported, response times, and the like.

To me, TPC-DS is a big leap forward. I’m no benchmarking expert, and nothing is totally foolproof, but this looks to be a highly ‘game-proof’ benchmark. It also does a much better job of capturing the complexity of modern business processing to a much greater extent than its predecessors.

From a customer perspective, it’s definitely worth consulting TPC-DS before making that next Big Data solution buy. Now we wait and see if the vendors are going to run it through some gear – and thus weaponise it. ®

tpcx-hs
[top]

https://www.slideshare.net/insideHPC/introducing-the-tpcxhs-benchmark-for-big-data

others
[top]

http://blog.atscale.com/how-different-sql-on-hadoop-engines-satisfy-bi-workloads
https://databricks.com/blog/2017/07/12/benchmarking-big-data-sql-platforms-in-the-cloud.html
https://zeepabyte.com/blog/index.php/2017/08/02/using-tpc-h-metrics-to-explain-the-three-fold-benefit-of-cascade-analytics-system-i/

..

Analytic Functions

Wed, 07 Jul 2021 21:31:00 GMT

official doc

data warehousing guide - 19 SQL for Analysis and Reporting
https://docs.oracle.com/en/database/oracle/oracle-database/19/dwhsg/sql-analysis-reporting-data-warehouses.html#GUID-20EFBF1E-F79D-4E4A-906C-6E496EECA684
https://docs.oracle.com/en/database/oracle/oracle-database/19/dwhsg/sql-analysis-reporting-data-warehouses.html#GUID-D6AC065D-670A-40E8-8DA0-E90A7307CFC2

SQL Language Reference - Analytic Functions
https://docs.oracle.com/en/database/oracle/oracle-database/19/sqlrf/Analytic-Functions.html#GUID-527832F7-63C0-4445-8C16-307FA5084056
https://docs.oracle.com/en/database/oracle/oracle-database/18/sqlrf/Analytic-Functions.html#GUID-527832F7-63C0-4445-8C16-307FA5084056

Analytic functions are commonly used in data warehousing environments. In the list of analytic functions that follows, 
functions followed by an asterisk (*) allow the full syntax, including the windowing_clause.

    AVG *
    CLUSTER_DETAILS
    CLUSTER_DISTANCE
    CLUSTER_ID
    CLUSTER_PROBABILITY
    CLUSTER_SET
    CORR *
    COUNT *
    COVAR_POP *
    COVAR_SAMP *
    CUME_DIST
    DENSE_RANK
    FEATURE_DETAILS
    FEATURE_ID
    FEATURE_SET
    FEATURE_VALUE
    FIRST
    FIRST_VALUE *
    LAG
    LAST
    LAST_VALUE *
    LEAD
    LISTAGG
    MAX *
    MIN *
    NTH_VALUE *
    NTILE
    PERCENT_RANK
    PERCENTILE_CONT
    PERCENTILE_DISC
    PREDICTION
    PREDICTION_COST
    PREDICTION_DETAILS
    PREDICTION_PROBABILITY
    PREDICTION_SET
    RANK
    RATIO_TO_REPORT
    REGR_ (Linear Regression) Functions *
    ROW_NUMBER
    STDDEV *
    STDDEV_POP *
    STDDEV_SAMP *
    SUM *
    VAR_POP *
    VAR_SAMP *
    VARIANCE *

https://oracle-base.com/articles/sql/articles-sql#analytic-functions
https://oracle-base.com/articles/misc/avg-and-median-analytic-functions
https://leetcode.com/problems/median-employee-salary/

Find Answers Faster
By Jonathan Gennick and Anthony Molinaro
http://www.oracle.com/technology/oramag/oracle/05-mar/o25dba.html

LAG
http://www.appsdba.com/blog/?p=383

CAST function
http://www.oracle.com/technetwork/database/focus-areas/manageability/diag-pack-ow08-131537.pdf
http://psoug.org/reference/cast.html

SQL – RANK, MAX Analytical Functions, DECODE, SIGN
http://hoopercharles.wordpress.com/2009/12/26/sql-–-rank-max-analytical-functions-decode-sign/

RANK - fist and last
https://oracle-base.com/articles/misc/rank-dense-rank-first-last-analytic-functions#first_and_last
https://stackoverflow.com/questions/40404497/select-latest-row-for-each-group-from-oracle

CONNECT BY - hierarchical queries
https://www.linkedin.com/pulse/step-by-step-guide-creating-sql-hierarchical-queries-bibhas-mitra/

http://www.slideshare.net/hamcdc/sep13-analytics
http://www.odtug.com/p/cm/ld/fid=65&tid=35&sid=972
http://www.amazon.com/Window-Functions-SQL-Jonathan-Gennick-ebook/dp/B006YITKJO/ref=sr_1_2?ie=UTF8&qid=1385753351&sr=8-2&keywords=window+functions+in+sql
http://gennick.com/database/?tag=WindowSS

Analytic Functions in Oracle 8i Srikanth Bellamkonda http://infolab.stanford.edu/infoseminar/archive/SpringY2000/speakers/agupta/paper.pdf
Enhanced subquery optimizations in Oracle http://www.vldb.org/pvldb/2/vldb09-423.pdf
Analytic SQL in 12c http://www.oracle.com/technetwork/database/bi-datawarehousing/wp-in-database-analytics-12c-2132656.pdf
Adaptive and big data scale parallel execution in oracle http://dl.acm.org/citation.cfm?id=2536235

..

oracle adw, oci adw

Tue, 06 Jul 2021 23:52:00 GMT

RAC application continuity

Thu, 01 Jul 2021 17:43:00 GMT

How To Test Application Continuity Using A Standalone Java Program (Doc ID 1602233.1)
TAF ENABLED GLOBAL SERVICE in GDS ENVIRONMNET 12C. (Doc ID 2283193.1)
Application Continuity Throws Exception No more data to read from socket For Commits After Failover (Doc ID 2197029.1)

How To Test Application Continuity Using A Standalone Java Program (Doc ID 1602233.1)	To BottomTo Bottom	

In this Document
	Goal
	Solution

Applies to:
JDBC - Version 12.1.0.1.0 and later
Information in this document applies to any platform.
Goal

 The document provides step-by-step instructions and a simple standalone Java Program which can be used to test the Application Continuity feature in the 12c JDBC driver.
Solution

 Application Continuity in the 12c JDBC driver can be tested with a simple standalone java program and a RAC 12C Database Cluster.

 

Step1 -  Creating a Database Service for Application Continuity on a RAC database

 

1) Add a service , say acservice, using srvctl on both instances of a two node RAC cluster, orcl1 and orlc2.
srvctl add service -s acservice -d orcl -r orcl1,orcl2

 

2) Start up the Service
 srvctl start service -s acservice -d orcl

 

3) Enable the service for Application Continuity
srvctl modify service -d ORCL -s acservice -failovertype TRANSACTION -replay_init_time 300 -failoverretry 30 -failoverdelay 3 -notification TRUE -commit_outcome TRUE

 
If the service is not AC-enabled, the exception java.lang.ClassCastException: oracle.jdbc.driver.T4CConnection cannot be cast to oracle.jdbc.replay.ReplayableConnection would be generated.


Step2 -  Running the Sample AcTest.java Program

 

1) Create and run the AcTest.java program, provided below,  with the 12.1.0.1 JDBC driver.  Please ensure the java program is named AcTest.java (noticed the "A' and "T" in uppercase).
If the connection is successful, the following output is seen:   
You are Connected to RAC Instance -  ORCL1

 

2) When the program pauses, shut down ORCL1 RAC instance

   
srvctl stop instance -i ORCL1 -d ORCL

 

3) If the replay is successful, the connection will be successfully established on the ORCL2 RAC instance

  
After Replay Connected to RAC Instance - ORCL2

 

AcTest.java

========

import java.sql.*;
import oracle.jdbc.*;
public class AcTest
{
public static void main(String[] args) throws SQLException,java.lang.InterruptedException
{
oracle.jdbc.replay.OracleDataSource  AcDatasource = oracle.jdbc.replay.OracleDataSourceFactory.getOracleDataSource();
AcDatasource.setURL("jdbc:oracle:thin:@<HOST>:<PORT>/acservice");
AcDatasource.setUser("<USER>");
AcDatasource.setPassword("<PASSWORD>");

Connection conn = AcDatasource.getConnection();

conn.setAutoCommit(false);

PreparedStatement stmt = conn.prepareStatement("select instance_name from v$instance");
ResultSet rset = stmt.executeQuery();
while (rset.next())
{
System.out.println("You are Connected to RAC Instance - "+ rset.getString(1));
}

Thread.currentThread().sleep(60000);

((oracle.jdbc.replay.ReplayableConnection)conn).beginRequest();

PreparedStatement stmt1 = conn.prepareStatement("select instance_name from v$instance");
ResultSet rset1 = stmt1.executeQuery();
while (rset1.next())
{
System.out.println("After Replay Connected to RAC Instance - "+rset1.getString(1));
}

rset.close();
stmt.close();
rset1.close();

stmt1.close();

conn.close();

((oracle.jdbc.replay.ReplayableConnection)conn).endRequest();
}
}

configure weblogic on RAC , active gridlink

Thu, 01 Jul 2021 17:40:00 GMT

/* Table of Contents */

References
[top]

Different approaches for connecting Weblogic Server to RAC database
[top]

http://www.albinsblog.com/2014/04/different-approaches-for-connecting.html , http://java-x.blogspot.com/2006/05/weblogic-server-and-oracle-rac.html
weblogic is an application server https://www.google.com/search?q=is+weblogic+a+web+server+or+application+server&oq=is+weblogic+a+web+server+or+app&aqs=chrome.1.69i57j0l2j33.5824j0j1&sourceid=chrome&ie=UTF-8

youtube - Oracle WebLogic Active GridLink for RAC Demo
[top]

https://www.youtube.com/watch?v=8D6cf6Y5z94

whitepaper - Active GridLink for RAC: Intelligent Integration Between WebLogic Server and Oracle Real Application Clusters <- really good stuff
[top]

http://www.oracle.com/technetwork/middleware/weblogic/overview/activegridlinkwhitepaperoraclenec-1987937.pdf
http://jpn.nec.com/soft/oracle/files/WLS_NECpart_OOW_2014.pdf
https://www.slideshare.net/jeckels/oracle-web-logic-server-12c-seamless-oracle-database-integration
https://blogs.oracle.com/weblogicserver/active-gridlink-configuration-for-database-outages

whitepaper - Oracle WebLogic Server Active GridLink for Oracle Real Application Clusters (RAC)
[top]

http://www.oracle.com/technetwork/middleware/weblogic/gridlink-rac-wp-494900.pdf

https://martincarstenbach.wordpress.com/2014/02/18/runtime-load-balancing-advisory-in-rac-12c/
[top]

How To Configure and Test a WebLogic Gridlink Datasource Connecting To An Oracle RAC SCAN Address (Doc ID 1382656.1) <- good stuff (with gridlink_ha.war)
[top]

Note: Ideally the ONS and FAN should be configured due to the choice of the balancing algorithm to allocate connections to Oracle RAC nodes.

Refer to the Documentation:
https://docs.oracle.com/middleware/11119/wls/JDBCA/gridlink_datasources.htm#CHDHHADB

GridLink data sources provide load balancing in XA and non-XA environments. GridLink data sources use runtime connection load balancing (RCLB) to distribute connections to Oracle RAC instances based on Oracle FAN events issued by the database. This simplifies data source configuration and improves performance as the database drives load balancing of connections through the GridLink data source, independent of the database topology.
(...)
If FAN is not enabled, GridLink data sources use a round-robin load balancing algorithm to allocate connections to Oracle RAC nodes.

https://docs.oracle.com/middleware/11119/wls/JDBCA/gridlink_datasources.htm#CHDHHADB <- Using GridLink Data Sources
[top]

https://docs.oracle.com/middleware/1212/wls/JDBCA/gridlink_datasources.htm#JDBCA373 <- Using Active GridLink Data Sources
[top]

10.3.4 - How-To: Use Oracle WebLogic Server with a JDBC GridLink Data Source
[top]

http://www.oracle.com/technetwork/middleware/weblogic/wls-jdbc-gridlink-howto-333331.html

configure ONS on weblogic
[top]

https://dbhk.wordpress.com/2009/12/16/change-ons-listening-ports/
https://blogs.oracle.com/weblogicserver/ons-configuration-in-wls
http://blog.dbauniversity.com/2009/02/ons-port-and-crs-installation.html
https://docs.oracle.com/cd/E11882_01/java.112/e16548/apxracfan.htm#JJDBC28947
https://web.stanford.edu/dept/itss/docs/oracle/10gR2/java.102/b14355/fstconfo.htm
Testing WLS and ONS Configuration https://blogs.oracle.com/weblogicserver/testing-wls-and-ons-configuration

other HOWTO
[top]

old - How-To Configure and Use Oracle Real Application Clusters (RAC) with Oracle WebLogic Server 10.3
[top]

http://www.oracle.com/technetwork/middleware/weblogic/index-086651.html

pdf - Oracle WebLogic Server 10.3 and Oracle Real Application Clusters (RAC)
[top]

http://www.oracle.com/technetwork/middleware/weblogic/oraclewls-rac-1-131306.pdf

books safari
[top]

tuning weblogic
[top]

Tuning WebLogic Server
[top]

https://docs.oracle.com/cd/E24329_01/web.1211/e24390/wls_tuning.htm#PERFM173

Oracle Optimized Solution for Secure Oracle WebLogic Server
[top]

https://static.ziftsolutions.com/files/0000000055eeed84015608bba82c7933

How to Load balance heavy Traffic on Application Servers - Understanding Network Channels on WLS
[top]

https://www.youtube.com/watch?v=7DHCDXQBro0

Performance Tuning Oracle Weblogic Server 12c
[top]

https://www.slideshare.net/ajithpathiyil1/performance-tuning-oracle-weblogic-server-12c

https://tekslate.com/weblogic-performance-tuning/
[top]

Top Tuning Recommendations for WebLogic Server
[top]

https://docs.oracle.com/cd/E13222_01/wls/docs81/perform/topten.html

gorbachev weblogic workload management RAC
[top]

https://www.slideshare.net/alexgorbachev/demistifying-oracle-rac-workload-management-by-alex-gorbachev-nocoug-2010-spring-conference

weblogic app continuity
[top]

srvctl commit_outcome
[top]

https://books.google.com/books?id=gbp5AAAAQBAJ&pg=PA85&lpg=PA85&dq=srvctl+commit_outcome&source=bl&ots=6f4I6UabTa&sig=5td22Keu0pgA-bh_ivQkq09LBMA&hl=en&sa=X&ved=0ahUKEwjDhtDC-YjVAhXK34MKHY6gD84Q6AEISTAF#v=onepage&q=srvctl%20commit_outcome&f=false

Advanced Configurations for Oracle Drivers and Databases
[top]

https://docs.oracle.com/middleware/1212/wls/JDBCA/ds_oracledriver.htm#JDBCA478

doc - Programming WebLogic JDBC - Using WebLogic Server with Oracle RAC
[top]

https://docs.oracle.com/cd/E13222_01/wls/docs81/jdbc/oracle_rac.html
http://docs.oracle.com/cd/E17904_01/web.1111/e13737/oracle_rac.htm#JDBCA394

doc - Fusion Middleware Configuring and Managing JDBC Data Sources for Oracle WebLogic Server - Using Multi Data Sources with Oracle RAC
[top]

http://docs.oracle.com/cd/E17904_01/web.1111/e13737/generic_oracle_rac.htm#JDBCA292

weblogic deploy war file
[top]

Weblogic Server - Deploy The WAR file
[top]

https://www.youtube.com/watch?v=yex4n8WXBlI

2021
[top]

Active GridLink Configuration for Database Outages https://blogs.oracle.com/weblogicserver/active-gridlink-configuration-for-database-outages

Migrating from Generic Data Source to Active GridLink https://blogs.oracle.com/weblogicserver/migrating-from-generic-data-source-to-active-gridlink

6 Using Active GridLink Data Sources https://docs.oracle.com/en/middleware/standalone/weblogic-server/14.1.1.0/jdbca/gridlink_datasources.html#GUID-82D615E4-857E-4DC1-89D2-34270809690A

Comparing Active GridLink and Multi Data Sources
https://docs.oracle.com/en/middleware/standalone/weblogic-server/14.1.1.0/jdbca/gridlink_datasources.html#GUID-7FB75861-31E6-44CC-88B3-41EE3B1371B5

There are several benefits to using AGL data sources over multi data sources when using Oracle RAC clusters.

The benefits include:

Requires one data source with a single URL. Multi data sources require a configuration with n generic data sources and a multi data source.

Eliminates a polling mechanism that can fail if one of the generic data sources is performing slowly.

Eliminates the need to manually add or delete a node to/from the cluster.

Provides a fast internal notification (out-of-band) when nodes are available so that connections are load-balanced to the new nodes using Oracle Notification Service (ONS).

Provides a fast internal notification when a node goes down so that connections are steered away from the node using ONS.

Provides load balancing advisories (LBA) so that new connections are created on the node with the least load, and the LBA information is also used for gravitation to move idle connections around based on load.

Provides affinity based on your XA transaction or your web session which may significantly improve performance.

Leverages all the advantages of HA configurations like DataGuard. For more information, see Oracle WebLogic Server and Highly Available Oracle Databases: Oracle Integrated Maximum Availability Solutions on the Oracle Technology network at http://www.oracle.com/technetwork/middleware/weblogic/learnmore/index.html
.

Migrating from Multi Data Source to Active GridLink
https://docs.oracle.com/en/middleware/standalone/weblogic-server/14.1.1.0/jdbca/gridlink_datasources.html#GUID-9B644C17-A2C0-4BF3-9AF1-8271008C1622

weblogic performance tuning

Thu, 01 Jul 2021 17:34:00 GMT

Fusion Middleware Administering JDBC Data Sources for Oracle WebLogic Server 12.1.3
https://docs.oracle.com/middleware/1213/wls/JDBCA/ds_tuning.htm#JDBCA490

Difference Between <SQL ISVALID> And <SQL SELECT 1 FROM DUAL> When Datasource Is Testing DB Connection (Doc ID 2236149.1)


Applies to:
Oracle WebLogic Server - Version 12.1.3.0.0 and later
Information in this document applies to any platform.
Goal

To test database connection, [SQL SELECT 1 FROM DUAL] is used before WLS 12.1.2 and [SQL ISVALID] is used from WLS 12.1.3.

What is the difference between them?
Solution

The [SELECT 1 FROM DUAL] checks the connection by a full query including connecting, parsing the SQL, executing the SQL and returning the result.

The [ISVALID] just checks that the remote Database process is still connected via the network socket, without sending anything that needs to go into the Database functionality, like parsing SQL etc.

[ISVALID] can improve the performance;  however it cannot check correctly in a few cases, for example:

    When there is a problem in the parser, execution or other function (except connection) on the Database side.
    When Database is into a shutdown mode but not yet disconnecting.

https://stackoverflow.com/questions/3668506/efficient-sql-test-query-or-validation-query-that-will-work-across-all-or-most

17 Tuning Data Source Connection Pools

This chapter provides information on how to properly tune the connection pool attributes in JDBC data sources in your WebLogic Server 12.1.3 domain to improve application and system performance.

This chapter includes the following sections:

Increasing Performance with the Statement Cache

Connection Testing Options for a Data Source

Enabling Connection Creation Retries

Enabling Connection Requests to Wait for a Connection

Automatically Recovering Leaked Connections

Avoiding Server Lockup with the Correct Number of Connections

Limiting Statement Processing Time with Statement Timeout

Using Pinned-To-Thread Property to Increase Performance

Using Unwrapped Data Type Objects

Tuning Maintenance Timers

IDM weblogic, identity and access management weblogic

Thu, 01 Jul 2021 17:32:00 GMT

MAA Best Practices - Oracle Fusion Middleware
https://www.oracle.com/database/technologies/high-availability/fusion-middleware-maa.html

10.4.2 Creating a Database Service for Oracle Internet Directory
https://docs.oracle.com/cd/E52734_01/core/IMEDG/db_repos.htm#IMEDG30626

Fusion Middleware Enterprise Deployment Guide for Oracle Identity and Access Management
https://docs.oracle.com/cd/E52734_01/core/IMEDG/toc.htm

AddService , Create Service PDB

Thu, 01 Jul 2021 17:16:00 GMT

/* Table of Contents */

11gR2
[top]

http://jarneil.wordpress.com/2010/11/05/11gr2-database-services-and-instance-shutdown/ <— 11gR2 version..

http://pat98.tistory.com/531 <— good stuff, well explained difference on admin and policy managed services

srvctl add service -d RACDB -s <SERVICE NAME HERE> -preferred RACDB1,RACDB2 -clbgoal short -rlbgoal SERVICE_TIME

Create Service PDB
[top]

Adding a Service to a PDB in RAC
[top]

    srvctl add service -db RAC -service MYSVC -preferred RAC1,RAC2 -tafpolicy BASIC -clbgoal SHORT -rlbgoal SERVICE_TIME -pdb PDB

https://hemantoracledba.blogspot.com/2017/04/12cr1-rac-posts-9-adding-service-to-pdb.html?m=1
https://docs.oracle.com/database/121/RACAD/GUID-15576271-E204-4ABD-961B-09876762EBF4.htm#RACAD5047
https://github.com/karlarao/OracleScheduledNodeAllocationTAF
https://karlarao.github.io/karlaraowiki/index.html#%5B%5BSRVCTL%20useful%20commands%5D%5D

..

oracle cloud sizing

Wed, 30 Jun 2021 05:39:00 GMT

AWS

https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ebs-optimized.html

I’ve used https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ebs-optimized.html a few times as it stores shapes storage stats in a table so you can grab it and then sort it.

Looks like you’re out of luck, though I had no idea what the x2gd were as the last time we looked the r5b’s were the largest. Worth a read I suppose in case someone asks.

oracle adw concurrency

Wed, 30 Jun 2021 04:42:00 GMT

Manage Concurrency and Priorities on Autonomous Database
https://docs.oracle.com/en/cloud/paas/autonomous-database/adbsa/manage-priorities.html#GUID-19175472-D200-445F-897A-F39801B0E953

.

.sql tuning videos

Fri, 25 Jun 2021 05:40:00 GMT

https://www.udemy.com/course/oracle-12c-sql-tuning/
https://www.udemy.com/course/sql-performance-tuning-masterclass/
https://www.udemy.com/course/sql-tuning/

Karl Arao's TiddlyWiki

MySQL DW, Mysql Datawarehouse

Golden Gate

golden gate health check [top]

Enkitec materials [top]

Oracle youtube materials [top]

other youtube materials [top]

golden gate waits [top]

oracle autostart

oci vs snowflake, adw vs snowflake

oci vs aws

oci vs gcp

oci vs azure, hybrid cloud

azure

networking

oci comparison

ORDS json api

ORDS for REST API ? [top]

references [top]

tpc-H and tpc-DS

disclaimer [top]

tpc-H [top]

tpc-DS [top]

tpc-H vs tpc-DS [top]

tpcx-hs [top]

others [top]

Analytic Functions

official doc

oracle adw, oci adw

RAC application continuity

configure weblogic on RAC , active gridlink

References [top]

Different approaches for connecting Weblogic Server to RAC database [top]

youtube - Oracle WebLogic Active GridLink for RAC Demo [top]

whitepaper - Active GridLink for RAC: Intelligent Integration Between WebLogic Server and Oracle Real Application Clusters <- really good stuff [top]

whitepaper - Oracle WebLogic Server Active GridLink for Oracle Real Application Clusters (RAC) [top]

https://martincarstenbach.wordpress.com/2014/02/18/runtime-load-balancing-advisory-in-rac-12c/ [top]

How To Configure and Test a WebLogic Gridlink Datasource Connecting To An Oracle RAC SCAN Address (Doc ID 1382656.1) <- good stuff (with gridlink_ha.war) [top]

https://docs.oracle.com/middleware/11119/wls/JDBCA/gridlink_datasources.htm#CHDHHADB <- Using GridLink Data Sources [top]

https://docs.oracle.com/middleware/1212/wls/JDBCA/gridlink_datasources.htm#JDBCA373 <- Using Active GridLink Data Sources [top]

10.3.4 - How-To: Use Oracle WebLogic Server with a JDBC GridLink Data Source [top]

configure ONS on weblogic [top]

other HOWTO [top]

old - How-To Configure and Use Oracle Real Application Clusters (RAC) with Oracle WebLogic Server 10.3 [top]

pdf - Oracle WebLogic Server 10.3 and Oracle Real Application Clusters (RAC) [top]

books safari [top]

Oracle WebLogic Server 12c: First Look [top]

Tuning multi data sources – surviving RAC node failures [top]

Using WebLogic Server with Oracle RAC [top]

other videos [top]

tuning weblogic [top]

Tuning WebLogic Server [top]

Oracle Optimized Solution for Secure Oracle WebLogic Server [top]

How to Load balance heavy Traffic on Application Servers - Understanding Network Channels on WLS [top]

Performance Tuning Oracle Weblogic Server 12c [top]

https://tekslate.com/weblogic-performance-tuning/ [top]

Top Tuning Recommendations for WebLogic Server [top]

gorbachev weblogic workload management RAC [top]

weblogic app continuity [top]

srvctl commit_outcome [top]

Advanced Configurations for Oracle Drivers and Databases [top]

doc - Programming WebLogic JDBC - Using WebLogic Server with Oracle RAC [top]

doc - Fusion Middleware Configuring and Managing JDBC Data Sources for Oracle WebLogic Server - Using Multi Data Sources with Oracle RAC [top]

weblogic deploy war file [top]

Weblogic Server - Deploy The WAR file [top]

2021 [top]

weblogic performance tuning

IDM weblogic, identity and access management weblogic

AddService , Create Service PDB

11gR2 [top]

Create Service PDB [top]

Adding a Service to a PDB in RAC [top]

oracle cloud sizing

AWS

oracle adw concurrency

.sql tuning videos

golden gate health check
[top]

Enkitec materials
[top]

Oracle youtube materials
[top]

other youtube materials
[top]

golden gate waits
[top]

ORDS for REST API ?
[top]

references
[top]

disclaimer
[top]

tpc-H
[top]

tpc-DS
[top]

tpc-H vs tpc-DS
[top]

tpcx-hs
[top]

others
[top]

References
[top]

Different approaches for connecting Weblogic Server to RAC database
[top]

youtube - Oracle WebLogic Active GridLink for RAC Demo
[top]

whitepaper - Active GridLink for RAC: Intelligent Integration Between WebLogic Server and Oracle Real Application Clusters <- really good stuff
[top]

whitepaper - Oracle WebLogic Server Active GridLink for Oracle Real Application Clusters (RAC)
[top]

https://martincarstenbach.wordpress.com/2014/02/18/runtime-load-balancing-advisory-in-rac-12c/
[top]

How To Configure and Test a WebLogic Gridlink Datasource Connecting To An Oracle RAC SCAN Address (Doc ID 1382656.1) <- good stuff (with gridlink_ha.war)
[top]

https://docs.oracle.com/middleware/11119/wls/JDBCA/gridlink_datasources.htm#CHDHHADB <- Using GridLink Data Sources
[top]

https://docs.oracle.com/middleware/1212/wls/JDBCA/gridlink_datasources.htm#JDBCA373 <- Using Active GridLink Data Sources
[top]

10.3.4 - How-To: Use Oracle WebLogic Server with a JDBC GridLink Data Source
[top]

configure ONS on weblogic
[top]

other HOWTO
[top]

old - How-To Configure and Use Oracle Real Application Clusters (RAC) with Oracle WebLogic Server 10.3
[top]

pdf - Oracle WebLogic Server 10.3 and Oracle Real Application Clusters (RAC)
[top]

books safari
[top]

Oracle WebLogic Server 12c: First Look
[top]

Tuning multi data sources – surviving RAC node failures
[top]

Using WebLogic Server with Oracle RAC
[top]

other videos
[top]

tuning weblogic
[top]

Tuning WebLogic Server
[top]

Oracle Optimized Solution for Secure Oracle WebLogic Server
[top]

How to Load balance heavy Traffic on Application Servers - Understanding Network Channels on WLS
[top]

Performance Tuning Oracle Weblogic Server 12c
[top]

https://tekslate.com/weblogic-performance-tuning/
[top]

Top Tuning Recommendations for WebLogic Server
[top]

gorbachev weblogic workload management RAC
[top]

weblogic app continuity
[top]

srvctl commit_outcome
[top]

Advanced Configurations for Oracle Drivers and Databases
[top]

doc - Programming WebLogic JDBC - Using WebLogic Server with Oracle RAC
[top]

doc - Fusion Middleware Configuring and Managing JDBC Data Sources for Oracle WebLogic Server - Using Multi Data Sources with Oracle RAC
[top]

weblogic deploy war file
[top]

Weblogic Server - Deploy The WAR file
[top]

2021
[top]

11gR2
[top]

Create Service PDB
[top]

Adding a Service to a PDB in RAC
[top]