UnableToRemember

SSH wrapping for autocompletion hostnames and domain

2023-11-15T18:28:00.001-05:00

intelligent ssh username and host completion

ssh u1106089

ssh u1106089.west.test.company.com

ssh p1106089
ssh p1106089.west.prod.company.com


Add this to your .zshrc or .bashrc and create the $HOME/sshwrap.sh and make that executable chmod 755 sshwrap.sh

ssh() {
if [[ "$0" == "ssh" ]]; then
    _host=$1
    shift
    .  ~/sshwrap.sh $_host $@ 
fi
}



The contents for sshwrap.sh

#!/bin/bash
_host="$1"
shift
if [[ $(echo "$_host" | grep "^p" | wc -l ) -eq 1 ]] 
then
    #xprod
    if [[ $(echo "${_host}" | grep "prod.cloud.com" | wc -l ) -eq 1 ]]
    then
        _host="${_host}.prod.cloud.com"
    fi
    if [[ $(echo "$_host" | grep "^f751818" | wc -l) -eq 0 ]]
    then
        _host="ff751818@${_host}"
    fi
    echo "connecting production syste, $_host"
elif [[ $(echo "$_host" | grep "^u" | wc -l ) -eq  1 ]]
then
    if [[ $(echo "$_host" | grep test.cloud.com | wc -l ) -eq 0 ]]
    then
        _host="${_host}.test.cloud.com"
    fi
    if [[ $(echo "$_host" | grep "^ff751818" | wc -l ) -eq  0 ]]
    then
        _host="ff751818@${_host}"
    fi
    echo "connecting test system, $_host"
elif [[ $(echo "$_host" | grep "^c" | wc -l) -eq 1 ]]
then
    if [[ $(echo "$_host" | grep test.cloud.com | wc -l ) -eq 0 ]]
    then
        _host="${_host}.test.cloud.com"
    fi
    if [[ $(echo "$_host" | grep "^ak751818" | wc -l ) -eq  0 ]]
    then
        _host="ak751818@${_host}"
    fi
    echo "connecting test system on premises, $_host"
else
    echo "other host definition $_host"
fi
echo "contacting $_host $@"
/usr/bin/ssh $_host $@ 

DOCKER LLB issue ... avoiding

2021-01-05T23:11:00.004-05:00

docker

export DOCKER_BUILDKIT=0
export COMPOSE_DOCKER_CLI_BUILD=0

My minimalistic Atom StyleSheet.

2020-06-19T09:18:00.001-04:00


/*
 * Your Stylesheet
 *
 * This stylesheet is loaded when Atom starts up and is reloaded automatically
 * when it is changed and saved.
 *
 * Add your own CSS or Less to fully customize Atom.
 * If you are unfamiliar with Less, you can read more about it here:
 * http://lesscss.org
 */


/*
 * Examples
 * (To see them, uncomment and save)
 */

// style the background color of the tree view
.tree-view {
  color: white;
  //background-color: black;
}
atom-pane-container atom-pane .item-views {
  border-width: 1px;
  border-color: gray;
  border-style: dashed;
}

.tab-bar .tab .close-icon {
  border-width: 1pt;
  border-color: white;
  border-style: solid;
}
.tab-bar .tab {
  border-width: 1pt;
  border-color: black;
  border-style: dashed;

}
.tab-bar .tab.active {
  border-width: 1px;
  border-color: gray;
  border-style: dashed;
}
// style the background and foreground colors on the atom-text-editor-element itself
atom-text-editor {
   //color: black;
   color: white;
   //background-color: white;
   //font-weight: bold;
   .gutter .line-number {
     //color: black
     color: white;
   }
//Background-color: lightgray;
}

// style UI elements inside atom-text-editor
atom-text-editor .cursor {
  // border-color: red;
}

How to Patch Methods with mock for python

2020-04-26T21:37:00.000-04:00

def test_command_line_gitlab_blocker( LOAD, monkeypatch, get_client, cicd_context, session_context):

    def return_value(self):

        return []

    def update_purge(self,mock):

        return

    with patch.object(GitlabBlocker, 'find_all_to_be_blocked_users',return_value):

        with patch.object(GitlabBlocker, 'update_purge_action_dt', update_purge):

            sys.argv =['gitlab_blocker.py', '--test','cycle','-f', 'my_test.cfg']

            runpy.run_module('gitlab_blocker', run_name='__main__')

class GitlabBlocker(object):

    def __init__(self, config, gitlab_client, test = 'cycle'):

    def _open(self):

    def find_all_to_be_blocked_users(self):

    def update_purge_action_dt(self, uuid):

    def blocking(self, no_Block_call=False):

saving of requests_cache objects as responses of requests in python, handy for mocking services.

2020-03-09T10:49:00.000-04:00

def dump_sqlite_response_cache():

    import sqlite3

    con = sqlite3.connect('demo_cache.sqlite')

    con.row_factory = sqlite3.Row

    from requests_cache.backends.sqlite import DbCache

    import requests_cache

    requests_cache.install_cache('demo_cache')

    #c = BaseCache.remove_old_entries.get_cache()

    s = CachedSession()

    #print(s.__dict__)

    c = requests_cache.core.get_cache()

    #print(c)

    cur = con.cursor()

    cur.execute('select * from responses')

    for i in cur.fetchall():

        cc = i['key']

        ii=0

        with open('response%02d.json' % (ii), 'w+') as f:

            res = c.get_response_and_time(i['key'])

            r = res[0].json()

            f.write(json.dumps(r))

            f.write('\n')

            ii+=1

clear terminal scroll buffer from iterm2

2020-02-14T19:00:00.001-05:00

printf '\033[2J\033[3J\033[1;1H' && find /

python2 EOL now upgrade to python3 as default

2020-01-03T19:02:00.001-05:00

While other installation options are available, the easiest way to get started is with Homebrew:



$ brew install pyenv

🍺  /usr/local/Cellar/pyenv/1.2.10: 634 files, 2.4MB

Now let's install the latest Python version (3.7.3 as of this writing):



$ pyenv install 3.7.3

python-build: use openssl 1.0 from homebrew

python-build: use readline from homebrew

Downloading Python-3.7.3.tar.xz...

-> https://www.python.org/ftp/python/3.7.3/Python-3.7.3.tar.xz

Installing Python-3.7.3...

## further output not included ##

Now that Python 3 is installed through pyenv, we want to set it as our global default version for pyenv environments:



$ pyenv global 3.7.3

# and verify it worked

$ pyenv version
3.7.3

(set by /Users/Guest/.pyenv/version)

The power of pyenv comes from its control over our shell's path. In order for it to work correctly, we need to add the following to our configuration file (.zshrc for me, possibly .bash_profile for you):

$ echo -e 'if command -v pyenv 1>/dev/null 2>&1; then\n  eval "$(pyenv init -)"\nfi' >> ~/.zshrc

We also need to remove the aliases we used in the sections above since they would prevent using pyenv correctly. After removing them, we can confirm pyenv is managing our Python 3 version:



# I start by resetting the current shell

$ exec $0

$ which python

/Users/Guest/.pyenv/shims/python

$ python -V

Python 3.7.3

$ pip -V

pip 19.0.3 from /Users/Guest/.pyenv/versions/3.7.3/lib/python3.7/site-packages/pip (python 3.7)

Now we know for certain that we're using Python 3.7.3 and pip will update alongside it without any manual aliasing between versions. Using Moshe's recommendation to use a version manager (pyenv) enables us to easily accept future upgrades without getting confused about which Python we are running at a given time.

Enable and Disable Word Wrap for iTerm on MacOSX

2019-06-13T23:11:00.003-04:00

lifted directly from https://apple.stackexchange.com/a/210666/115119 Props to @michid Disable line wrapping:

`tput rmam`

Enable line wrapping:

`tput smam`

show me lines between two line markers / identifiers with perl

2018-05-06T17:34:00.002-04:00

Start makers = 'begin - remote_properties' End markers = 'end - remote_properties'

perl -ne 'next unless /begin - remote_properties/ .. /end - remote_properties/;print' testfile.tibco_beGenerator

du calculate totalsize of list of files

2017-09-29T13:34:00.004-04:00

Reading list of files and calculate the total size cat /tmp/deletepurg.txt| tr \\n \\0 | du -skh --files0-from=- --total

reading 3 lines in one time in oneliner perl

2017-09-01T10:15:00.003-04:00

  cat PDDV_hosts.txt | perl -e 'while (my $frs=<>) { chomp $frs; $sec=<>; chomp $sec; $th=<> ;printf "%s,%s,%s", $frs, $sec, $th; }'

Sledgehammer with sudo over remote hosts

2017-07-20T16:50:00.002-04:00

dsh ls /etc/bashrc | perl -ne 'BEGIN { printf "export ss=\${1};shift;export args=\$@;" }{ $_=~s/://g;@x=split /\s+/;printf "ssh -t %s \"echo \${ss} | sudo -S -u tibcosilver \${args} \"\n",$x[0], $x[2]}' | tee out
perl -i -pe "s/#/'/g" out
echo "Please run: . out [Password]"

TIBCO Obfuscate encypt and decrypt : how to ...

2017-06-02T09:49:00.002-04:00

Decrypt.java

import com.tibco.security.ObfuscationEngine;
public class Decrypt {

  public static void main(String[] args) throws Exception {
try {
    System.out.println(ObfuscationEngine.decrypt(args[0]));
} catch (Exception e ) {
}
    System.out.println(ObfuscationEngine.encrypt(args[0].toCharArray()));
  }
}

Compile

javac -cp /opt/tibco/RA1.1/tra/5.9/lib/TIBCrypt.jar  Decrypt.java

Run

java -cp .:/opt/tibco/RA1.1/tra/5.9/lib/TIBCrypt.jar:/opt/tibco/RA1.1/tpcl/5.9/lib/slf4j-log4j12-1.5.2.jar:/opt/tibco/RA1.1/tpcl/5.9/lib/slf4j-api-1.5.2.jar:/opt/tibco/RA1.1/tpcl/5.9/lib/log4j-1.2.15.jar:.  Decrypt "$@"

$ ./run.sh HelloWorld
#!oUNDLWlfuOH60LsUdl/qjrkGRADiglWRuw5Z4mGaUFU=
$ ./run.sh '#!oUNDLWlfuOH60LsUdl/qjrkGRADiglWRuw5Z4mGaUFU='
HelloWorld
#!UsKsGea13VhSx9H+IRO9xrgqRjFQn4RC2n8LybKGyPtgss4cYLwXbKt/Clc++ljpVQsAqhsMJE3sJqk9JY4xJi3LnRXW7rCK/layTvt+xXxqpZB9sX8JjqQUxNn1FrjokjFAKrPTNGM=

reconstructing oracle connect string from userenv details

2017-05-16T17:13:00.002-04:00

select sys_context('userenv','IP_ADDRESS') || '=' || sys_context('userenv','instance_name')  || '.' || sys_context('userenv','db_domain') from dual;

2017-05-10T21:36:00.004-04:00

990 mvn versions:set -DnewVersion=1.0.0 997 next_version=1.0.0 999 svn copy . https://conexus.com:9443/subversion/sefs_common/fxs-deploy/tags/${next_version} $svn_opts -m "Tagged by SEFS shared-library. [artf1376420] Release ${next_version}"

email all users that have exceeded their /home/ size quota with oneliner in du, perl

2017-05-04T07:16:00.004-04:00

du -skh /home/* 2> /dev/null | sort -h | perl -pe 'if (/^\d{3}M/){ ($sz,$who) = $_=~ m!(\S+)\s\/home\/[a-z]{1,2}(75\d+)$!mxi;if ($who) {open(MAIL, "|/usr/sbin/sendmail -t");print MAIL "To: $who\@company.com\nFrom: mightymouse\@company.com\nSubject: homedir size exceeds: $sz; please remove items from your /home/ directory on uwb00078\n\nhomedir current size exceeds $sz > 99.9M; please remove items from your /home/ directory on uwb00078!";close(MAIL);print "$who $sz\n"}} $_=undef'

Syntax for Maven / Eclipse Lifecycle mapping

2017-05-01T16:19:00.003-04:00

New syntax for specifying lifecycle mapping metadata

A new syntax has been introduced to simplify lifecycle mapping metadata for plugin executions, using processing instructions within plugin/executions/execution nodes.

Supported syntax:

<?m2e ignore?> this execution will be ignored;
<?m2e execute?> this execution will be executed once on project import;
<?m2e execute onConfiguration?> this execution will be executed on every Project Configuration update;
<?m2e execute onIncremental?> this execution will be executed on every incremental build;
<?m2e execute onConfiguration,onIncremental?> this execution will be executed on every Project Configuration update and every incremental build;
<?m2e configurator configuratorId?> this execution will be delegated to the matching m2e configurator.

Each instruction can be placed in the <execution> node, this way it applies on this exact execution or on any execution of the same plugin with the same executionId in child pom. It can also be placed in a <plugin> node, this way it acts the same as a dedicated <pluginManagement> section which lists all goals of this plugin.

Please be aware there are currently no Quick Fixes available to automatically inject these new instructions when a “Plugin Execution Not Covered” error marker is found.

Perl find all modules on your INC path.

2017-04-17T15:56:00.002-04:00

 perl -e 'foreach (@INC) {
    print `find $_ -type f -name "*.pm"`;
 }'

oneliner: list names of all ascii files with find and grep

2017-04-14T15:20:00.002-04:00

find .  -type f -exec grep -lIRn RA1.1 {} \; | tee list

settings.xml mirrors repositories proxy

2017-03-14T15:34:00.000-04:00

 <distributionManagement>
  <repository>
   <id>fxg-releases</id>
   <url>https://nexus.x.com:8443/nexus/content/repositories/fxg-releases</url>
  </repository>
  <snapshotRepository>
   <id>fxg-snapshots</id>
   <url>https://nexus.x.com:8443/nexus/content/repositories/fxg-snapshots</url>
  </snapshotRepository>
  <site>
   <id>mvnown</id>
   <url>scpexe://maven.x.com/var/fedex/scm/mvn/httproot/site/${project.artifactId}/${project.artifactId}-${project.version}</url>
  </site>
 </distributionManagement>


SETTINGS XML 


<settings>
 <!-- Switching to c:/temp for the "document and settings" spacing issues some projects have when stepping out of the java realm to perform 
  function by a plugin. -->
 <localRepository>${java.io.tmpdir}/${user.name}/repository</localRepository>
 <interactiveMode>true</interactiveMode>
 <proxies>
  <proxy>
   <active />
   <port>3128</port>
   <host>internet.proxy.fedex.com</host>
   <id>FedEx VPN Proxy</id>
  </proxy>
 </proxies>
 <servers>
  <server>
   <id>releases</id>
   <username>scm</username>
   <password>****</password>
  </server>
  <server>
   <id>snapshots</id>
   <username>dev</username>
   <password>LKLKLJLKJL</password>
  </server>
 </servers>
 <mirrors>
  <mirror>
   <id>proxy</id>
   <name>Maven Proxy</name>
   <url>http://maven.x.com:9999/nexus/content/groups/m2/</url>
   <mirrorOf>external:*,!my-nexus</mirrorOf>
  </mirror>
  <mirror>
   <id>my-nexus</id>
   <name>
    Maven Repository Manager running on 
   </name>
   <url>https://nexus.x.com:8443/nexus/content/groups/m2/</url>
   <mirrorOf>*</mirrorOf>
  </mirror>
 </mirrors>
 <profiles>
  <profile>
   <id>nexus</id>
   <repositories>
    <repository>
     <id>corp-nexus-snapshots</id>
     <url>https://nexus.x.com:8443/nexus/content/repositories/fxg-snapshots</url>
     <releases>
      <enabled>false</enabled>
     </releases>
     <snapshots>
      <enabled>true</enabled>
     </snapshots>
    </repository>
    <repository>
     <id>corp-nexus-releases</id>
     <url>https://nexus.x.com:8443/nexus/content/repositories/fxg-releases</url>
     <releases>
      <enabled>false</enabled>
     </releases>
     <snapshots>
      <enabled>true</enabled>
     </snapshots>
    </repository>
   </repositories>
  </profile>
 </profiles>
 <activeProfiles>
  <activeProfile>nexus</activeProfile>
 </activeProfiles>
</settings>

Jenkins/Cloudbees Available Environment Variables

2017-03-06T23:29:00.001-05:00

Name ↓	Value
_	/usr/bin/java
ANDROID_HOME	/opt/jenkins/tools/android-sdk-linux
BUILD_CAUSE	MANUALTRIGGER
BUILD_CAUSE_MANUALTRIGGER	true
BUILD_DISPLAY_NAME	#39
BUILD_ID	39
BUILD_NUMBER	39
BUILD_TAG	jenkins-EFS-SEFS_COMMON-6270-JOBS-EFS_DASHBOARD_RELEASE_CUT_JOB-39
BUILD_URL	https://company.com:8443/jenkins/job/ShipmentEFS/job/SEFS_COMMON-6270/job/JOBS/job/SEFS_DASHBOARD_RELEASE_CUT_JOB/39/
DONT_DEPLOY	false
EXECUTOR_NUMBER	3
grunt	/opt/jenkins/tools/node-v4.6.0-linux-x64/lib/node_modules/grunt-cli/bin
HOME	/opt/jenkins
HUDSON_HOME	/opt/jenkins
HUDSON_SERVER_COOKIE	4b4586c89a3e8abe
HUDSON_URL	https://company.com:8443/jenkins/
JAVA_HOME	/opt/jenkins/tools/jdk1.7.0_79
JENKINS_HOME	/opt/jenkins
JENKINS_SERVER_COOKIE	4b4586c89a3e8abe
JENKINS_URL	https://company.com:8443/jenkins/
JOB_BASE_NAME	EFS_DASHBOARD_RELEASE_CUT_JOB
JOB_NAME	EFS/EFS_COMMON-6270/JOBS/SEFS_DASHBOARD_RELEASE_CUT_JOB
JOB_URL	https://company.com:8443/jenkins/job/EFS/job/EFS_COMMON-6270/job/JOBS/job/SEFS_DASHBOARD_RELEASE_CUT_JOB/
LOGNAME	jenkins
MAIL	/var/mail/jenkins
NLSPATH	/usr/dt/lib/nls/msg/%L/%N.cat
NODE_LABELS	2144 Android Java7 Java8 Tomcat Tomcat (2144)
NODE_NAME	Tomcat (2144)
OLDPWD	/opt/jenkins
PATH	/usr/local/bin:/bin:/usr/bin
PATH+JDK	/opt/jenkins/tools/jdk1.7.0_79/bin
PWD	/opt/jenkins
RELEASE_TAG	1.3.2.6
ROOT_BUILD_CAUSE	MANUALTRIGGER
ROOT_BUILD_CAUSE_MANUALTRIGGER	true
SHELL	/bin/bash
SHLVL	1
SOURCE_BRANCH	1.3.0-SNAPSHOT
SSH_CLIENT	10.236.10.51 60556 22
SSH_CONNECTION	10.236.10.51 60556 10.236.14.54 22
USER	jenkins
XFILESEARCHPATH	/usr/dt/app-defaults/%L/Dt

Remove arbitrary columns from text lines with perl and splice

2017-02-24T18:13:00.002-05:00

Probably not the shorted ... remove the 9th and 0th column from an ls with perl and splice

find . -type f -ls | sort -k11 | perl -ne '@x=split;splice @x,9,1;splice @x,0,1; print join("\t", @x), "\n";' | tail

Moving one git repository to another git repository host

2017-02-03T05:30:00.004-05:00

You can refer to the GitHub page "Duplicating a repository"

It uses:

git clone --mirror: to clone every references (commits, tags, branches)
git push --mirror: to push everything

That would give:

git clone --mirror https://bitbucket.org/exampleuser/repository-to-mirror.git
# Make a bare mirrored clone of the repository

cd repository-to-mirror.git
git remote set-url --push origin https://github.com/exampleuser/mirrored
# Set the push location to your mirror

git push --mirror

Jenkins / CloudBees : moving jobs between servers .... how ...

2017-02-01T20:11:00.001-05:00

 curl -s https://USER:API_TOKEIN@jenkins.prod.com:8443/jenkins/job/SCM_SVN_MODEL/config.xml | curl -X POST 'http://USER:APITOKEN@jenkins-dev.test.com:8080/jenkins/createItem?name=JOBNAME' --header "Content-Type: application/xml" -d @-

Get the API token on the target machine (in this case jenkins-dev.test.com)

- Open browser and login on target machine
- http://jenkins-dev.test.com:8080/jenkins/user/USER/configure
- hit the API TOKEN button

If you want to directly copy to a folder do this ...

curl -s https://USER_SRC:APITOKEN_SRC@jenkins.prod.com:8443/jenkins/job/SCM_SVN_MODEL/config.xml | \
curl -X POST 'http://USER_TGT:APITOKEN_TGT@jenkins-dev.test.com:8080/jenkins/job/SANDBOX/createItem?name=JOBNAME' --header "Content-Type: application/xml" -d @-

or if you have a list of them ....

declare -a arr=(
"SEFS_ABSTRACT_ACTION_MODEL"
"SEFS_ABSTRACT_BUILD_ENV_MODEL"
"SEFS_ABSTRACT_BUILD_MODEL"
"SEFS_ABSTRACT_SCM_MODEL"
"SEFS_ABSTRACT_TEST_MODEL"
"SEFS_BASE_AUX_MODEL"
"SEFS_BUILDER_TMPL"
"SEFS_JAVA_BUILD_MODEL"
"SEFS_MASTER_BUILD_TMPL"
"SEFS_PROJECT_TMPL"
"SEFS_SCM_GIT_MODEL"
"SEFS_SCM_SVN_MODEL"
"SEFS_SILVER_FABRIC_DEPLOY_TMPLT"
"SEFS_STANDARD_BUILD_ENV_MODEL"
"SEFS_TEST_JUNIT_MODEL"
"SEFS_TIBCO_BUILD_MODEL"
"SEFS_UC_DEPLOY_MODEL")

## now loop through the above array
for i in "${arr[@]}"
do
    curl -s https://USERID_SRC:2615adec2asas558a20790eec2994096c3c455b43@jenkins.prod.com:8443/jenkins/job/$i/config.xml | curl -X POST "http://USERID_TGT:efd517beb69f2ca1sfasfd81371885a48a928cf565@jenkins-dev.test.com:8080/jenkins/job/SANDBOX/createItem?name=$i" --header "Content-Type: application/xml" -d @-
   # or do whatever with individual element of the array
done

Jenkins Pipeline Groovy Snippets.

2017-01-31T20:31:00.002-05:00

Moved some of the examples to gist.github.com for organizational purposes.

Show all binding variables:

echo "${this.binding.variables}"

Change spaces in underscores for the workspace

def getWorkspace() {
pwd().replace("%2F", "_")
}

def wipeWorkspace(String workspace) {
if (workspace) {
sh "find ${workspace} -mindepth 4 -depth -delete"
}
}

Show all environment variables.

node {
sh 'env | sort'
}

Getting absolute path to a Job:

SCM_JOB is a template attribute with item -> Pipelines

[Pipeline] echo
[name:ASSEMBLY_DESCRIPTORS_BUILD,SCM_JOB:org.jenkinsci.plugins.workflow.job.WorkflowJob@3d71aee8[ShipmentEFS/COMMON/JOBS/Pipeline_leaf_caan], steps:org.jenkinsci.plugins.workflow.cps.DSL@dfb3e3d]

${SCM_JOB['fullName']} = 'ShipmentEFS/Common/Jobs/Pipeline_leaf_caan'

then we can do

node {

build job: SCM_JOB['fullName']

}

AUXILARY MODELS AND GETTNG THERE CONTENT

// List all auxilary models for logging purpose

echo "${SEFS_CONTEXT}"

echo "${SCM_MODEL}"

echo "class:${BUILD_MODEL.metaClass.toString()}"

echo "methods:${BUILD_MODEL.metaClass.methods}"

echo "fields: ${BUILD_MODEL.metaClass.fields}"

echo "toSTring: ${BUILD_MODEL.toString()}"

echo "testmodel: ${BUILD_MODEL['BUILD_TEST_MODEL']}"

try {

echo "getbinding: ${BUILD_MODEL.getValue('BUILD_TEST_MODEL')}"

} catch (error) {

echo error

}

try {

echo "model: ${BUILD_MODEL.model}"

def m=BUILD_MODEL.model

echo "meta: ${m['BUILD_TEST_MODEL']}"

} catch (error) {

echo error

echo "model: ${m.metaClass.methods}"

}

try {

echo "getmodel: ${BUILD_MODEL.getModel()}"

} catch (error) {

echo error

}