Flummoxed by IT

Compiling jbig2enc on MSYS on Windows 11 using LLVM & Clang

2023-12-30T02:11:00.002+08:00

These are the steps that I use to build jbig2encon MSYS using LLVM/Clang

Install MSYS2 and development tools
Install jbig2enc dependencies
Substitute inet.h to Winsock2
Build

Install MSYS2 and development tools

The official installation instruction for MSYS2 is pretty straightforward. The default is to use GCC and the relevant development tools. For example, this page has a step-by-step instructions on how to install base-devel, gcc, vim and cmake.

To use the Clang/LLVM toolchain though, you will need the mingw-w64-clang-x86_64-toolchain group.


$ sudo pacman -S mingw-w64-clang-x86_64-toolchain

Install these other development tools: automake autoconf libtool nasm pkgconf


$ sudo pacman -S automake autoconf libtool nasm pkgconf

Install jbig2enc dependencies

Assuming you have cloned the source code of jbig2enc, install the dependencies before you start compiling.


pacman -S zlib-devel clang64/mingw-w64-clang-x86_64-leptonica msys2-w32api-headers

The last package, msys2-w32api-headers, is to provide the Winsock2 library.

Substitute inet.h to Winsock2

Building jbig2enc in a Windows/MSYS environment will lead to certain network functionality missing, for more details on the specifics, see this blog post.

Add the -lws_32 linking flag when you build jbig2enc.

Build

Now go ahead and build


./autogen.sh
LIBS="-lws2_32" ./configure
make
sudo make install

MSYS llvm and clang linking error undefined symbol htons and htonl

2023-12-30T00:57:00.007+08:00

When I was building jbig2enc in a Windows x64 Msys2 environment, I got errors on undefined htons and htonl symbols. Specifically:


libtool: compile:  g++ -DPACKAGE_NAME=\"jbig2enc\" -DPACKAGE_TARNAME=\"jbig2enc-0.28\" -DPACKAGE_VERSION=\"0.28\" "-DPACKAGE_STRING=\"jbig2enc 0.28\"" -DPACKAGE_BUGREPORT=\"agl@imperialviolet.org\" -DPACKAGE_URL=\"https://github.com/agl/jbig2enc\" -DPACKAGE=\"jbig2enc-0.28\" -DVERSION=\"0.28\" -DHAVE_STDIO_H=1 -DHAVE_STDLIB_H=1 -DHAVE_STRING_H=1 -DHAVE_INTTYPES_H=1 -DHAVE_STDINT_H=1 -DHAVE_STRINGS_H=1 -DHAVE_SYS_STAT_H=1 -DHAVE_SYS_TYPES_H=1 -DHAVE_UNISTD_H=1 -DSTDC_HEADERS=1 -DLT_OBJDIR=\".libs/\" -DHAVE_LIBLEPTONICA=1 -DHAVE_LIBTIFF=1 -DHAVE_LIBPNG=1 -DHAVE_LIBJPEG=1 -DHAVE_LIBGIF=1 -DHAVE_LIBWEBP=1 -DHAVE_LIBZ=1 -DHAVE_LIBM=1 -I. -Wall -g -O2 -c jbig2comparator.cc  -DDLL_EXPORT -DPIC -o .libs/jbig2comparator.o
libtool: compile:  g++ -DPACKAGE_NAME=\"jbig2enc\" -DPACKAGE_TARNAME=\"jbig2enc-0.28\" -DPACKAGE_VERSION=\"0.28\" "-DPACKAGE_STRING=\"jbig2enc 0.28\"" -DPACKAGE_BUGREPORT=\"agl@imperialviolet.org\" -DPACKAGE_URL=\"https://github.com/agl/jbig2enc\" -DPACKAGE=\"jbig2enc-0.28\" -DVERSION=\"0.28\" -DHAVE_STDIO_H=1 -DHAVE_STDLIB_H=1 -DHAVE_STRING_H=1 -DHAVE_INTTYPES_H=1 -DHAVE_STDINT_H=1 -DHAVE_STRINGS_H=1 -DHAVE_SYS_STAT_H=1 -DHAVE_SYS_TYPES_H=1 -DHAVE_UNISTD_H=1 -DSTDC_HEADERS=1 -DLT_OBJDIR=\".libs/\" -DHAVE_LIBLEPTONICA=1 -DHAVE_LIBTIFF=1 -DHAVE_LIBPNG=1 -DHAVE_LIBJPEG=1 -DHAVE_LIBGIF=1 -DHAVE_LIBWEBP=1 -DHAVE_LIBZ=1 -DHAVE_LIBM=1 -I. -Wall -g -O2 -c jbig2comparator.cc -o jbig2comparator.o >/dev/null 2>&1
/bin/sh ../libtool  --tag=CXX   --mode=link g++ -Wall -g -O2 -no-undefined -version-info 0:28  -o libjbig2enc.la -rpath /usr/lib jbig2enc.lo jbig2arith.lo jbig2sym.lo jbig2comparator.lo  -lm -lz -lwebp -lgif -ljpeg -lpng -ltiff -lleptonica
libtool: link: g++ -shared -nostdlib D:/msys64/clang64/lib/dllcrt2.o D:/msys64/clang64/lib/crtbegin.o  .libs/jbig2enc.o .libs/jbig2arith.o .libs/jbig2sym.o .libs/jbig2comparator.o   -lz -lwebp -lgif -ljpeg -lpng -ltiff -lleptonica -LD:/msys64/clang64/x86_64-w64-mingw32/lib -LD:/msys64/clang64/x86_64-w64-mingw32/mingw/lib -LD:/msys64/clang64/lib -LD:/msys64/clang64/lib/clang/17/lib/windows -lc++ -lmingw32 D:/msys64/clang64/lib/clang/17/lib/windows/libclang_rt.builtins-x86_64.a -lunwind -lmoldname -lmingwex -lmsvcrt -ladvapi32 -lshell32 -luser32 -lkernel32 -lmingw32 D:/msys64/clang64/lib/clang/17/lib/windows/libclang_rt.builtins-x86_64.a -lunwind -lmoldname -lmingwex -lmsvcrt -lkernel32 D:/msys64/clang64/lib/crtend.o  -g -O2   -o .libs/msys-jbig2enc-0.dll -Wl,--enable-auto-image-base -Xlinker --out-implib -Xlinker .libs/libjbig2enc.dll.a
ld.lld: error: undefined symbol: __declspec(dllimport) htonl
>>> referenced by jbig2enc.cc:674
>>>               .libs/jbig2enc.o:(jbig2_pages_complete(jbig2ctx*, int*))
>>> referenced by jbig2enc.cc:696
>>>               .libs/jbig2enc.o:(jbig2_pages_complete(jbig2ctx*, int*))
>>> referenced by jbig2enc.cc:751
>>>               .libs/jbig2enc.o:(jbig2_produce_page(jbig2ctx*, int, int, int, int*))
>>> referenced 18 more times

ld.lld: error: undefined symbol: __declspec(dllimport) htons
>>> referenced by ./jbig2segments.h:0
>>>               .libs/jbig2enc.o:(Segment::write(unsigned char*))
g++: error: linker command failed with exit code 1 (use -v to see invocation)
make[1]: *** [Makefile:472：libjbig2enc.la] 错误 1
make[1]: 离开目录“/d/Github/jbig2enc/src”
make: *** [Makefile:479：all-recursive] 错误 1

htons and htonl are part of the arpa/inet.h headers in UNIX-like environments. In Windows development environment, these functions are provided by the Winsock2 library.

MSYS ought to ship with the Winsock2 library - or else you can install it from the msys2-w32api-headers package.

Link to Winsock2

When running autoconfig, add the -lws2_32 linker flag. For my example,


LIBS="-lws2_32" ./configure

Windows Subsystem for Linux has no installed distributions

2020-06-08T16:12:00.000+08:00

When trying to launch a new bash console on Windows 10, I get this error


wslbridge error: failed to start backend process
note: bash.exe output: Windows Subsystem for Linux has no installed distributions.
Distributions can be installed by visiting the Microsoft Store:
https://aka.ms/wslstore


ConEmuC: Root process was alive less than 10 sec, ExitCode=0.
Press Enter or Esc to close console...

Windows Subsystem for Linux

This seems weird, as bash worked on my system before, and I remembered installing WSL. A quick check using "optionalfeatures" show that WSL is indeed installed

Installing WSL does not mean it comes with a Linux distribution. I still need to install it manually.

Note also that I am using an older version of Windows 10. Windows 10 Version 1803 and above should be using the wsl command.

Install Linux

Use the lxrun command to install a Linux distribution


λ lxrun /install /y
Warning: lxrun.exe is only used to configure the legacy Windows Subsystem for Linux distribution.
Distributions can be installed by visiting the Microsoft Store:
https://aka.ms/wslstore

This will install Ubuntu on Windows, distributed by Canonical and licensed under its terms available here:
https://aka.ms/uowterms

Downloading from the Microsoft Store... 100%
Extracting filesystem, this will take a few minutes...
Installation successful!
Documentation is available at:  https://aka.ms/wsldocs

After successfully installing Ubuntu, bash works once more


root@hostname:/mnt/c/Users/hanxue#

2020-04-26T18:52:00.002+08:00

I was trying to connect from VSCode Windows into a remote Linux server, and got this error


@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ @        
 WARNING: UNPROTECTED PRIVATE KEY FILE!          @ @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

Permissions for 'C:\\Users\\hanxuel\\OneDrive\\Private\\hanxuel' are too open.

It is required that your private key files are NOT accessible by others.

This private key will be ignored.

Load key "C:\\Users\\hanxuel\\OneDrive\\Private\\hanxuel": bad permissions

Seems the that private SSH key that I am using has too open permissions.

SSH Key Permissions

On Linux, I am pretty clear about the permissions I need to set.

File	Octal Permissions	File Listing Permissions
~/.ssh	700	drwx------
~/.ssh/id_rsa (or other private keys)	600	-rw-------
~/.ssh/id_rsa.pub (or other public keys)	644	-rw-r--r--

So the ~/.ssh directory and SSH private key should be only viewable by myself, although the public key can be more open. The public key is sometimes distributed to other users or used by remote services and it should be public anyway.

Windows SSH Key Permission

Windows file permissions works a bit differently than UNIX. There is filesystem ACL, objects and inheritance. But basically the goal is the same: remove anyone else from reading the private key, except yourself.

Here's a script I found on Superuser.com that does that


:: # Set Variable ::
Set Key="C:\Path\to\key"

:: # Remove Inheritance ::
Cmd /c Icacls %Key% /c /t /Inheritance:d

:: # Set Ownership to Owner ::
Cmd /c Icacls %Key% /c /t /Grant %UserName%:F

:: # Remove All Users, except for Owner ::
Cmd /c Icacls %Key% /c /t /Remove Administrator "Authenticated Users" BUILTIN\Administrators BUILTIN Everyone System Users

:: # Verify ::
Cmd /c Icacls %Key%

Remember to run this script as Administrator.

This is what the output looks like


λ C:\Apps\private_key.cmd 
 
Set Key="C:\Users\hanxuel\OneDrive\Private\hanxuel" 
 
Cmd /c Icacls "C:\Users\hanxuel\OneDrive\Private\hanxuel" /c /t /Inheritance:d 
processed file: C:\Users\hanxuel\OneDrive\Private\hanxuel 
Successfully processed 1 files; Failed processing 0 files 
 
Cmd /c Icacls "C:\Users\hanxuel\OneDrive\Private\hanxuel" /c /t /Grant hanxuel:F 
processed file: C:\Users\hanxuel\OneDrive\Private\hanxuel 
Successfully processed 1 files; Failed processing 0 files 
 
Cmd /c Icacls "C:\Users\hanxuel\OneDrive\Private\hanxuel" /c /t /Remove Administrator "Authenticated Users" BUILTIN\Administrators BUILTIN Everyone System Users 
processed file: C:\Users\hanxuel\OneDrive\Private\hanxuel 
Successfully processed 1 files; Failed processing 0 files 
 
Cmd /c Icacls "C:\Users\hanxuel\OneDrive\Private\hanxuel" 
C:\Users\hanxuel\OneDrive\Private\hanxuel ACME\hanxuel:(F) 
                                                        ACME\xilongj:(F)

Successfully processed 1 files; Failed processing 0 files

Python fatal error: Python.h: No such file or directory

2020-04-22T11:52:00.003+08:00

I got this error while installing a Python package


Installing collected packages: psutil, wcwidth, pyte, thefuck           [37/257]
  Running setup.py install for psutil ... error
    Complete output from command /usr/bin/python3 -u -c "import setuptools, toke
nize;__file__='/tmp/pip-build-2lqls7pu/psutil/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(c
ode, __file__, 'exec'))" install --record /tmp/pip-kips6a90-record/install-recor
d.txt --single-version-externally-managed --compile --user --prefix=:
    running install
    running build
    running build_py
    creating build
    creating build/lib.linux-x86_64-3.6
    creating build/lib.linux-x86_64-3.6/psutil
    copying psutil/_pssunos.py -> build/lib.linux-x86_64-3.6/psutil
    copying psutil/_common.py -> build/lib.linux-x86_64-3.6/psutil
    copying psutil/_psposix.py -> build/lib.linux-x86_64-3.6/psutil
    copying psutil/_pslinux.py -> build/lib.linux-x86_64-3.6/psutil
    copying psutil/_psaix.py -> build/lib.linux-x86_64-3.6/psutil
    copying psutil/_psosx.py -> build/lib.linux-x86_64-3.6/psutil
    copying psutil/_pswindows.py -> build/lib.linux-x86_64-3.6/psutil
    copying psutil/_psbsd.py -> build/lib.linux-x86_64-3.6/psutil
    copying psutil/__init__.py -> build/lib.linux-x86_64-3.6/psutil
    copying psutil/_compat.py -> build/lib.linux-x86_64-3.6/psutil
    creating build/lib.linux-x86_64-3.6/psutil/tests
    copying psutil/tests/test_system.py -> build/lib.linux-x86_64-3.6/psutil/tests
    copying psutil/tests/test_memory_leaks.py -> build/lib.linux-x86_64-3.6/psut
il/tests
    copying psutil/tests/test_linux.py -> build/lib.linux-x86_64-3.6/psutil/test
s
    copying psutil/tests/test_sunos.py -> build/lib.linux-x86_64-3.6/psutil/test
s
    copying psutil/tests/test_misc.py -> build/lib.linux-x86_64-3.6/psutil/tests    copying psutil/tests/test_aix.py -> build/lib.linux-x86_64-3.6/psutil/tests
    copying psutil/tests/test_windows.py -> build/lib.linux-x86_64-3.6/psutil/tests
    copying psutil/tests/test_osx.py -> build/lib.linux-x86_64-3.6/psutil/tests
    copying psutil/tests/__main__.py -> build/lib.linux-x86_64-3.6/psutil/tests

    copying psutil/tests/__main__.py -> build/lib.linux-x86_64-3.6/psutil/tests
    copying psutil/tests/test_process.py -> build/lib.linux-x86_64-3.6/psutil/tests
    copying psutil/tests/test_connections.py -> build/lib.linux-x86_64-3.6/psutil/tests
    copying psutil/tests/test_bsd.py -> build/lib.linux-x86_64-3.6/psutil/tests
    copying psutil/tests/runner.py -> build/lib.linux-x86_64-3.6/psutil/tests
    copying psutil/tests/__init__.py -> build/lib.linux-x86_64-3.6/psutil/tests
    copying psutil/tests/test_unicode.py -> build/lib.linux-x86_64-3.6/psutil/tests
    copying psutil/tests/test_posix.py -> build/lib.linux-x86_64-3.6/psutil/tests
    copying psutil/tests/test_contracts.py -> build/lib.linux-x86_64-3.6/psutil/tests
    running build_ext
    building 'psutil._psutil_linux' extension
    creating build/temp.linux-x86_64-3.6
    creating build/temp.linux-x86_64-3.6/psutil
    gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -DPSUTIL_POSIX=1 -DPSUTIL_SIZEOF_PID_T=4 -DPSUTIL_VERSION=570 -DPSUTIL_LINUX=1 -I/usr/include/python3.6m -c psutil/_psutil_common.c -o build/temp.linux-x86_64-3.6/psutil/_psutil_common.o
    psutil/_psutil_common.c:9:20: fatal error: Python.h: No such file or directory
     #include <Python.h>
                        ^
    compilation terminated.
    error: command 'gcc' failed with exit status 1

    ----------------------------------------
Command "/usr/bin/python3 -u -c "import setuptools, tokenize;__file__='/tmp/pip-build-2lqls7pu/psutil/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /tmp/pip-kips6a90-record/install-record.txt --single-version-externally-managed --compile --user --prefix=" failed with error code 1 in /tmp/pip-build-2lqls7pu/psutil/

Python Header Files

The error message reporting missing Python.h file is because Python cannot find the header/development files. Install the necessary OS package.

For Debian or Ubuntu based OS


sudo apt-get install python-dev  
sudo apt-get install python3-dev

For CentOS / Fedora / RedHat based OS


sudo yum install python-devel  

sudo yum install python3-devel

For example, these are the packages installed on CentOS 7


================================================================================
 Package                     Arch        Version           Repository      Size
================================================================================
Installing:
 python3-devel               x86_64      3.6.8-10.el7      xlnx-base      215 k
Installing for dependencies:
 python-rpm-macros           noarch      3-32.el7          xlnx-base      8.8 k
 python3-rpm-generators      noarch      6-2.el7           xlnx-base       20 k
 python3-rpm-macros          noarch      3-32.el7          xlnx-base      7.7 k

The Python package can now be built and installed successfully


$ pip3 install --user thefuck
Collecting thefuck
  Using cached https://files.pythonhosted.org/packages/57/56/378c08c58453d245435acdb58729db0762537c5d223bbf093454f7834c86/thefuck-3.30-py2.py3-none-any.whl
Requirement already satisfied: decorator in ./.local/lib/python3.6/site-packages (from thefuck)
Requirement already satisfied: colorama in ./.local/lib/python3.6/site-packages (from thefuck)
Collecting pyte (from thefuck)
Collecting psutil (from thefuck)
  Using cached https://files.pythonhosted.org/packages/c4/b8/3512f0e93e0db23a71d82485ba256071ebef99b227351f0f5540f744af41/psutil-5.7.0.tar.gz
Requirement already satisfied: six in ./.local/lib/python3.6/site-packages (from thefuck)
Collecting wcwidth (from pyte->thefuck)
  Using cached https://files.pythonhosted.org/packages/f6/d5/1ecdac957e3ea12c1b319fcdee8b6917ffaff8b4644d673c4d72d2f20b49/wcwidth-0.1.9-py2.py3-none-any.whl
Building wheels for collected packages: psutil
  Running setup.py bdist_wheel for psutil ... done
  Stored in directory: /home/hanxue/.cache/pip/wheels/d7/69/b4/3200b95828d1f0ddb3cb5699083717f4fdbd9b4223d0644c57
Successfully built psutil
Installing collected packages: wcwidth, pyte, psutil, thefuck
Successfully installed psutil-5.7.0 pyte-0.8.0 thefuck-3.30 wcwidth-0.1.9

libreadline.so.6: cannot open shared object file: No such file or directory

2020-04-20T10:44:00.000+08:00

Readline Share Library Missing

When I run a script that calls rlwrap, I got this error on Ubuntu 18.04


rlwrap: error while loading shared libraries: libreadline.so.6: cannot open shared object file: No such file or directory

Looks like it is missing the readline library. Searching Ubuntu package repositories


$ apt search libreadline

libreadline-dev/bionic 7.0-3 amd64
  GNU readline and history libraries, development files

libreadline-gplv2-dev/bionic 5.2+dfsg-3build1 amd64
  GNU readline and history libraries, development files

libreadline-java/bionic 0.8.0.1+dfsg-6 amd64
  GNU readline and BSD editline wrappers for Java

libreadline-java-doc/bionic,bionic 0.8.0.1+dfsg-6 all
  API docs for readline/editline wrappers for Java

libreadline5/bionic,now 5.2+dfsg-3build1 amd64 [installed]
  GNU readline and history libraries, run-time libraries

libreadline5-dbg/bionic 5.2+dfsg-3build1 amd64
  GNU readline and history libraries, debugging libraries

libreadline7/bionic,now 7.0-3 amd64 [installed]
  GNU readline and history libraries, run-time libraries

libreadline7-dbg/bionic 7.0-3 amd64
  GNU readline and history libraries, debugging libraries

Checking on the libreadline6 library, it was deleted on 2017-12-06 from this Debian bug. The reason for deletion being

(From Debian) ROM; obsolete version of readline;

What is Readline

Readline is the library that allows you to

move the text cursor in command line
search history
copy and paste
tab completion
and so on

In short, any useful command line utility using C will need Readline or an equivalent library.

Using Readline 5 and Readline 7

Let's see if the other versions of Readline has been installed on the system


$ sudo apt install libreadline5
Reading package lists... Done
Building dependency tree
Reading state information... Done
libreadline5 is already the newest version (5.2+dfsg-3build1).
0 upgraded, 0 newly installed, 0 to remove and 15 not upgraded.


$ sudo apt install libreadline7
Reading package lists... Done
Building dependency tree
Reading state information... Done
libreadline7 is already the newest version (7.0-3).
0 upgraded, 0 newly installed, 0 to remove and 15 not upgraded.

Unfortunately the script still requires the Readline version 6


rlwrap: error while loading shared libraries: libreadline.so.6: cannot open shared object file: No such file or directory

libreadline-dev

From my understanding of the error message, I thought Readline 6 is required. I am going to try installing libreadline-dev anyway, to see if it has the pkg-config files and recompile rlwrap with libreadline7.


$ sudo apt install libreadline-dev
Reading package lists... Done
Building dependency tree
Reading state information... Done
Suggested packages:
  readline-doc
The following NEW packages will be installed:
  libreadline-dev
0 upgraded, 1 newly installed, 0 to remove and 15 not upgraded.
Need to get 133 kB of archives.
After this operation, 728 kB of additional disk space will be used.
Get:1 http://xco-engapt.xilinx.com/ubuntu180401 bionic/main amd64 libreadline-de
v amd64 7.0-3 [133 kB]
Fetched 133 kB in 1s (90.8 kB/s)
debconf: delaying package configuration, since apt-utils is not installed
Selecting previously unselected package libreadline-dev:amd64.
(Reading database ... 328880 files and directories currently installed.)
Preparing to unpack .../libreadline-dev_7.0-3_amd64.deb ...
Unpacking libreadline-dev:amd64 (7.0-3) ...
Processing triggers for install-info (6.5.0.dfsg.1-2) ...
Setting up libreadline-dev:amd64 (7.0-3) ...

Let's take a look at the content


$ dpkg -L libreadline-de
v
/.
/usr
/usr/include
/usr/include/readline
/usr/include/readline
/usr/include/readline/chardefs.h
/usr/include/readline/history.h
/usr/include/readline/keymaps.h
/usr/include/readline/readline.h
/usr/include/readline/rlconf.h
/usr/include/readline/rlstdc.h
/usr/include/readline/rltypedefs.h
/usr/include/readline/tilde.h
/usr/lib
/usr/lib/x86_64-linux-gnu
/usr/lib/x86_64-linux-gnu/libhistory.a
/usr/lib/x86_64-linux-gnu/libreadline.a
/usr/share
/usr/share/doc
/usr/share/info
/usr/lib/x86_64-linux-gnu/libhistory.so
/usr/lib/x86_64-linux-gnu/libreadline.so
/usr/share/doc/libreadline-dev

Hmmm... there's a /usr/lib/x86_64-linux-gnu/libreadline.so . Let's try to recompile and see if it works


$ ./configure
...
...
...
checking readline/readline.h usability... yes
checking readline/readline.h presence... yes
checking for readline/readline.h... yes
checking whether your readline headers and library know about rl_set_screen_size
... yes
checking whether your readline headers and library know about rl_basic_quote_cha
racters... yes
checking whether your readline headers and library know about rl_variable_value.
.. yes
checking whether your readline headers and library know about rl_readline_versio
n... yes
checking whether your readline headers and library know about rl_executing_keyse
q... yes
checking whether the private symbol _rl_horizontal_scroll_mode is visble in your
 readline libs... yes
Will rlwrap find command's working directory under /proc/commands pid=""/cwd? let
's see...
checking for /proc/5269/cwd/configure.ac... yes
checking whether we can find command line under opt_proc_mountpoint/pid/cmdl
ine and mirror it by overwriting our own *argv... yes
checking that generated files are newer than configure... done
checking that generated files are newer than configure... done
configure: creating ./config.status/pid/opt_proc_mountpoint/commands

And now build the binary


$ make
make  all-recursive
make[1]: Entering directory '/Github/rlwrap'
Making all in doc
make[2]: Entering directory '/Github/rlwrap/doc'
sed -e 's#@DATADIR@#/usr/local/share#'  rlwrap.man > rlwrap.1
make[2]: Leaving directory '/Github/rlwrap/doc'
Making all in src
make[2]: Entering directory '/Github/rlwrap/src'
gcc -DHAVE_CONFIG_H -I. -I..    -DDATADIR=\"/usr/local/share\"  -g -O2 -MT main.
o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c
mv -f .deps/main.Tpo .deps/main.Po
gcc -DHAVE_CONFIG_H -I. -I..    -DDATADIR=\"/usr/local/share\"  -g -O2 -MT signa
ls.o -MD -MP -MF .deps/signals.Tpo -c -o signals.o signals.c
mv -f .deps/signals.Tpo .deps/signals.Po
gcc -DHAVE_CONFIG_H -I. -I..    -DDATADIR=\"/usr/local/share\"  -g -O2 -MT readlmv -f .deps/signals.Tpo .deps/signals.Po                               [84/1892]
gcc -DHAVE_CONFIG_H -I. -I..    -DDATADIR=\"/usr/local/share\"  -g -O2 -MT readl
ine.o -MD -MP -MF .deps/readline.Tpo -c -o readline.o readline.c
mv -f .deps/readline.Tpo .deps/readline.Po
gcc -DHAVE_CONFIG_H -I. -I..    -DDATADIR=\"/usr/local/share\"  -g -O2 -MT pty.o
 -MD -MP -MF .deps/pty.Tpo -c -o pty.o pty.c
mv -f .deps/pty.Tpo .deps/pty.Po
rbgen completion.rb completion.c || echo "You don't seem to have rbgen (http://l
ibredblack.sourceforge.net/). If you didn't change any .rb files, this is not a
problem"
/bin/sh: rbgen: command not found
You don't seem to have rbgen (http://libredblack.sourceforge.net/). If you didn'
t change any .rb files, this is not a problem
gcc -DHAVE_CONFIG_H -I. -I..    -DDATADIR=\"/usr/local/share\"  -g -O2 -MT compl
etion.o -MD -MP -MF .deps/completion.Tpo -c -o completion.o completion.c
mv -f .deps/completion.Tpo .deps/completion.Po
gcc -DHAVE_CONFIG_H -I. -I..    -DDATADIR=\"/usr/local/share\"  -g -O2 -MT term.
o -MD -MP -MF .deps/term.Tpo -c -o term.o term.c
mv -f .deps/term.Tpo .deps/term.Po
gcc -DHAVE_CONFIG_H -I. -I..    -DDATADIR=\"/usr/local/share\"  -g -O2 -MT ptytt
y.o -MD -MP -MF .deps/ptytty.Tpo -c -o ptytty.o ptytty.c
mv -f .deps/ptytty.Tpo .deps/ptytty.Po
gcc -DHAVE_CONFIG_H -I. -I..    -DDATADIR=\"/usr/local/share\"  -g -O2 -MT utils
.o -MD -MP -MF .deps/utils.Tpo -c -o utils.o utils.c
mv -f .deps/utils.Tpo .deps/utils.Po
gcc -DHAVE_CONFIG_H -I. -I..    -DDATADIR=\"/usr/local/share\"  -g -O2 -MT strin
g_utils.o -MD -MP -MF .deps/string_utils.Tpo -c -o string_utils.o string_utils.c
mv -f .deps/string_utils.Tpo .deps/string_utils.Po
gcc -DHAVE_CONFIG_H -I. -I..    -DDATADIR=\"/usr/local/share\"  -g -O2 -MT mallo
mv -f .deps/string_utils.Tpo .deps/string_utils.Po                     [57/1892]
gcc -DHAVE_CONFIG_H -I. -I..    -DDATADIR=\"/usr/local/share\"  -g -O2 -MT mallo
c_debug.o -MD -MP -MF .deps/malloc_debug.Tpo -c -o malloc_debug.o malloc_debug.c
mv -f .deps/malloc_debug.Tpo .deps/malloc_debug.Po
gcc -DHAVE_CONFIG_H -I. -I..    -DDATADIR=\"/usr/local/share\"  -g -O2 -MT filte
r.o -MD -MP -MF .deps/filter.Tpo -c -o filter.o filter.c
mv -f .deps/filter.Tpo .deps/filter.Po
gcc -DDATADIR=\"/usr/local/share\"  -g -O2   -o rlwrap main.o signals.o readline
.o pty.o completion.o term.o ptytty.o utils.o string_utils.o malloc_debug.o filt
er.o  -lutil   -lreadline -ltinfo
make[2]: Leaving directory '/Github/rlwrap/src'
Making all in filters
make[2]: Entering directory '/Github/rlwrap/filters'
make[2]: Nothing to be done for 'all'.
make[2]: Leaving directory '/Github/rlwrap/filters'
make[2]: Entering directory '/Github/rlwrap'
make[2]: Leaving directory '/Github/rlwrap'
make[1]: Leaving directory '/Github/rlwrap'

And let's try the script that calls rlwrap again


$ ggv macos src
grep: src: Is a directory
grep: src: Is a directory
============================ grep results ===============================
     1  ./tools/config.sub:1396:              | -macos* | -mpw* | -magic* | -mmi
xware* | -mon960* | -lnews*)
     2  ./tools/config.sub:1399:                os=`echo $os | sed -e 's|mac|mac
os|'`
     3  ./tools/config.sub:1695:                os=-macos
     4  ./tools/config.sub:1766:                        -mpw* | -macos*)
============================ grep results ===============================
Enter a number between 1 and 4 or anything else to quit:  2

Looks great!

In short, libreadline-dev is needed to run rlwrap - although during compilation it is not needed. Not intuitive to me, as I expect libreadline-dev to be used during compilation, instead of containing the shared library that is used during runtime.

SSH: How to log in using Password only and ignore ssh keys

2020-04-09T14:01:00.002+08:00

When I first discovered the magic of passwordless SSH login using ssh keys, I was thrilled with the convenience of logging in directly. But sometimes we do not want to use ssh keypairs to log in. Perhaps there are different sets of hosts using different keys - in this case, setting up ~/.ssh/config with matching key/host is the way to go. Or perhaps you want to troubleshooting password authentication issue.

Password Authentication

Using the PreferredAuthentication option should work


ssh -o PreferredAuthentications=password hostname

Unfortunately it sometimes does not work. The remote host may have preferred SSH keys when available. Or the remote hosts' SSH client configuration prefers SSH key.

The following options should ensure that only Password authentication is used


ssh -o PasswordAuthentication=yes -o PreferredAuthentications=keyboard-interactive,password -o PubkeyAuthentication=no hostname

Python error: invalid command 'bdist_wheel'

2020-03-25T11:57:00.001+08:00

I was trying to install https://github.com/thombashi/sqlitebiter and ran into this error

  error: invalid command 'bdist_wheel'

Solution

Install the wheel Python package to solve the problem

 $ pip3 install wheel
Collecting wheel
  Downloading https://files.pythonhosted.org/packages/8c/23/848298cccf8e40f5bbb59009b32848a4c38f4e7f3364297ab3c3e2e2cd14/wheel-0.34.2-py2.py3-none-any.whl
Installing collected packages: wheel
Successfully installed wheel-0.34.2

Why

The Python package that you are installing needs to run

python3 setup.py bdist_wheel

When the wheel package is missing, this is what you see

$ pip3 install --user sqlitebiter
Collecting sqlitebiter
  Using cached https://files.pythonhosted.org/packages/e3/6e/5fa8df113446e25455ccda73d6b9abccee60b754bf01b2c6285d108750dc/sqlitebiter-0.31.0-py3-none-any.whl
Collecting pathvalidate<3,>=2.1.0 (from sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/08/af/0d99785427f6e36f958bf05dc7e058ec1031ce7b478216d818bf61bac657/pathvalidate-2.2.1-py3-none-any.whl
Collecting loguru<1,>=0.4.1 (from sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/b2/f4/2c8b94025c6e30bdb331c7ee628dc152771845aedff35f0365c2a4dacd42/loguru-0.4.1-py3-none-any.whl (54kB)
    100% |████████████████████████████████| 61kB 2.1MB/s
Collecting colorama<1,>=0.3.7 (from sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/c9/dc/45cdef1b4d119eb96316b3117e6d5708a08029992b2fee2c143c7a0a5cc5/colorama-0.4.3-py2.py3-none-any.whl
Collecting appconfigpy<2,>=0.4.0 (from sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/f5/fa/ac0ba73728948436e7dae3e235b0fc06f4db836038537a58dd207f6b3dcf/appconfigpy-1.0.1-py3-none-any.whl
Collecting msgfy<1,>=0.0.6 (from sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/af/a1/2c98ebd88ee88d300a3eedd41e5b8c2781bf7d39ecf56abf91dd93721711/msgfy-0.0.7-py2.py3-none-any.whl
Collecting setuptools>=38.3.0 (from sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/1e/32/69e6ce8502a12af0cdcbb8de91f1cbafd4533f84d8fe17bf712f6200f21b/setuptools-46.1.1-py3-none-any.whl (582kB)
    100% |████████████████████████████████| 583kB 1.7MB/s
Collecting pytablereader[excel,md,sqlite,url]<2,>=0.28.0 (from sqlitebiter)
  Using cached https://files.pythonhosted.org/packages/d4/36/3c986cf8d2f6c8e1372b11e10abb02cdb0a25549b8569c01bf10eafe9f5b/pytablereader-0.28.0-py3-none-any.whl
Collecting nbformat<6,>=4.4.0 (from sqlitebiter)
  Using cached https://files.pythonhosted.org/packages/ac/eb/de575b7a64e7ab8d8c95e4c180ccc36deda3f1379186c4ee7adf6c2f1586/nbformat-5.0.4-py3-none-any.whl
Collecting simplejson<4,>=3.8.1 (from sqlitebiter)
  Using cached https://files.pythonhosted.org/packages/98/87/a7b98aa9256c8843f92878966dc3d8d914c14aad97e2c5ce4798d5743e07/simplejson-3.17.0.tar.gz
Collecting path.py<13 (from sqlitebiter)
  Using cached https://files.pythonhosted.org/packages/a5/0d/4caee829b04e3113b7069fa52063bce5c78e374e05850aa893549e917a1a/path.py-12.4.0-py3-none-any.whl
Collecting typepy<2,>=0.6.6 (from sqlitebiter)
  Using cached https://files.pythonhosted.org/packages/54/e8/e11b753cced190dd2e3decc1697a5fed3325e94f4e9c4ef20ff7936948ec/typepy-0.6.6-py2.py3-none-any.whl
Collecting SimpleSQLite<2,>=1.0.1 (from sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/76/3f/0f928c322df10a014750ad04f503b515b1bc7d3d339c478462cb25f59384/SimpleSQLite-1.0.1-py3-none-any.whl
Collecting retryrequests<1,>=0.0.2 (from sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/9c/0e/a61a2c47684922c4d0878c323803d332f8a2509ac8490e25b0e19448b026/retryrequests-0.0.3-py2.py3-none-any.whl
Collecting click<8,>=6.2 (from sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/dd/c0/4d8f43a9b16e289f36478422031b8a63b54b6ac3b1ba605d602f10dd54d6/click-7.1.1-py2.py3-none-any.whl (82kB)
    100% |████████████████████████████████| 92kB 3.6MB/s
Collecting aiocontextvars>=0.2.0; python_version < "3.7" (from loguru<1,>=0.4.1->sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/db/c1/7a723e8d988de0a2e623927396e54b6831b68cb80dce468c945b849a9385/aiocontextvars-0.2.2-py2.py3-none-any.whl
Collecting jsonschema<4,>=2.5.1 (from pytablereader[excel,md,sqlite,url]<2,>=0.28.0->sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/c5/8f/51e89ce52a085483359217bc72cdbf6e75ee595d5b1d4b5ade40c7e018b8/jsonschema-3.2.0-py2.py3-none-any.whl (56kB)
    100% |████████████████████████████████| 61kB 2.8MB/s
Collecting beautifulsoup4<5,>=4.4.1 (from pytablereader[excel,md,sqlite,url]<2,>=0.28.0->sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/cb/a1/c698cf319e9cfed6b17376281bd0efc6bfc8465698f54170ef60a485ab5d/beautifulsoup4-4.8.2-py3-none-any.whl (106kB)
    100% |████████████████████████████████| 112kB 3.5MB/s
Collecting mbstrdecoder<2,>=0.8.3 (from pytablereader[excel,md,sqlite,url]<2,>=0.28.0->sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/d1/bb/06a26dcda7404b4387e72317961f50cbadcd91d5d12eb27b4701313cff6f/mbstrdecoder-0.8.4-py2.py3-none-any.whl
Collecting tabledata<2,>=0.10.3 (from pytablereader[excel,md,sqlite,url]<2,>=0.28.0->sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/56/8e/6a1cd2c4f0004d3fb658dc1bd6597e9b583011935f5aee4b96318ef34290/tabledata-1.1.0-py3-none-any.whl
Collecting DataProperty<2,>=0.46.3 (from pytablereader[excel,md,sqlite,url]<2,>=0.28.0->sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/a7/db/251fdaeabd3bdfcff69e6558a0c8986ba07e2cee7099d962930e67944d35/DataProperty-0.46.4-py2.py3-none-any.whl
Collecting excelrd>=2.0.2; extra == "excel" (from pytablereader[excel,md,sqlite,url]<2,>=0.28.0->sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/78/3e/d7be8ffa1a2726c65e379b5b485442546e3654455a3ff701f11c45a47a91/excelrd-2.0.3-py3-none-any.whl (105kB)
    100% |████████████████████████████████| 112kB 4.2MB/s
Collecting Markdown<3,>=2.6.6; extra == "md" (from pytablereader[excel,md,sqlite,url]<2,>=0.28.0->sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/6d/7d/488b90f470b96531a3f5788cf12a93332f543dbab13c423a5e7ce96a0493/Markdown-2.6.11-py2.py3-none-any.whl (78kB)
    100% |████████████████████████████████| 81kB 3.7MB/s
Collecting requests<3,>=2.18.4; extra == "url" (from pytablereader[excel,md,sqlite,url]<2,>=0.28.0->sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/1a/70/1935c770cb3be6e3a8b78ced23d7e0f3b187f5cbfab4749523ed65d7c9b1/requests-2.23.0-py2.py3-none-any.whl (58kB)
    100% |████████████████████████████████| 61kB 3.0MB/s
Collecting ipython-genutils (from nbformat<6,>=4.4.0->sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/fa/bc/9bd3b5c2b4774d5f33b2d544f1460be9df7df2fe42f352135381c347c69a/ipython_genutils-0.2.0-py2.py3-none-any.whl
Collecting jupyter-core (from nbformat<6,>=4.4.0->sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/63/0d/df2d17cdf389cea83e2efa9a4d32f7d527ba78667e0153a8e676e957b2f7/jupyter_core-4.6.3-py2.py3-none-any.whl (83kB)
    100% |████████████████████████████████| 92kB 3.6MB/s
Collecting traitlets>=4.1 (from nbformat<6,>=4.4.0->sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/ca/ab/872a23e29cec3cf2594af7e857f18b687ad21039c1f9b922fac5b9b142d5/traitlets-4.3.3-py2.py3-none-any.whl (75kB)
    100% |████████████████████████████████| 81kB 3.7MB/s
Collecting path<13.2 (from path.py<13->sqlitebiter)
  Using cached https://files.pythonhosted.org/packages/4d/24/5827e075036b5bb6b538f71bf39574d4a8024c5df51206cb9d6739e24d94/path-13.1.0-py3-none-any.whl
Collecting six<2,>=1.10.0 (from typepy<2,>=0.6.6->sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/65/eb/1f97cb97bfc2390a276969c6fae16075da282f5058082d4cb10c6c5c1dba/six-1.14.0-py2.py3-none-any.whl
Collecting sqliteschema<2,>=0.17.4 (from SimpleSQLite<2,>=1.0.1->sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/00/e4/6a72614e477a62a3a7bc7f36e24475f25b7615a7289da67b6dcf4a73cebe/sqliteschema-1.0.1-py3-none-any.whl
Collecting contextvars==2.4; python_version < "3.7" (from aiocontextvars>=0.2.0; python_version < "3.7"->loguru<1,>=0.4.1->sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/83/96/55b82d9f13763be9d672622e1b8106c85acb83edd7cc2fa5bc67cd9877e9/contextvars-2.4.tar.gz
Collecting importlib-metadata; python_version < "3.8" (from jsonschema<4,>=2.5.1->pytablereader[excel,md,sqlite,url]<2,>=0.28.0->sqlitebiter)
  Using cached https://files.pythonhosted.org/packages/8b/03/a00d504808808912751e64ccf414be53c29cad620e3de2421135fcae3025/importlib_metadata-1.5.0-py2.py3-none-any.whl
Collecting attrs>=17.4.0 (from jsonschema<4,>=2.5.1->pytablereader[excel,md,sqlite,url]<2,>=0.28.0->sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/a2/db/4313ab3be961f7a763066401fb77f7748373b6094076ae2bda2806988af6/attrs-19.3.0-py2.py3-none-any.whl
Collecting pyrsistent>=0.14.0 (from jsonschema<4,>=2.5.1->pytablereader[excel,md,sqlite,url]<2,>=0.28.0->sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/9f/0d/cbca4d0bbc5671822a59f270e4ce3f2195f8a899c97d0d5abb81b191efb5/pyrsistent-0.16.0.tar.gz (108kB)
    100% |████████████████████████████████| 112kB 4.0MB/s
Collecting soupsieve>=1.2 (from beautifulsoup4<5,>=4.4.1->pytablereader[excel,md,sqlite,url]<2,>=0.28.0->sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/05/cf/ea245e52f55823f19992447b008bcbb7f78efc5960d77f6c34b5b45b36dd/soupsieve-2.0-py2.py3-none-any.whl
Collecting chardet<4,>=3.0.4 (from mbstrdecoder<2,>=0.8.3->pytablereader[excel,md,sqlite,url]<2,>=0.28.0->sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB)
    100% |████████████████████████████████| 143kB 3.6MB/s
Collecting idna<3,>=2.5 (from requests<3,>=2.18.4; extra == "url"->pytablereader[excel,md,sqlite,url]<2,>=0.28.0->sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/89/e3/afebe61c546d18fb1709a61bee788254b40e736cff7271c7de5de2dc4128/idna-2.9-py2.py3-none-any.whl (58kB)
    100% |████████████████████████████████| 61kB 3.0MB/s
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 (from requests<3,>=2.18.4; extra == "url"->pytablereader[excel,md,sqlite,url]<2,>=0.28.0->sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/e8/74/6e4f91745020f967d09332bb2b8b9b10090957334692eb88ea4afe91b77f/urllib3-1.25.8-py2.py3-none-any.whl (125kB)
    100% |████████████████████████████████| 133kB 3.9MB/s
Collecting certifi>=2017.4.17 (from requests<3,>=2.18.4; extra == "url"->pytablereader[excel,md,sqlite,url]<2,>=0.28.0->sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/b9/63/df50cac98ea0d5b006c55a399c3bf1db9da7b5a24de7890bc9cfd5dd9e99/certifi-2019.11.28-py2.py3-none-any.whl (156kB)
    100% |████████████████████████████████| 163kB 3.7MB/s
Collecting decorator (from traitlets>=4.1->nbformat<6,>=4.4.0->sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/ed/1b/72a1821152d07cf1d8b6fce298aeb06a7eb90f4d6d41acec9861e7cc6df0/decorator-4.4.2-py2.py3-none-any.whl
Collecting immutables>=0.9 (from contextvars==2.4; python_version < "3.7"->aiocontextvars>=0.2.0; python_version < "3.7"->loguru<1,>=0.4.1->sqlitebiter)
  Downloading https://files.pythonhosted.org/packages/62/cc/3961b18a1a689a7e3232d923a8546cb901c49b4a33be6987c03a89175c4f/immutables-0.11-cp36-cp36m-manylinux1_x86_64.whl (92kB)
    100% |████████████████████████████████| 102kB 4.5MB/s
Collecting zipp>=0.5 (from importlib-metadata; python_version < "3.8"->jsonschema<4,>=2.5.1->pytablereader[excel,md,sqlite,url]<2,>=0.28.0->sqlitebiter)
  Using cached https://files.pythonhosted.org/packages/b2/34/bfcb43cc0ba81f527bc4f40ef41ba2ff4080e047acb0586b56b3d017ace4/zipp-3.1.0-py3-none-any.whl
Building wheels for collected packages: simplejson, contextvars, pyrsistent
  Running setup.py bdist_wheel for simplejson ... error
  Complete output from command /usr/bin/python3 -u -c "import setuptools, tokenize;__file__='/tmp/pip-build-h9yib_fx/simplejson/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" bdist_wheel -d /tmp/tmp7b6yj0eypip-wheel- --python-tag cp36:
  usage: -c [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
     or: -c --help [cmd1 cmd2 ...]
     or: -c --help-commands
     or: -c cmd --help

  error: invalid command 'bdist_wheel'

  ----------------------------------------
  Failed building wheel for simplejson
  Running setup.py clean for simplejson
  Running setup.py bdist_wheel for contextvars ... error
  Complete output from command /usr/bin/python3 -u -c "import setuptools, tokenize;__file__='/tmp/pip-build-h9yib_fx/contextvars/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" bdist_wheel -d /tmp/tmpzbq6a04jpip-wheel- --python-tag cp36:
  usage: -c [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
     or: -c --help [cmd1 cmd2 ...]
     or: -c --help-commands
     or: -c cmd --help

  error: invalid command 'bdist_wheel'

  ----------------------------------------
  Failed building wheel for contextvars
  Running setup.py clean for contextvars
  Running setup.py bdist_wheel for pyrsistent ... error
  Complete output from command /usr/bin/python3 -u -c "import setuptools, tokenize;__file__='/tmp/pip-build-h9yib_fx/pyrsistent/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" bdist_wheel -d /tmp/tmpunvvup5kpip-wheel- --python-tag cp36:
  /usr/lib/python3.6/distutils/dist.py:261: UserWarning: Unknown distribution option: 'license_files'
    warnings.warn(msg)
  usage: -c [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
     or: -c --help [cmd1 cmd2 ...]
     or: -c --help-commands
     or: -c cmd --help

  error: invalid command 'bdist_wheel'

  ----------------------------------------
  Failed building wheel for pyrsistent
  Running setup.py clean for pyrsistent
Failed to build simplejson contextvars pyrsistent
Installing collected packages: pathvalidate, immutables, contextvars, aiocontextvars, loguru, colorama, appconfigpy, setuptools, msgfy, zipp, importlib-metadata, attrs, six, pyrsistent, jsonschema, soupsieve, beautifulsoup4, path, path.py, chardet, mbstrdecoder, typepy, DataProperty, tabledata, excelrd, Markdown, sqliteschema, SimpleSQLite, idna, urllib3, certifi, requests, retryrequests, pytablereader, ipython-genutils, decorator, traitlets, jupyter-core, nbformat, simplejson, click, sqlitebiter
  Running setup.py install for contextvars ... done
  Running setup.py install for pyrsistent ... done
  Running setup.py install for simplejson ... done
Successfully installed DataProperty-0.46.4 Markdown-2.6.11 SimpleSQLite-1.0.1 aiocontextvars-0.2.2 appconfigpy-1.0.1 attrs-19.3.0 beautifulsoup4-4.8.2 certifi-2019.11.28 chardet-3.0.4 click-7.1.1 colorama-0.4.3 contextvars-2.4 decorator-4.4.2 excelrd-2.0.3 idna-2.9 immutables-0.11 importlib-metadata-1.5.0 ipython-genutils-0.2.0 jsonschema-3.2.0 jupyter-core-4.6.3 loguru-0.4.1 mbstrdecoder-0.8.4 msgfy-0.0.7 nbformat-5.0.4 path-13.1.0 path.py-12.4.0 pathvalidate-2.2.1 pyrsistent-0.16.0 pytablereader-0.28.0 requests-2.23.0 retryrequests-0.0.3 setuptools-46.1.1 simplejson-3.17.0 six-1.14.0 soupsieve-2.0 sqlitebiter-0.31.0 sqliteschema-1.0.1 tabledata-1.1.0 traitlets-4.3.3 typepy-0.6.6 urllib3-1.25.8 zipp-3.1.0

Windows Server: OpenSSH service does not start

2020-02-27T01:47:00.002+08:00

I was trying to run OpenSSH server on a Windows Server and got the error


Windows could not start the sshd service on Local Computer.



Error 1067: the process terminated unexpectedly.

Here is a screenshot of the error from the OpenSSH Github project.

Error 1067 is not an error message specific to OpenSSH, but it is a generic error message from the Windows Services subsystem, when the executable for the service exit with an error. You will to find out about the error message from OpenSSH's logs.

OpenSSH has various level of verbosity for its logs. Due to the fact that a server could have hundreds if not thousands of connection attempts per day, logging is either turned off or at a low level of verbosity. Refer to OpenSSH for Windows' logging section for more information on logging configuration.

File Permissions

SSH users in Linux might have come across this error message


Permission denied (publickey).

Often times, the password and public key used is correct, yet the error message still appears. Unfortunately the debug messages from ssh does not indicate one of the cause of this error - the file permission for "~/.ssh" as well as the private key permissions, for example "~/.ssh/id_rsa"

Some SSH files are critical for securing the identity of the client (user) or the server. SSH may refuse to connect, or SSH daemon refuse to start up if the permissions are too open.

User Keys

The sshd manual explains file permissions requirements for the following user key files


~/.ssh/
    This directory is the default location for all user-specific configuration and authentication information. There is no general requirement to keep the entire contents of this directory secret, but the recommended permissions are read/write/execute for the user, and not accessible by others.



~/.ssh/authorized_keys
    Lists the public keys (DSA, ECDSA, Ed25519, RSA) that can be used for logging in as this user. The format of this file is described above. The content of the file is not highly sensitive, but the recommended permissions are read/write for the user, and not accessible by others.

    If this file, the ~/.ssh directory, or the user's home directory are writable by other users, then the file could be modified or replaced by unauthorized users. In this case, sshd will not allow it to be used unless the StrictModes option has been set to “no”.

Server Host Key

The SSH daemon also has host keys that uniquely and securely identifies the server. If the server is rebuilt or physically swapped, this is when you will see the remote host identification warning




@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@    WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED!     @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY!
Someone could be eavesdropping on you right now (man-in-the-middle attack)!
It is also possible that a host key has just been changed.
The fingerprint for the RSA key sent by the remote host is
51:82:00:1c:7e:6f:ac:ac:de:f1:53:08:1c:7d:55:68.
Please contact your system administrator.
Add correct host key in /home/hanxuel/.ssh/known_hosts to get rid of this message.
Offending RSA key in /home/hanxuel/.ssh/known_hosts:12
RSA host key for 10.1.16.158 has changed and you have requested strict checking.
Host key verification failed.

The host key is critical for the SSH server's security!

On UNIX-like operating systems, the host key files need to be owned and readable by root only. From the sshd manual:




/etc/ssh/ssh_host_ecdsa_key

/etc/ssh/ssh_host_ed25519_key

/etc/ssh/ssh_host_rsa_key

    These files contain the private parts of the host keys. These files should only be owned by root, readable only by root, and not accessible to others. Note that sshd does not start if these files are group/world-accessible.



/etc/ssh/ssh_host_ecdsa_key.pub

/etc/ssh/ssh_host_ed25519_key.pub    

/etc/ssh/ssh_host_rsa_key.pub

    These files contain the public parts of the host keys. These files should be world-readable but writable only by root. Their contents should match the respective private parts. These files are not really used for anything; they are provided for the convenience of the user so their contents can be copied to known hosts files. These files are created using ssh-keygen(1).

Fixing OpenSSH Windows File Permissions

How does the UNIX permissions map to Windows permission? This is where Windows permissions gets a bit tricky:

UNIX root user generally maps to the System account and Administrator Group
UNIX root also maps to Administrators and members of Administrator Group
But when you log on to Windows, even if you are in Administrator Group, you do not have elevated permissions - you are a regular user
There is files/folders permission inheritance, where unexpected users and groups have access

This Wiki article from OpenSSH for Windows Github project explains in more detail.

File permission problems for OpenSSH on Windows is common enough that the project released two PowerShell scripts to check and fix file permissions:

FixUserFilePermissions.ps1
FixHostFilePermissions.ps1

Fix User Permissions

This script will fix errors when you are using ssh.exe to connect to a remote server. Generally speaking, they do not affect the sshd.exe daemon.

Running the script will fix the permissions of any private key found in your %USERPROFILE%\.ssh directory

PS C:\Windows\OpenSSH> .\FixUserFilePermissions.ps1
[*] C:\Users\hanxuel\.ssh\id_rsa
      looks good

[*] C:\Users\hanxuel\.ssh\id_rsa.pub
      looks good

   Done.

Fix Server Permissions

The other script will fix errors with the sshd.exe daemon.



PS C:\Windows\OpenSSH> .\FixHostFilePermissions.ps1
  [*] C:\ProgramData\ssh\sshd_config

Need to remove the inheritance before repair the rules.
Shall I remove the inheritace?
[Y] Yes  [A] Yes to All  [N] No  [L] No to All  [S] Suspend  [?] Help (default is "Y"): y
Inheritance is removed from 'C:\ProgramData\ssh\sshd_config'.

'BUILTIN\Users' should not have access to 'C:\ProgramData\ssh\sshd_config'..
Shall I remove this access?
[Y] Yes  [A] Yes to All  [N] No  [L] No to All  [S] Suspend  [?] Help (default is "Y"): y
'BUILTIN\Users' has no more access to 'C:\ProgramData\ssh\sshd_config'.
      Repaired permissions

  [*] C:\ProgramData\ssh\ssh_host_dsa_key

Current owner: 'CORP\hanxuel'. 'NT AUTHORITY\SYSTEM' should own 'C:\ProgramData\ssh\ssh_host_dsa_key'.
Shall I set the file owner?
[Y] Yes  [A] Yes to All  [N] No  [L] No to All  [S] Suspend  [?] Help (default is "Y"): y

'CORP\hanxuel' should not have access to 'C:\ProgramData\ssh\ssh_host_dsa_key'..
Shall I remove this access?
[Y] Yes  [A] Yes to All  [N] No  [L] No to All  [S] Suspend  [?] Help (default is "Y"): y
'CORP\hanxuel' has no more access to 'C:\ProgramData\ssh\ssh_host_dsa_key'.
      Repaired permissions

  [*] C:\ProgramData\ssh\ssh_host_dsa_key.pub

Current owner: 'CORP\hanxuel'. 'NT AUTHORITY\SYSTEM' should own 'C:\ProgramData\ssh\ssh_host_dsa_key.pub'.
Shall I set the file owner?
[Y] Yes  [A] Yes to All  [N] No  [L] No to All  [S] Suspend  [?] Help (default is "Y"): y

'CORP\hanxuel' has the following access to 'C:\ProgramData\ssh\ssh_host_dsa_key.pub': 'Modify, Synchronize'.
Shall I make it Read only?
[Y] Yes  [A] Yes to All  [N] No  [L] No to All  [S] Suspend  [?] Help (default is "Y"): y
'CORP\hanxuel' now has Read access to 'C:\ProgramData\ssh\ssh_host_dsa_key.pub'.
      Repaired permissions

  [*] C:\ProgramData\ssh\ssh_host_ecdsa_key

Current owner: 'CORP\hanxuel'. 'NT AUTHORITY\SYSTEM' should own 'C:\ProgramData\ssh\ssh_host_ecdsa_key'.
Shall I set the file owner?
[Y] Yes  [A] Yes to All  [N] No  [L] No to All  [S] Suspend  [?] Help (default is "Y"): y

'CORP\hanxuel' should not have access to 'C:\ProgramData\ssh\ssh_host_ecdsa_key'..
Shall I remove this access?
[Y] Yes  [A] Yes to All  [N] No  [L] No to All  [S] Suspend  [?] Help (default is "Y"): y
'CORP\hanxuel' has no more access to 'C:\ProgramData\ssh\ssh_host_ecdsa_key'.
      Repaired permissions

  [*] C:\ProgramData\ssh\ssh_host_ecdsa_key.pub

Current owner: 'CORP\hanxuel'. 'NT AUTHORITY\SYSTEM' should own 'C:\ProgramData\ssh\ssh_host_ecdsa_key.pub'.
Shall I set the file owner?
[Y] Yes  [A] Yes to All  [N] No  [L] No to All  [S] Suspend  [?] Help (default is "Y"): y

'CORP\hanxuel' has the following access to 'C:\ProgramData\ssh\ssh_host_ecdsa_key.pub': 'Modify, Synchronize'.
Shall I make it Read only?
[Y] Yes  [A] Yes to All  [N] No  [L] No to All  [S] Suspend  [?] Help (default is "Y"): y
'CORP\hanxuel' now has Read access to 'C:\ProgramData\ssh\ssh_host_ecdsa_key.pub'.
      Repaired permissions

  [*] C:\ProgramData\ssh\ssh_host_ed25519_key

Current owner: 'CORP\hanxuel'. 'NT AUTHORITY\SYSTEM' should own 'C:\ProgramData\ssh\ssh_host_ed25519_key'.
Shall I set the file owner?
[Y] Yes  [A] Yes to All  [N] No  [L] No to All  [S] Suspend  [?] Help (default is "Y"): y

'CORP\hanxuel' should not have access to 'C:\ProgramData\ssh\ssh_host_ed25519_key'..
Shall I remove this access?
[Y] Yes  [A] Yes to All  [N] No  [L] No to All  [S] Suspend  [?] Help (default is "Y"): y
'CORP\hanxuel' has no more access to 'C:\ProgramData\ssh\ssh_host_ed25519_key'.
      Repaired permissions

  [*] C:\ProgramData\ssh\ssh_host_ed25519_key.pub

Current owner: 'CORP\hanxuel'. 'NT AUTHORITY\SYSTEM' should own 'C:\ProgramData\ssh\ssh_host_ed25519_key.pub'.
Shall I set the file owner?
[Y] Yes  [A] Yes to All  [N] No  [L] No to All  [S] Suspend  [?] Help (default is "Y"): y

'CORP\hanxuel' has the following access to 'C:\ProgramData\ssh\ssh_host_ed25519_key.pub': 'Modify, Synchronize'.
Shall I make it Read only?
[Y] Yes  [A] Yes to All  [N] No  [L] No to All  [S] Suspend  [?] Help (default is "Y"): y
'CORP\hanxuel' now has Read access to 'C:\ProgramData\ssh\ssh_host_ed25519_key.pub'.
      Repaired permissions

  [*] C:\ProgramData\ssh\ssh_host_rsa_key

Current owner: 'CORP\hanxuel'. 'NT AUTHORITY\SYSTEM' should own 'C:\ProgramData\ssh\ssh_host_rsa_key'.
Shall I set the file owner?
[Y] Yes  [A] Yes to All  [N] No  [L] No to All  [S] Suspend  [?] Help (default is "Y"): y

'CORP\hanxuel' should not have access to 'C:\ProgramData\ssh\ssh_host_rsa_key'..
Shall I remove this access?
[Y] Yes  [A] Yes to All  [N] No  [L] No to All  [S] Suspend  [?] Help (default is "Y"): y
'CORP\hanxuel' has no more access to 'C:\ProgramData\ssh\ssh_host_rsa_key'.
      Repaired permissions

  [*] C:\ProgramData\ssh\ssh_host_rsa_key.pub

Current owner: 'CORP\hanxuel'. 'NT AUTHORITY\SYSTEM' should own 'C:\ProgramData\ssh\ssh_host_rsa_key.pub'.
Shall I set the file owner?
[Y] Yes  [A] Yes to All  [N] No  [L] No to All  [S] Suspend  [?] Help (default is "Y"): y

'CORP\hanxuel' has the following access to 'C:\ProgramData\ssh\ssh_host_rsa_key.pub': 'Modify, Synchronize'.
Shall I make it Read only?
[Y] Yes  [A] Yes to All  [N] No  [L] No to All  [S] Suspend  [?] Help (default is "Y"): y
'CORP\hanxuel' now has Read access to 'C:\ProgramData\ssh\ssh_host_rsa_key.pub'.
      Repaired permissions

  [*] C:\Users\hanxuel\.ssh\authorized_keys
      looks good

   Done.

Try restarting the OpenSSH Windows service again and it should now start up correctly.

Docker Desktop: no matching manifest for windows/amd64

2020-02-26T19:50:00.002+08:00

I was using Docker Desktop for Windows and building a Docker image based on Ubuntu 18.04 when I got this error:


λ docker build --no-cache --build-arg "host_uid=$(id -u)" --build-arg "host_gid=$(id -g)" --tag "my-image:latest" .
Sending build context to Docker daemon  3.072kB
Step 1/17 : FROM ubuntu:18.04
18.04: Pulling from library/ubuntu
no matching manifest for windows/amd64 10.0.17134 in the manifest list entries

The content of the Dockerfile is irrelevant. Docker could not pull the Ubuntu 18.04 image. Here is the full Dockerfile content anyway:


FROM ubuntu:18.04
RUN apt-get update && apt-get -y install gawk wget git-core \
    diffstat unzip texinfo gcc-multilib build-essential \
    chrpath socat cpio python python3 python3-pip \
    python3-pexpect xz-utils debianutils iputils-ping \
    libsdl1.2-dev xterm tar locales
RUN rm /bin/sh && ln -s bash /bin/sh
RUN locale-gen en_US.UTF-8 && update-locale LC_ALL=en_US.UTF-8 \
    LANG=en_US.UTF-8
ENV LANG en_US.UTF-8
ENV LC_ALL en_US.UTF-8
ENV USER_NAME cuteradio
ENV PROJECT cuteradio

ARG host_uid=1001
ARG host_gid=1001
RUN groupadd -g $host_gid $USER_NAME && \
    useradd -g $host_gid -m -s /bin/bash -u $host_uid $USER_NAME
USER $USER_NAME

ENV BUILD_INPUT_DIR /home/$USER_NAME/yocto/input
ENV BUILD_OUTPUT_DIR /home/$USER_NAME/yocto/output
RUN mkdir -p $BUILD_INPUT_DIR $BUILD_OUTPUT_DIR && \
    cd $BUILD_INPUT_DIR && \
    git clone --recurse-submodules https://github.com/bstubert/$PROJECT.git
ENV TEMPLATECONF=$BUILD_INPUT_DIR/$PROJECT/sources/meta-$PROJECT/custom
CMD ["source", "$BUILD_INPUT_DIR/$PROJECT/sources/poky/oe-init-build-env", \
    "build", "&&", "bitbake", "$PROJECT-image"]

Linux Containers vs Windows Containers

Turns out the default setting for Docker Desktop for Windows is to use Windows container. Having re-installed my laptop from scratch and re-install Docker Desktop, I did not notice that Windows container is being used.

The Docker documentation should be clear enough, otherwise refer to Microsoft's documentation on Windows containers.

In most cases, you should be using Linux Containers even on Windows.

Use Windows containers only when you need the functionalities that is otherwise not available on Linux containers. For example, building Windows Server containers, or running .NET Docker images that has dependencies to run on Windows Containers.

On the flip side:

Most Docker images are built on Linux hosts, and upon Linux images
Docker Linux images use features in Linux containers not available on Windows containers
Some advanced networking and filesystem features only available on Linux containers

The idea of using Docker is to have simple-to-replicate environment. Most development environment uses Ubuntu, Redhat Enterprise Linux or CentOS hosts, and uses Ubuntu Linux images. Stay with the most common denominators to avoid configuration mismatch and dependency errors.

Switch to Linux Containers

When Docker Desktop is up and running, right-click on the Docker icon in the Notification Area, and click on "Switch to Linux containers..."

You will see a warning Window. Click on Switch to proceed

After Docker Desktop has switched to Linux Container, try running your docker command again


λ docker build --no-cache --build-arg "host_uid=$(id -u)" --build-arg "host_gid=$(id -g)" --tag "my-image:latest" .
Sending build context to Docker daemon  3.072kB
Step 1/17 : FROM ubuntu:18.04
18.04: Pulling from library/ubuntu
423ae2b273f4: Pull complete
de83a2304fa1: Pull complete
f9a83bce3af0: Pull complete
b6b53be908de: Pull complete
Digest: sha256:04d48df82c938587820d7b6006f5071dbbffceb7ca01d2814f81857c631d44df
Status: Downloaded newer image for ubuntu:18.04

Your Linux-based Docker image should be able to run now on Docker Desktop for Windows.

How to install libjasper-dev on Ubuntu 18 and above

2020-02-13T21:58:00.003+08:00

This is a commonly seen error when running OpenCV on Ubuntu Bionic 18.04


ImportError: libjasper.so.1: cannot open shared object file: No such file or directory

When you Google the error message, the most common solution given is to install libjasper-dev. Unfortunately, libjasper-dev is not available on Ubuntu Bionic


$ apt-cache search libjasper
libjasperreports-java - Java reporting generator library

Background

libjasper-dev was available on Ubuntu Xenial 16.04, so why has it been removed? Jasper was intentionally removed from Ubuntu and Debian from this Debian bug report.

------------------- Reason -------------------
RoQA; dead upstrem, replaced by openjpeg
----------------------------------------------

Some further explanation on the bug report

Due to lack of time, I'm looking for a new maintainer for this package. There was no upstream release since 2007. Although you can contact the original author, he doesn't seem to be actively working on jasper releases. There are alternative libraries in Debian, and maybe jasper should be completely replaced by other libraries since there were several security bugs in Debian due to jasper upstream code, and it's hard to work on them without upstream.

At the time of the bug report, there was no update to Jasper for 9 years. The Debian maintainer of the package decided to remove this package.

Ubuntu is built on top of Debian, therefore Jasper has been unavailable in Ubuntu since 17.04.

Jasper is still a needed dependency for OpenCV. Here are the options.

OpenCV's bundled Jasper

3rd-party dependency build issues is common enough that OpenCV bundles most dependencies, including Jasper. Use the bundled version of Jasper 1.900.1 with the CMake flag WITH_JASPER.

Here is an example


cd opencv-3.4.9/
mkdir build
cd build/
cmake -DWITH_JASPER=ON ..

cmake will report the build options once it has completed building. You should be able to see that the JPEG_2000 feature is enabled with version 1.900.1


--   OpenCV modules:
--     To be built:                 calib3d core dnn features2d flann highgui imgcodecs imgproc ml objdetect photo shape stitching superres ts video videoio videostab
--     Disabled:                    world
--     Disabled by dependency:      -
--     Unavailable:                 cudaarithm cudabgsegm cudacodec cudafeatures2d cudafilters cudaimgproc cudalegacy cudaobjdetect cudaoptflow cudastereo cudawarping cudev java js python2 python3 viz
--     Applications:                tests perf_tests apps
--     Documentation:               NO
--     Non-free algorithms:         NO
--
--   GUI:
--     GTK+:                        NO
--     VTK support:                 NO
--
--   Media I/O:
--     ZLib:                        /usr/lib/x86_64-linux-gnu/libz.so (ver 1.2.11)
--     JPEG:                        libjpeg-turbo (ver 2.0.2-62)
--     WEBP:                        build (ver encoder: 0x020e)
--     PNG:                         build (ver 1.6.37)
--     TIFF:                        build (ver 42 - 4.0.10)
--     JPEG 2000:                   build (ver 1.900.1)
--     OpenEXR:                     build (ver 2.3.0)
--     HDR:                         YES
--     SUNRASTER:                   YES
--     PXM:                         YES
--
--   Video I/O:
--     DC1394:                      NO
--     FFMPEG:                      NO
--       avcodec:                   NO
--       avformat:                  NO
--       avutil:                    NO
--       swscale:                   NO
--       avresample:                NO
--     GStreamer:                   NO
--     libv4l/libv4l2:              NO
--     v4l/v4l2:                    linux/videodev2.h

If this version of Jasper is too old, you can use your own Jasper.

Compile Jasper from Source

Since Jasper is an open source project and is available on Github, you can download the latest release and compile it.


wget https://github.com/mdadams/jasper/archive/version-2.0.16.tar.gz -O jasper-version-2.0.16.tar.gz
tar xvf cd jasper-version-2.0.16.tar.gz
cd jasper-version-2.0.16/

Let's first install all the required build tools


 sudo apt-get install build-essential cmake

Now we can start building jasper


mkdir build 
export SOURCE_DIR=~/jasper-version-2.0.16
export BUILD_DIR=~/jasper-version-2.0.16/build
cd $BUILD_DIR
cmake -G "Unix Makefiles" -H$SOURCE_DIR -B$BUILD_DIR
cd $BUILD_DIR
make clean all
make test

The binaries are now built here


~/jasper-version-2.0.16/build$ ls src/appl/
CMakeFiles           CTestTestfile.cmake  imginfo  jiv
cmake_install.cmake  imgcmp               jasper   Makefile

The libraries are available at


$ ls src/libjasper/CMakeFiles           include         libjasper.so.4.0.0
cmake_install.cmake  libjasper.so    Makefile
CTestTestfile.cmake  libjasper.so.4

Note that if you want to install all the files into Ubuntu's standard path, you will need to have root or sudo permission. This is not recommended, as those files are installed without going through Ubuntu's package manager (apt / apt-get / aptitude), and you risk losing track of what applications and which versions have been installed. But if you are sure you know what you are doing


sudo make install

libjasper-dev from Ubuntu Xenial

Another alternative is to install libjasper-dev from an older release of Ubuntu, libjasper-dev 1.900.1 from Ubuntu Xenial 16.04.

Add the Xenial repository


echo “deb http://security.ubuntu.com/ubuntu xenial-security main” | sudo tee /etc/apt/sources.list.d/xenial.list

Install Jasper


sudo apt update
sudo apt install libjasper1 libjasper-dev

After installation of Jasper, remember to remove the Xenial repository to prevent conflicts and errors


sudo rm /etc/apt/sources.list.d/xenial.list
sudo apt update

Note that this version of Jasper is very old, 1.900 released before 2016.

How to check SSH configuration before restarting sshd

2020-01-06T21:55:00.001+08:00

Have you had the experience of changing your /etc/ssh/sshd_config settings, restart sshd and found that you are no longer able to connect to your remote host? This is especially frustrating when you have no remote console access to the machine.

Always check your sshd_config settings before restarting the ssh daemon!

Having experienced that before with a cloud VM where I was left with no choice but to terminate that instance, I wish to avoid that experience.

Test sshd_config

The sshd command has the -t flag that will check your configuration file for any errors. Here is an example:


$ sudo /usr/sbin/sshd -t
/etc/ssh/sshd_config line 89: unsupported option "yup".

The sshd helpfully tells us the problem is in line 89. When we take a look at line 89:


GatewayPorts yup

the mistake is obvious. Change yup to yes


GatewayPorts yes

Just to be sure, let's test the configuration again.


$ sudo /usr/sbin/sshd -t
$

Perfect! We can be assured that there isn't any mis-configuration that will prevent sshd from starting.

The example above might not be the best. There are integer values that could be mistaken for Boolean option or vice-version. For example, setting MaxSessions yes instead of MaxSessions 20. That will cause sshd to fail to start.

Restart sshd

Restart the SSH daemon


$ sudo systemctl restart ssh
$

There, the daemon is restarted with changes applied.

Existing SSH Connection

Note that re-starting ssh daemon will not disconnect existing ssh connections. Technically you can safely change the sshd_config file, restart sshd. If sshd fails to start up, use the existing SSH connection to revert changes to sshd_config.

Why take the risk when you can use the -t flag?

How to upload and download files using sftp in a single command

2020-01-02T14:30:00.000+08:00

Usually we log in to an SFTP server, and then upload a file:


$ sftp username@sftpserver
username@sftpserver's password:
Connected to sftpserver.
sftp> put file.tar.gz

Likewise, you first need to log in to the SFTP server, cd to the directory of the file location and download


$ sftp username@sftpserver
hanxuel@ezmovexhd's password:
Connected to ezmovexhd.
sftp> cd pub
sftp> get file.tar.gz

Single Command Upload

You can combine log on and upload with this command:


$ sftp username@sftpserver:/ <<<  $'put file.tar.gz'
username@sftpserver's password:
Connected to sftpserver.
Changing to: /
Uploading file.tar.gz to /put file.tar.gz
put file.tar.gz                                                 100%   64MB   9.1MB/s   00:07

Single Command Download

Likewise, you can combine login and download to a single command


$ sftp username@sftpserver:/file.tar.gz file.tar.gz
Connected to sftpserver.
Fetching /file.tar.gz to file.tar.gz
/file.tar.gz 100% 64MB 45.2MB/s 00:01

Passwordless Login

SFTP is built upon SSH. Therefore, you can use SSH public key authentication instead of typing in your password.


ssh-keygen
ssh-copy-id -i username@sftpserver

Ubuntu Bionic: Downgrade from GCC 7 to 4

2019-12-30T18:30:00.000+08:00

I wrote about installing GCC 7.x and setting the default version of GCC to 7.x on Ubuntu Bionic 18.04. What if you need to chanage the default version of GCC back to 4.x?

Install GCC Toolchain 4.8

Ubuntu Bionic's default version of GCC is 7.4.0.


hanxuel@xcdl190201 ~$ apt show gcc
Package: gcc
Version: 4:5.3.1-1ubuntu1
Priority: optional
Section: devel
Source: gcc-defaults (1.150ubuntu1)
Origin: Ubuntu
Maintainer: Ubuntu Developers <ubuntu-devel-discuss@lists.ubuntu.com>
Original-Maintainer: Debian GCC Maintainers <debian-gcc@lists.debian.org>
Bugs: https://bugs.launchpad.net/ubuntu/+filebug
Installed-Size: 45.1 kB
Provides: c-compiler
Depends: cpp (>= 4:5.3.1-1ubuntu1), gcc-5 (>= 5.3.1-3~)
Recommends: libc6-dev | libc-dev
Suggests: gcc-multilib, make, manpages-dev, autoconf, automake, libtool, flex, bison, gdb, gcc-doc
Conflicts: gcc-doc (<< 1:2.95.3)
Task: ubuntu-desktop, ubuntu-usb, kubuntu-desktop, kubuntu-full, edubuntu-desktop, edubuntu-usb, xubuntu-core, xubuntu-desktop, mythbuntu-frontend, mythbuntu-desktop, mythbuntu-backend-slave, mythbuntu-backend-master, ubuntustudio-desktop-core, ubuntustudio-desktop, ubuntu-gnome-desktop, ubuntukylin-desktop
Build-Essential: yes
Supported: 5y
Download-Size: 5,244 B
APT-Manual-Installed: yes
APT-Sources: http://xcd-engyum.xilinx.com/ubuntu160405 xenial/main amd64 Packages
Description: GNU C compiler
 This is the GNU C compiler, a fairly portable optimizing compiler for C.
 .
 This is a dependency package providing the default GNU C compiler.

For GCC 4.x series, GCC 4.8.5 is available.

You will need to install the following packages:

gcc-4.8
g++-4.8
libgcc-4.8-dev
gcc-4.8-multilib
gcc-ar-4.8
gcc-nm-4.8

Basically


$ sudo apt-get install  gcc-4.8g++-4.8 libgcc-4.8-dev gcc-4.8-multilib gcc-ar-4.8 gcc-nm-4.8

Next, we will be practically undoing what we have done in the previous article. Setting the default version of GCC to 4.8

Set Default GCC Version


sudo update-alternatives \

     --install /usr/bin/gcc gcc /usr/bin/gcc-4.8 60 \
     --slave /usr/bin/g++ g++ /usr/bin/g++-4.8 \
     --slave /usr/bin/gcc-ar gcc-ar /usr/bin/gcc-ar-4.8 \
     --slave /usr/bin/gcc-nm gcc-nm /usr/bin/gcc-nm-4.8 \
     --slave /usr/bin/gcc-ranlib gcc-ranlib /usr/bin/gcc-ranlib-4.8

Check GCC version again


$ gcc --version<
gcc (Ubuntu 4.8.5-4ubuntu8) 4.8.5
Copyright (C) 2015 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

Ansible : Depends: python-httplib2 but it is not going to be installed

2019-12-27T21:36:00.000+08:00

While trying to install Ansible from the official PPA on Ubuntu 18.04, I got this error


$ sudo apt-get install ansible
sudo: start_tls specified but LDAP libs do not support ldap_start_tls_s() or ldap_start_tls_s_np()
Reading package lists... Done
Building dependency tree
Reading state information... Done
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

The following packages have unmet dependencies:
 ansible : Depends: python-httplib2 but it is not going to be installed
E: Unable to correct problems, you have held broken packages.

Apt Fix Broken

First, try the -f or --fix-broken option


$ sudo apt-get install -f
sudo: start_tls specified but LDAP libs do not support ldap_start_tls_s() or ldap_start_tls_s_np()
Reading package lists... Done
Building dependency tree
Reading state information... Done
0 upgraded, 0 newly installed, 0 to remove and 5 not upgraded.

Nope, nothing is truly broken.

Packages on Hold

The initial apt command reports "you have held broken packages". Let's see what are the packages that are being held. You can use dpkg --get-selections


$ dpkg --get-selections | grep hold

or dpkg -l


$ dpkg -l | grep "^hi"

or apt-mark


$ apt-mark showhold

There are no packages held in the scenario that I am facing.

Show Up-gradable Packages

Before changing anything further, it is worth getting all packages upgraded. Use aptitude


$ aptitude -F%p --disable-columns search ~U
cuda-nvjpeg-10-0
cuda-nvjpeg-dev-10-0
libvdpau1
libvulkan1
vdpau-driver-all

or apt-check


$ /usr/lib/update-notifier/apt-check -p; echo
libvulkan1
cuda-nvjpeg-10-0
libvdpau1
cuda-nvjpeg-dev-10-0
vdpau-driver-all

Let's upgrade them


$ sudo apt upgrade cuda-nvjpeg-10-0 cuda-nvjpeg-dev-10-0 libvdpau1 libvulkan1 vdpau-driver-all
Reading package lists... Done
Building dependency tree
Reading state information... Done
Calculating upgrade... Done
The following packages will be upgraded:
  cuda-nvjpeg-10-0 cuda-nvjpeg-dev-10-0 libvdpau1 libvulkan1 vdpau-driver-all
5 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
Need to get 139 kB/2,527 kB of archives.
After this operation, 7,001 kB of additional disk space will be used.
Do you want to continue? [Y/n] y
Get:1 file:/var/cuda-repo-10-0-local-nvjpeg-update-1  cuda-nvjpeg-10-0 10.0.130.1-1 [1,302 kB]
Get:2 file:/var/cuda-repo-10-0-local-nvjpeg-update-1  cuda-nvjpeg-dev-10-0 10.0.130.1-1 [1,086 kB]
Get:3 http://ppa.launchpad.net/graphics-drivers/ppa/ubuntu bionic/main amd64 libvdpau1 amd64 1.3-0ubuntu0~gpu18.04.2 [29.3 kB]
Get:4 http://ppa.launchpad.net/graphics-drivers/ppa/ubuntu bionic/main amd64 libvulkan1 amd64 1.1.126.0-2~gpu18.04.1 [101 kB]
Get:5 http://ppa.launchpad.net/graphics-drivers/ppa/ubuntu bionic/main amd64 vdpau-driver-all amd64 1.3-0ubuntu0~gpu18.04.2 [8,392 B]
Fetched 139 kB in 5s (27.5 kB/s)
(Reading database ... 254639 files and directories currently installed.)
Preparing to unpack .../cuda-nvjpeg-10-0_10.0.130.1-1_amd64.deb ...
Unpacking cuda-nvjpeg-10-0 (10.0.130.1-1) over (10.0.130-1) ...
Preparing to unpack .../cuda-nvjpeg-dev-10-0_10.0.130.1-1_amd64.deb ...
Unpacking cuda-nvjpeg-dev-10-0 (10.0.130.1-1) over (10.0.130-1) ...
Preparing to unpack .../libvdpau1_1.3-0ubuntu0~gpu18.04.2_amd64.deb ...
Unpacking libvdpau1:amd64 (1.3-0ubuntu0~gpu18.04.2) over (1.1.1-3ubuntu1) ...
Preparing to unpack .../libvulkan1_1.1.126.0-2~gpu18.04.1_amd64.deb ...
Unpacking libvulkan1:amd64 (1.1.126.0-2~gpu18.04.1) over (1.1.70+dfsg1-1) ...
Preparing to unpack .../vdpau-driver-all_1.3-0ubuntu0~gpu18.04.2_amd64.deb ...
Unpacking vdpau-driver-all:amd64 (1.3-0ubuntu0~gpu18.04.2) over (1.1.1-3ubuntu1) ...
Setting up vdpau-driver-all:amd64 (1.3-0ubuntu0~gpu18.04.2) ...
Setting up libvulkan1:amd64 (1.1.126.0-2~gpu18.04.1) ...
Setting up cuda-nvjpeg-10-0 (10.0.130.1-1) ...
Setting up cuda-nvjpeg-dev-10-0 (10.0.130.1-1) ...
Setting up libvdpau1:amd64 (1.3-0ubuntu0~gpu18.04.2) ...
Processing triggers for libc-bin (2.27-3ubuntu1) ...

Use Aptitude

Upgrading all packages did not solve the problem. Let's use Aptitude to install the package


e$ sudo aptitude install ansible
sudo: start_tls specified but LDAP libs do not support ldap_start_tls_s() or ldap_start_tls_s_np()
The following NEW packages will be installed:
  ansible python-asn1crypto{a} python-cffi-backend{a} python-crypto{a}
  python-cryptography{a} python-enum34{a} python-httplib2{a} python-idna{a}
  python-ipaddress{a} python-jinja2{a} python-markupsafe{a}
  python-paramiko{a} python-pkg-resources{a} python-setuptools{a}
  python-six{a} python-yaml{a} sshpass{a}
0 packages upgraded, 17 newly installed, 0 to remove and 5 not upgraded.
Need to get 7,310 kB of archives. After unpacking 66.0 MB will be used.
The following packages have unmet dependencies:
 libssl1.1 : Breaks: python-httplib2 (<= 0.9.2+dfsg-1) but 0.9.2+dfsg-1 is to be installed
The following actions will resolve these dependencies:

     Keep the following packages at their current version:
1)     ansible [Not Installed]
2)     python-httplib2 [Not Installed]



Accept this solution? [Y/n/q/?]

Ah, now we can see what is the problem. " libssl1.1" needs a lower version of "python-httplib2". The default option given by Aptitude will not install anything. Let's answer "n" and see what is the next option that Aptitude offers.


      Downgrade the following packages:
1)      curl [7.58.0-2ubuntu3.8 (now) -> 7.58.0-2ubuntu3.1 (bionic-updates)]
2)      libcurl4 [7.58.0-2ubuntu3.8 (now) -> 7.58.0-2ubuntu3.1 (bionic-updates)]
3)      libio-socket-ssl-perl [2.060-3~ubuntu18.04.1 (now) -> 2.056-1 (bionic)]
4)      libmysqlclient20 [5.7.28-0ubuntu0.18.04.4 (now) -> 5.7.22-0ubuntu18.04.1
5)      libnet-ssleay-perl [1.84-1ubuntu0.2 (now) -> 1.84-1build1 (bionic)]
6)      libpython3.6 [3.6.8-1~18.04.3 (now) -> 3.6.5-3 (bionic)]
7)      libpython3.6-minimal [3.6.8-1~18.04.3 (now) -> 3.6.5-3 (bionic)]
8)      libpython3.6-stdlib [3.6.8-1~18.04.3 (now) -> 3.6.5-3 (bionic)]
9)      libruby2.5 [2.5.1-1ubuntu1.6 (now) -> 2.5.1-1ubuntu1 (bionic)]
10)     libssl1.1 [1.1.1-1ubuntu2.1~18.04.5 (now) -> 1.1.0g-2ubuntu4 (bionic)]
11)     mysql-client-core-5.7 [5.7.28-0ubuntu0.18.04.4 (now) -> 5.7.22-0ubuntu18
12)     mysql-server-core-5.7 [5.7.28-0ubuntu0.18.04.4 (now) -> 5.7.22-0ubuntu18
13)     openssl [1.1.1-1ubuntu2.1~18.04.5 (now) -> 1.1.0g-2ubuntu4 (bionic)]
14)     python3-cryptography [2.1.4-1ubuntu1.3 (now) -> 2.1.4-1ubuntu1.1 (bionic
15)     python3.6 [3.6.8-1~18.04.3 (now) -> 3.6.5-3 (bionic)]
16)     python3.6-minimal [3.6.8-1~18.04.3 (now) -> 3.6.5-3 (bionic)]



Accept this solution? [Y/n/q/?] Y

Aptitude is proposing we downgrade 16 packages. The biggest impact which are:

Python 3.6.8 -> 3.6.5
MySQL 5.7.28 -> 5.7.22
OpenSSL 1.1.1 -> 1.1.0

Due to the specific dependency of Ansible to a version of python-httplib2 that in turn depends on Python 3.6.5, we need to downgrade a few Ubuntu 18.04 packages. I think those are acceptable.

Let's proceed with the install...


The following packages will be DOWNGRADED:
  curl libcurl4 libio-socket-ssl-perl libmysqlclient20 libnet-ssleay-perl
  libpython3.6 libpython3.6-minimal libpython3.6-stdlib libruby2.5
  libssl1.1 mysql-client-core-5.7 mysql-server-core-5.7 openssl
  python3-cryptography python3.6 python3.6-minimal
The following NEW packages will be installed:
  ansible python-asn1crypto{a} python-cffi-backend{a} python-crypto{a}
  python-cryptography{a} python-enum34{a} python-httplib2{a} python-idna{a}
  python-ipaddress{a} python-jinja2{a} python-markupsafe{a}
  python-paramiko{a} python-pkg-resources{a} python-setuptools{a}
  python-six{a} python-yaml{a} sshpass{a}
0 packages upgraded, 17 newly installed, 16 downgraded, 0 to remove and 0 not upgraded.
Need to get 33.9 MB of archives. After unpacking 68.2 MB will be used.
Do you want to continue? [Y/n/?] y
Get: 1 http://ppa.launchpad.net/ansible/ansible/ubuntu bionic/main amd64 ansible all 2.9.2-1ppa~bionic [5,778 kB]
Get: 2 http://aptmirror.corp.com/ubuntu180401 bionic/main amd64 libpython3.6 amd64 3.6.5-3 [1,448 kB]
Get: 3 http://aptmirror.corp.com/ubuntu180401 bionic-updates/main amd64 mysql-client-core-5.7 amd64 5.7.22-0ubuntu18.04.1 [6,979 kB]
Get: 4 http://aptmirror.corp.com/ubuntu180401 bionic-updates/main amd64 libmysqlclient20 amd64 5.7.22-0ubuntu18.04.1 [815 kB]
Get: 5 http://aptmirror.corp.com/ubuntu180401 bionic/main amd64 openssl amd64 1.1.0g-2ubuntu4 [532 kB]
Get: 6 http://aptmirror.corp.com/ubuntu180401 bionic/main amd64 libio-socket-ssl-perl all 2.056-1 [172 kB]
Get: 7 http://aptmirror.corp.com/ubuntu180401 bionic/main amd64 libnet-ssleay-perl amd64 1.84-1build1 [282 kB]
Get: 8 http://aptmirror.corp.com/ubuntu180401 bionic-updates/main amd64 curl amd64 7.58.0-2ubuntu3.1 [159 kB]
Get: 9 http://aptmirror.corp.com/ubuntu180401 bionic-updates/main amd64 libcurl4 amd64 7.58.0-2ubuntu3.1 [214 kB]
Get: 10 http://aptmirror.corp.com/ubuntu180401 bionic-updates/main amd64 mysql-server-core-5.7 amd64 5.7.22-0ubuntu18.04.1 [7,764 kB]
Get: 11 http://aptmirror.corp.com/ubuntu180401 bionic/main amd64 libruby2.5 amd64 2.5.1-1ubuntu1 [3,066 kB]
Get: 12 http://aptmirror.corp.com/ubuntu180401 bionic/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.1 [220 kB]
Get: 13 http://aptmirror.corp.com/ubuntu180401 bionic/main amd64 python3.6 amd64 3.6.5-3 [186 kB]
Get: 14 http://aptmirror.corp.com/ubuntu180401 bionic/main amd64 libpython3.6-stdlib amd64 3.6.5-3 [1,648 kB]
Get: 15 http://aptmirror.corp.com/ubuntu180401 bionic/main amd64 python3.6-minimal amd64 3.6.5-3 [1,425 kB]
Get: 16 http://aptmirror.corp.com/ubuntu180401 bionic/main amd64 libpython3.6-minimal amd64 3.6.5-3 [529 kB]
Get: 17 http://aptmirror.corp.com/ubuntu180401 bionic/main amd64 libssl1.1 amd64 1.1.0g-2ubuntu4 [1,128 kB]
Get: 18 http://aptmirror.corp.com/ubuntu180401 bionic/main amd64 python-markupsafe amd64 1.0-1build1 [13.0 kB]
Get: 19 http://aptmirror.corp.com/ubuntu180401 bionic/main amd64 python-jinja2 all 2.10-1 [94.6 kB]
Get: 20 http://aptmirror.corp.com/ubuntu180401 bionic/main amd64 python-yaml amd64 3.12-1build2 [115 kB]
Get: 21 http://aptmirror.corp.com/ubuntu180401 bionic/main amd64 python-asn1crypto all 0.24.0-1 [72.7 kB]
Get: 22 http://aptmirror.corp.com/ubuntu180401 bionic/main amd64 python-cffi-backend amd64 1.11.5-1 [63.4 kB]
Get: 23 http://aptmirror.corp.com/ubuntu180401 bionic/main amd64 python-enum34 all 1.1.6-2 [34.8 kB]
Get: 24 http://aptmirror.corp.com/ubuntu180401 bionic/main amd64 python-idna all 2.6-1 [32.4 kB]
Get: 25 http://aptmirror.corp.com/ubuntu180401 bionic/main amd64 python-ipaddress all 1.0.17-1 [18.2 kB]
Get: 26 http://aptmirror.corp.com/ubuntu180401 bionic/main amd64 python-six all 1.11.0-2 [11.3 kB]
Get: 27 http://aptmirror.corp.com/ubuntu180401 bionic/main amd64 python-cryptography amd64 2.1.4-1ubuntu1.1 [220 kB]
Get: 28 http://aptmirror.corp.com/ubuntu180401 bionic/main amd64 python-paramiko all 2.0.0-1ubuntu1 [110 kB]
Get: 29 http://aptmirror.corp.com/ubuntu180401 bionic/main amd64 python-httplib2 all 0.9.2+dfsg-1 [34.6 kB]
Get: 30 http://aptmirror.corp.com/ubuntu180401 bionic/main amd64 python-crypto amd64 2.6.1-8ubuntu2 [244 kB]
Get: 31 http://aptmirror.corp.com/ubuntu180401 bionic/main amd64 python-pkg-resources all 39.0.1-2 [128 kB]
Get: 32 http://aptmirror.corp.com/ubuntu180401 bionic/main amd64 python-setuptools all 39.0.1-2 [329 kB]
Get: 33 http://aptmirror.corp.com/ubuntu180401 bionic/universe amd64 sshpass amd64 1.06-1 [10.5 kB]
Fetched 33.9 MB in 28s (1,228 kB/s)
Extracting templates from packages: 100%
Preconfiguring packages ...
dpkg: warning: downgrading libpython3.6:amd64 from 3.6.8-1~18.04.3 to 3.6.5-3
(Reading database ... 254644 files and directories currently installed.)
Preparing to unpack .../00-libpython3.6_3.6.5-3_amd64.deb ...
Unpacking libpython3.6:amd64 (3.6.5-3) over (3.6.8-1~18.04.3) ...
dpkg: warning: downgrading mysql-client-core-5.7 from 5.7.28-0ubuntu0.18.04.4 to 5.7.22-0ubuntu18.04.1
Preparing to unpack .../01-mysql-client-core-5.7_5.7.22-0ubuntu18.04.1_amd64.deb ...
Unpacking mysql-client-core-5.7 (5.7.22-0ubuntu18.04.1) over (5.7.28-0ubuntu0.18.04.4) ...
dpkg: warning: downgrading libmysqlclient20:amd64 from 5.7.28-0ubuntu0.18.04.4 to 5.7.22-0ubuntu18.04.1
Preparing to unpack .../02-libmysqlclient20_5.7.22-0ubuntu18.04.1_amd64.deb ...
Unpacking libmysqlclient20:amd64 (5.7.22-0ubuntu18.04.1) over (5.7.28-0ubuntu0.18.04.4) ...
dpkg: warning: downgrading openssl from 1.1.1-1ubuntu2.1~18.04.5 to 1.1.0g-2ubuntu4
Preparing to unpack .../03-openssl_1.1.0g-2ubuntu4_amd64.deb ...
Unpacking openssl (1.1.0g-2ubuntu4) over (1.1.1-1ubuntu2.1~18.04.5) ...
dpkg: warning: downgrading libio-socket-ssl-perl from 2.060-3~ubuntu18.04.1 to 2.056-1
Preparing to unpack .../04-libio-socket-ssl-perl_2.056-1_all.deb ...
Unpacking libio-socket-ssl-perl (2.056-1) over (2.060-3~ubuntu18.04.1) ...
dpkg: warning: downgrading libnet-ssleay-perl from 1.84-1ubuntu0.2 to 1.84-1build1
Preparing to unpack .../05-libnet-ssleay-perl_1.84-1build1_amd64.deb ...
Unpacking libnet-ssleay-perl (1.84-1build1) over (1.84-1ubuntu0.2) ...
dpkg: warning: downgrading curl from 7.58.0-2ubuntu3.8 to 7.58.0-2ubuntu3.1
Preparing to unpack .../06-curl_7.58.0-2ubuntu3.1_amd64.deb ...
Unpacking curl (7.58.0-2ubuntu3.1) over (7.58.0-2ubuntu3.8) ...
dpkg: warning: downgrading libcurl4:amd64 from 7.58.0-2ubuntu3.8 to 7.58.0-2ubuntu3.1
Preparing to unpack .../07-libcurl4_7.58.0-2ubuntu3.1_amd64.deb ...
Unpacking libcurl4:amd64 (7.58.0-2ubuntu3.1) over (7.58.0-2ubuntu3.8) ...
dpkg: warning: downgrading mysql-server-core-5.7 from 5.7.28-0ubuntu0.18.04.4 to 5.7.22-0ubuntu18.04.1
Preparing to unpack .../08-mysql-server-core-5.7_5.7.22-0ubuntu18.04.1_amd64.deb ...
Unpacking mysql-server-core-5.7 (5.7.22-0ubuntu18.04.1) over (5.7.28-0ubuntu0.18.04.4) ...
dpkg: warning: downgrading libruby2.5:amd64 from 2.5.1-1ubuntu1.6 to 2.5.1-1ubuntu1
Preparing to unpack .../09-libruby2.5_2.5.1-1ubuntu1_amd64.deb ...
Unpacking libruby2.5:amd64 (2.5.1-1ubuntu1) over (2.5.1-1ubuntu1.6) ...
dpkg: warning: downgrading python3-cryptography from 2.1.4-1ubuntu1.3 to 2.1.4-1ubuntu1.1
Preparing to unpack .../10-python3-cryptography_2.1.4-1ubuntu1.1_amd64.deb ...
Unpacking python3-cryptography (2.1.4-1ubuntu1.1) over (2.1.4-1ubuntu1.3) ...
dpkg: warning: downgrading python3.6 from 3.6.8-1~18.04.3 to 3.6.5-3
Preparing to unpack .../11-python3.6_3.6.5-3_amd64.deb ...
Unpacking python3.6 (3.6.5-3) over (3.6.8-1~18.04.3) ...
dpkg: warning: downgrading libpython3.6-stdlib:amd64 from 3.6.8-1~18.04.3 to 3.6.5-3
Preparing to unpack .../12-libpython3.6-stdlib_3.6.5-3_amd64.deb ...
Unpacking libpython3.6-stdlib:amd64 (3.6.5-3) over (3.6.8-1~18.04.3) ...
dpkg: warning: downgrading python3.6-minimal from 3.6.8-1~18.04.3 to 3.6.5-3
Preparing to unpack .../13-python3.6-minimal_3.6.5-3_amd64.deb ...
Unpacking python3.6-minimal (3.6.5-3) over (3.6.8-1~18.04.3) ...
dpkg: warning: downgrading libpython3.6-minimal:amd64 from 3.6.8-1~18.04.3 to 3.6.5-3
Preparing to unpack .../14-libpython3.6-minimal_3.6.5-3_amd64.deb ...
Unpacking libpython3.6-minimal:amd64 (3.6.5-3) over (3.6.8-1~18.04.3) ...
dpkg: warning: downgrading libssl1.1:amd64 from 1.1.1-1ubuntu2.1~18.04.5 to 1.1.0g-2ubuntu4
Preparing to unpack .../15-libssl1.1_1.1.0g-2ubuntu4_amd64.deb ...
Unpacking libssl1.1:amd64 (1.1.0g-2ubuntu4) over (1.1.1-1ubuntu2.1~18.04.5) ...
Selecting previously unselected package python-markupsafe.
Preparing to unpack .../16-python-markupsafe_1.0-1build1_amd64.deb ...
Unpacking python-markupsafe (1.0-1build1) ...
Selecting previously unselected package python-jinja2.
Preparing to unpack .../17-python-jinja2_2.10-1_all.deb ...
Unpacking python-jinja2 (2.10-1) ...
Selecting previously unselected package python-yaml.
Preparing to unpack .../18-python-yaml_3.12-1build2_amd64.deb ...
Unpacking python-yaml (3.12-1build2) ...
Selecting previously unselected package python-asn1crypto.
Preparing to unpack .../19-python-asn1crypto_0.24.0-1_all.deb ...
Unpacking python-asn1crypto (0.24.0-1) ...
Selecting previously unselected package python-cffi-backend.
Preparing to unpack .../20-python-cffi-backend_1.11.5-1_amd64.deb ...
Unpacking python-cffi-backend (1.11.5-1) ...
Selecting previously unselected package python-enum34.
Preparing to unpack .../21-python-enum34_1.1.6-2_all.deb ...
Unpacking python-enum34 (1.1.6-2) ...
Selecting previously unselected package python-idna.
Preparing to unpack .../22-python-idna_2.6-1_all.deb ...
Unpacking python-idna (2.6-1) ...
Selecting previously unselected package python-ipaddress.
Preparing to unpack .../23-python-ipaddress_1.0.17-1_all.deb ...
Unpacking python-ipaddress (1.0.17-1) ...
Selecting previously unselected package python-six.
Preparing to unpack .../24-python-six_1.11.0-2_all.deb ...
Unpacking python-six (1.11.0-2) ...
Selecting previously unselected package python-cryptography.
Preparing to unpack .../25-python-cryptography_2.1.4-1ubuntu1.1_amd64.deb ...
Unpacking python-cryptography (2.1.4-1ubuntu1.1) ...
Selecting previously unselected package python-paramiko.
Preparing to unpack .../26-python-paramiko_2.0.0-1ubuntu1_all.deb ...
Unpacking python-paramiko (2.0.0-1ubuntu1) ...
Selecting previously unselected package python-httplib2.
Preparing to unpack .../27-python-httplib2_0.9.2+dfsg-1_all.deb ...
Unpacking python-httplib2 (0.9.2+dfsg-1) ...
Selecting previously unselected package python-crypto.
Preparing to unpack .../28-python-crypto_2.6.1-8ubuntu2_amd64.deb ...
Unpacking python-crypto (2.6.1-8ubuntu2) ...
Selecting previously unselected package python-pkg-resources.
Preparing to unpack .../29-python-pkg-resources_39.0.1-2_all.deb ...
Unpacking python-pkg-resources (39.0.1-2) ...
Selecting previously unselected package python-setuptools.
Preparing to unpack .../30-python-setuptools_39.0.1-2_all.deb ...
Unpacking python-setuptools (39.0.1-2) ...
Selecting previously unselected package sshpass.
Preparing to unpack .../31-sshpass_1.06-1_amd64.deb ...
Unpacking sshpass (1.06-1) ...
Selecting previously unselected package ansible.
Preparing to unpack .../32-ansible_2.9.2-1ppa~bionic_all.deb ...
Unpacking ansible (2.9.2-1ppa~bionic) ...
Setting up python-idna (2.6-1) ...
Setting up python-yaml (3.12-1build2) ...
Setting up python-asn1crypto (0.24.0-1) ...
Setting up python-crypto (2.6.1-8ubuntu2) ...
Processing triggers for mime-support (3.60ubuntu1) ...
Processing triggers for desktop-file-utils (0.23-1ubuntu3.18.04.1) ...
Setting up mysql-server-core-5.7 (5.7.22-0ubuntu18.04.1) ...
Setting up python-pkg-resources (39.0.1-2) ...
Setting up python-markupsafe (1.0-1build1) ...
Setting up python-httplib2 (0.9.2+dfsg-1) ...
Setting up python-cffi-backend (1.11.5-1) ...
Setting up python-six (1.11.0-2) ...
Processing triggers for libc-bin (2.27-3ubuntu1) ...
Setting up sshpass (1.06-1) ...
Setting up libssl1.1:amd64 (1.1.0g-2ubuntu4) ...
Setting up python-enum34 (1.1.6-2) ...
Setting up openssl (1.1.0g-2ubuntu4) ...
Installing new version of config file /etc/ssl/openssl.cnf ...
Processing triggers for man-db (2.8.3-2) ...
Setting up libmysqlclient20:amd64 (5.7.22-0ubuntu18.04.1) ...
Processing triggers for gnome-menus (3.13.3-11ubuntu1) ...
Setting up mysql-client-core-5.7 (5.7.22-0ubuntu18.04.1) ...
Setting up python-ipaddress (1.0.17-1) ...
Setting up python3-cryptography (2.1.4-1ubuntu1.1) ...
Setting up python-setuptools (39.0.1-2) ...
Setting up libruby2.5:amd64 (2.5.1-1ubuntu1) ...
Setting up python-jinja2 (2.10-1) ...
Setting up libnet-ssleay-perl (1.84-1build1) ...
Setting up libcurl4:amd64 (7.58.0-2ubuntu3.1) ...
Setting up libio-socket-ssl-perl (2.056-1) ...
Setting up libpython3.6-minimal:amd64 (3.6.5-3) ...
Setting up python-cryptography (2.1.4-1ubuntu1.1) ...
Setting up libpython3.6-stdlib:amd64 (3.6.5-3) ...
Setting up curl (7.58.0-2ubuntu3.1) ...
Setting up python3.6-minimal (3.6.5-3) ...
Setting up python-paramiko (2.0.0-1ubuntu1) ...
Setting up ansible (2.9.2-1ppa~bionic) ...
Setting up libpython3.6:amd64 (3.6.5-3) ...
Setting up python3.6 (3.6.5-3) ...
Processing triggers for libc-bin (2.27-3ubuntu1) ...

Let's confirm if Ansible is installed


$ apt-cache show ansible
Package: ansible
Priority: optional
Section: admin
Installed-Size: 56579
Maintainer: Ansible, Inc. <info@ansible.com>
Architecture: all
Version: 2.9.2-1ppa~bionic
Depends: python-jinja2, python-yaml, python-paramiko, python-httplib2, python-six, python-crypto (>= 2.6), python-setuptools, sshpass, python-cryptography, python:any (<< 2.8), python:any (>= 2.7.5-5~)
Filename: pool/main/a/ansible/ansible_2.9.2-1ppa~bionic_all.deb
Size: 5777612
MD5sum: 3468ec2ff9e22ac430ee0ccd71e007c2
SHA1: 81780a7413cdc338c4f4fb874bffe9486d788d91
SHA256: 4c4db7e2a32bdafec7f0907fc979a5a0c6589b5ec69ac4396d7eab6e74d1bcc4
Description-en: Ansible IT Automation
 Ansible is a radically simple model-driven configuration management,
 multi-node deployment, and remote task execution system. Ansible works
 over SSH and does not require any software or daemons to be installed
 on remote nodes. Extension modules can be written in any language and
 are transferred to managed machines automatically.
Description-md5: 0e3133c71d7d51c7e54c60ee8b4f0be0

Package: ansible
Architecture: all
Version: 2.5.1+dfsg-1
Priority: optional
Section: universe/admin
Origin: Ubuntu
Maintainer: Ubuntu Developers <ubuntu-devel-discuss@lists.ubuntu.com>
Original-Maintainer: Harlan Lieberman-Berg <hlieberman@debian.org>
Bugs: https://bugs.launchpad.net/ubuntu/+filebug
Installed-Size: 26263
Depends: python-cryptography, python-jinja2, python-paramiko, python-pkg-resources, python-yaml, python:any (<< 2.8), python:any (>= 2.7.5-5~), python-crypto, python-httplib2, python-netaddr
Recommends: python-jmespath, python-kerberos, python-libcloud, python-selinux, python-winrm (>= 0.1.1), python-xmltodict
Suggests: cowsay, sshpass
Filename: pool/universe/a/ansible/ansible_2.5.1+dfsg-1_all.deb
Size: 3196684
MD5sum: 2ff0d45d0a8d10a4c4b2f86ca98011dd
SHA1: eb4728c657bebdaa03aa5de5add330b7b6b12bd6
SHA256: 3d1a3b7ad8ca018a0212c92e2034222bae1e2968028828eaace64d6acd30fd96
Homepage: https://www.ansible.com
Description-en: Configuration management, deployment, and task execution system
 Ansible is a radically simple model-driven configuration management,
 multi-node deployment, and remote task execution system. Ansible works
 over SSH and does not require any software or daemons to be installed
 on remote nodes. Extension modules can be written in any language and
 are transferred to managed machines automatically.
Description-md5: db2b21b0d2286fccc4401d5982361488

How to find common lines in two files

2019-12-27T18:55:00.003+08:00

While developing two Docker images, I want to find common lines for bash scripts I use to build and run the Docker images. There are fancy applications such as Beyond Compare (recommended, used by some of the best software engineers I know), or open source applications such as Meld, kdiff3 or WinMerge.

fgrep

For simple command line comparison, use fgrep:


$ fgrep -f docker_build.sh ../another-project/docker_build.sh
#!/usr/bin/env bash

user=`whoami`
uid=`id -u`
gid=`id -g`

VERSION="1.0.1"
DOCKER_REPO="registry.corp.com/"
BRAND="vitis-ai-runtime"
IMAGE_NAME="${DOCKER_REPO}${BRAND}:${VERSION}"
# Create Latest Tag - just another name for the image above
LATEST_CPU_IMAGE_TAG=${DOCKER_REPO}$BRAND:latest
TAR_PATH="${2:-/proj/rdi/staff/hanxuel/vai/docker-images}"

#cp  -f  ../../conda/*.txt .
#cp  -f ../../packages/ubuntu/xrt*18.04* .
#cp -rf /wrk/acceleration/shareData/conda/latest/conda-channel .

#sudo \
while getopts ":t:" opt; do
  case $opt in
    t)
      VERSION="TEST-${OPTARG}"
      echo "-t was triggered, TEST Version: ${VERSION}" >&2
      IMAGE_NAME="${DOCKER_REPO}${BRAND}:${VERSION}"
      unset LATEST_CPU_IMAGE_TAG
      ;;
    \?)
      echo "Invalid option: -$OPTARG" >&2
      exit 1
      ;;
    :)
      echo "Option -$OPTARG requires an argument." >&2
      exit 1
      ;;
  esac
done
docker build --no-cache\
  --network=host \
  --build-arg VERSION=$VERSION \
  -f Dockerfile \
  -t $IMAGE_NAME \
  .
#  -t $IMAGE_NAME \
  #-t vitis-ai-runtime:0.4.5 \

#rm -rf conda-channel xrt* *.txt

echo "Saving Docker Image $IMAGE_NAME"
docker tag $IMAGE_NAME $LATEST_CPU_IMAGE_TAG #registry:5000/$IMAGE_NAME
docker push $IMAGE_NAME
if [ -z ${LATEST_CPU_IMAGE_TAG} ]
then
  docker tag ${IMAGE_NAME} ${LATEST_CPU_IMAGE_TAG};
  docker push ${LATEST_CPU_IMAGE_TAG}
fi
docker save $IMAGE_NAME | gzip -c > ${BRAND}-${VERSION}.tar.gz

If you have GNU grep installed, you can use the -F flag


grep -Ff file1 file2

comm

If the lines are sorted, you can use comm


$ comm -12 docker_run.sh ../another-projecte/docker_run.sh
#!/bin/bash


comm: file 1 is not in sorted order

user=`whoami`
comm: file 2 is not in sorted order
uid=`id -u`
gid=`id -g`


VERSION=1.0.1


IMAGE_NAME="${1:-$CPU_IMAGE_TAG}"
xclmgmt_driver="$(find /dev -name xclmgmt\*)"
docker_devices=""
for i in ${xclmgmt_driver} ;
do
  docker_devices+="--device=$i "
done


render_driver="$(find /dev/dri -name renderD\*)"
for i in ${render_driver} ;
do
  docker_devices+="--device=$i "
done

It does not work with unsorted files though. For example:


$ comm -12 docker_build.sh ../vitis-ai--runtime/docker_build.sh
#!/usr/bin/env bash

comm: file 1 is not in sorted order
comm: file 2 is not in sorted order

How to check installed CUDA version

2019-12-27T18:23:00.001+08:00

The first place you should check is the OS' package management system


$ apt list --installed | grep cuda

WARNING: apt does not have a stable CLI interface. Use with caution in scripts.

cuda/unknown,now 10.0.130-1 amd64 [installed]
cuda-10-0/unknown,now 10.0.130-1 amd64 [installed,automatic]
cuda-command-line-tools-10-0/unknown,now 10.0.130-1 amd64 [installed,automatic]
cuda-compiler-10-0/unknown,now 10.0.130-1 amd64 [installed,automatic]
cuda-cublas-10-0/unknown,now 10.0.130-1 amd64 [installed,automatic]
cuda-cublas-dev-10-0/unknown,now 10.0.130-1 amd64 [installed,automatic]
cuda-cudart-10-0/unknown,now 10.0.130-1 amd64 [installed,automatic]
cuda-cudart-dev-10-0/unknown,now 10.0.130-1 amd64 [installed,automatic]

Next, try checking /usr/local/cuda/version.txt


~$ cat /usr/local/cuda/version.txt
CUDA Version 10.0.130

There might be multiple versions of CUDA


$ ls -ld /usr/local/cuda*
lrwxrwxrwx  1 root root   9 Sep 10 16:02 /usr/local/cuda -> cuda-10.0
drwxr-xr-x 16 root root 290 Sep 10 16:01 /usr/local/cuda-10.0
drwxr-xr-x 18 root root 249 Jul 29 11:13 /usr/local/cuda-9.0

If you have cuda-toolkit-x-y (for example, cuda-toolkit-10-0) installed, you can also use this command


 $ /usr/local/cuda/bin/nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2018 NVIDIA Corporation
Built on Sat_Aug_25_21:08:01_CDT_2018
Cuda compilation tools, release 10.0, V10.0.130

Finally, within your application, you can call the CUDA API with either of these functions


cudaRuntimeGetVersion()

cudaDriverGetVersion()

How to restart Audio in Windows without rebooting

2019-12-27T17:32:00.002+08:00

Sometimes the Audio service in Windows will fail to work. There could be many kinds of symptoms such as:

Sound is enabled, volume set to high or maximum but no sound on speaker, headset or other connected audio devices
Sounds devices not detected
When bluetooth is enabled and connected to audio device and Windows is put to sleep, then wake up again, audio does not work

Restart Windows Audio Service

Open a command prompt (for example, cmd.exe) with Administrator privileges and run these commands to stop the audio services


net stop audiosrv
net stop AudioEndpointBuilder

Start the audio services again


net start audiosrv
net start AudioEndpointBuilder

Waves MaxxAudio

Microsoft bundles Waves MaxxAudio Pro software to enhance audio quality for Windows. One of the functionality it does is optimizing the audio output depending on what kind of devices you plug into the audio jack.

This is what you will typically see when you plug in an audio device

I notice that if the MaxxAudio Pro application is not running, audio services may fail to work. Check in your Task Manager if the Waves AudioMaxx application is running

If it is not responding, terminate it. You can start the application manually from C:\Windows\System32\DriverStore\FileRepository\wavesapo75de.inf_amd64_8d6ed1504b570116 by running these two applications:

WavesSvc64.exe
MaxxAudioPro.exe

Uninstall Waves MaxxAudio

Finally, if you find the Waves MaxxAudio application to be a nuisance, follow these steps to permanently uninstall it:

Device Manager
Sound, video and game controllers
Realtek Audio
Right-click, update driver.
"Browse my computer for driver software"
"Let me pick from a list..."
Install "High Definition Audio Device"


Update Audio Device

Select "High Definition Audio" device

Ubuntu: CUDA apt installation error: The following packages have unmet dependencies:

2019-12-26T21:29:00.002+08:00

When you install the official CUDA Debian package, you may encounter this error:


$ sudo apt-get install cuda
Reading package lists... Done
Building dependency tree
Reading state information... Done
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

The following packages have unmet dependencies:
 cuda : Depends: cuda-10-0 (>= 10.0.130) but it is not going to be installed
E: Unable to correct problems, you have held broken packages.

I got this error when installing CUDA 10.0 on an Ubuntu 18.04 server.

Fix Missing or Broken Packages

Unfortunately, apt does not explain what is causing the error, nor does it show the conflict clearly. The following commands does not solve the problem either


sudo apt-get update –fix-missing
sudo dpkg –configure -a
sudo apt-get install -f

Use Aptitude

Aptitude is a text-mode as well as graphical application that offers an easy-to-use interface to advanced features of apt. Most importantly, it has the magical (to me, at least) ability to resolve package conflicts.

Simply replace apt or apt-get commands with aptitude.


$ sudo aptitude install cuda
The following NEW packages will be installed:
  cuda cuda-10-0{a} cuda-command-line-tools-10-0{a} cuda-compiler-10-0{a}
  cuda-cublas-10-0{a} cuda-cublas-dev-10-0{a} cuda-cudart-10-0{a}
  cuda-cudart-dev-10-0{a} cuda-cufft-10-0{a} cuda-cufft-dev-10-0{a}
  cuda-cuobjdump-10-0{a} cuda-cupti-10-0{a} cuda-curand-10-0{a}
  cuda-curand-dev-10-0{a} cuda-cusolver-10-0{a} cuda-cusolver-dev-10-0{a}
  cuda-cusparse-10-0{a} cuda-cusparse-dev-10-0{a} cuda-demo-suite-10-0{a}
  cuda-documentation-10-0{a} cuda-driver-dev-10-0{a} cuda-drivers{a}
  cuda-gdb-10-0{a} cuda-gpu-library-advisor-10-0{a} cuda-libraries-10-0{a}
  cuda-libraries-dev-10-0{a} cuda-license-10-0{a} cuda-memcheck-10-0{a}
  cuda-misc-headers-10-0{a} cuda-npp-10-0{a} cuda-npp-dev-10-0{a}
  cuda-nsight-10-0{a} cuda-nsight-compute-10-0{a} cuda-nvcc-10-0{a}
  cuda-nvdisasm-10-0{a} cuda-nvgraph-10-0{a} cuda-nvgraph-dev-10-0{a}
  cuda-nvjpeg-10-0{a} cuda-nvjpeg-dev-10-0{a} cuda-nvml-dev-10-0{a}
  cuda-nvprof-10-0{a} cuda-nvprune-10-0{a} cuda-nvrtc-10-0{a}
  cuda-nvrtc-dev-10-0{a} cuda-nvtx-10-0{a} cuda-nvvp-10-0{a}
  cuda-runtime-10-0{a} cuda-samples-10-0{a} cuda-toolkit-10-0{a}
  cuda-tools-10-0{a} cuda-visual-tools-10-0{a} freeglut3{a}
  freeglut3-dev{a} libdrm-dev{a} libgl1-mesa-dev{a} libglu1-mesa-dev{a}
  libglvnd-core-dev{a} libglvnd-dev{a} libice-dev{a} libopengl0{a}
  libpthread-stubs0-dev{a} libsm-dev{a} libx11-dev{ab} libx11-xcb-dev{ab}
  libxau-dev{a} libxcb-dri2-0-dev{a} libxcb-dri3-dev{a} libxcb-glx0-dev{a}
  libxcb-present-dev{a} libxcb-randr0-dev{a} libxcb-render0-dev{a}
  libxcb-shape0-dev{a} libxcb-sync-dev{a} libxcb-xfixes0-dev{a}
  libxcb1-dev{a} libxdamage-dev{a} libxdmcp-dev{a} libxext-dev{a}
  libxfixes-dev{a} libxi-dev{a} libxmu-dev{a} libxmu-headers{a}
  libxnvctrl0{a} libxshmfence-dev{a} libxt-dev{a} libxxf86vm-dev{a}
  mesa-common-dev{a} nvidia-modprobe{a} nvidia-settings{a} pkg-config{a}
  screen-resolution-extra{a} x11proto-core-dev{a} x11proto-damage-dev{a}
  x11proto-dev{a} x11proto-dri2-dev{a} x11proto-fixes-dev{a}
  x11proto-gl-dev{a} x11proto-input-dev{a} x11proto-xext-dev{a}
  x11proto-xf86vidmode-dev{a} xorg-sgml-doctools{a} xtrans-dev{a}
The following packages are RECOMMENDED but will NOT be installed:
  libx11-doc
0 packages upgraded, 102 newly installed, 0 to remove and 3 not upgraded.
Need to get 4,368 kB/1,368 MB of archives. After unpacking 3,157 MB will be used.
The following packages have unmet dependencies:
 libx11-xcb-dev : Depends: libx11-xcb1 (= 2:1.6.4-3) but 2:1.6.4-3ubuntu0.1 is installed
 libx11-dev : Depends: libx11-6 (= 2:1.6.4-3) but 2:1.6.4-3ubuntu0.1 is installed
The following actions will resolve these dependencies:

      Keep the following packages at their current version:
1)      cuda [Not Installed]
2)      cuda-10-0 [Not Installed]
3)      cuda-documentation-10-0 [Not Installed]
4)      cuda-samples-10-0 [Not Installed]
5)      cuda-toolkit-10-0 [Not Installed]
6)      freeglut3-dev [Not Installed]
7)      libgl1-mesa-dev [Not Installed]
8)      libglu1-mesa-dev [Not Installed]
9)      libx11-dev [Not Installed]
10)     libx11-xcb-dev [Not Installed]
11)     libxdamage-dev [Not Installed]
12)     libxext-dev [Not Installed]
13)     libxfixes-dev [Not Installed]
14)     libxi-dev [Not Installed]
15)     libxmu-dev [Not Installed]
16)     libxmu-headers [Not Installed]
17)     libxt-dev [Not Installed]
18)     libxxf86vm-dev [Not Installed]
19)     mesa-common-dev [Not Installed]

Isn't this a lot more helpful? Aptitude gives you choices starting from the most conservative. The default choice is the same as the "apt" command: not changing anything. Aptitude helpfully list out the actual conflict.


The following packages have unmet dependencies:
 libx11-xcb-dev : Depends: libx11-xcb1 (= 2:1.6.4-3) but 2:1.6.4-3ubuntu0.1 is installed
 libx11-dev : Depends: libx11-6 (= 2:1.6.4-3) but 2:1.6.4-3ubuntu0.1 is installed

The problem is with libx11-xcb-dev and libx11-dev. The correct version is installed, but the version name has the ubuntu0.1 suffix.

The default and first option provided by aptitude does not take any actions except to show you the list of packages that needed to be installed, but would not install due to unmet dependencies.

Next Aptitude Option

Let's answer no and see what is the next option


Accept this solution? [Y/n/q/?] n
The following actions will resolve these dependencies:

     Downgrade the following packages:
1)     libx11-6 [2:1.6.4-3ubuntu0.1 (now) -> 2:1.6.4-3 (bionic)]
2)     libx11-xcb1 [2:1.6.4-3ubuntu0.1 (now) -> 2:1.6.4-3 (bionic)]

Now aptitude offers to downgrade the 2 conflicting packages, so that the original package we requested, cuda, can be installed. Let's answer "Yes"


Accept this solution? [Y/n/q/?] y
The following packages will be DOWNGRADED:
  libx11-6 libx11-xcb1
The following NEW packages will be installed:
  cuda cuda-10-0{a} cuda-command-line-tools-10-0{a} cuda-compiler-10-0{a}
  cuda-cublas-10-0{a} cuda-cublas-dev-10-0{a} cuda-cudart-10-0{a}
  cuda-cudart-dev-10-0{a} cuda-cufft-10-0{a} cuda-cufft-dev-10-0{a}
  cuda-cuobjdump-10-0{a} cuda-cupti-10-0{a} cuda-curand-10-0{a}
  cuda-curand-dev-10-0{a} cuda-cusolver-10-0{a} cuda-cusolver-dev-10-0{a}
  cuda-cusparse-10-0{a} cuda-cusparse-dev-10-0{a} cuda-demo-suite-10-0{a}
  cuda-documentation-10-0{a} cuda-driver-dev-10-0{a} cuda-drivers{a}
  cuda-gdb-10-0{a} cuda-gpu-library-advisor-10-0{a} cuda-libraries-10-0{a}
  cuda-libraries-dev-10-0{a} cuda-license-10-0{a} cuda-memcheck-10-0{a}
  cuda-misc-headers-10-0{a} cuda-npp-10-0{a} cuda-npp-dev-10-0{a}
  cuda-nsight-10-0{a} cuda-nsight-compute-10-0{a} cuda-nvcc-10-0{a}
  cuda-nvdisasm-10-0{a} cuda-nvgraph-10-0{a} cuda-nvgraph-dev-10-0{a}
  cuda-nvjpeg-10-0{a} cuda-nvjpeg-dev-10-0{a} cuda-nvml-dev-10-0{a}
  cuda-nvprof-10-0{a} cuda-nvprune-10-0{a} cuda-nvrtc-10-0{a}
  cuda-nvrtc-dev-10-0{a} cuda-nvtx-10-0{a} cuda-nvvp-10-0{a}
  cuda-runtime-10-0{a} cuda-samples-10-0{a} cuda-toolkit-10-0{a}
  cuda-tools-10-0{a} cuda-visual-tools-10-0{a} freeglut3{a}
  freeglut3-dev{a} libdrm-dev{a} libgl1-mesa-dev{a} libglu1-mesa-dev{a}
  libglvnd-core-dev{a} libglvnd-dev{a} libice-dev{a} libopengl0{a}
  libpthread-stubs0-dev{a} libsm-dev{a} libx11-dev{a} libx11-xcb-dev{a}
  libxau-dev{a} libxcb-dri2-0-dev{a} libxcb-dri3-dev{a} libxcb-glx0-dev{a}
  libxcb-present-dev{a} libxcb-randr0-dev{a} libxcb-render0-dev{a}
  libxcb-shape0-dev{a} libxcb-sync-dev{a} libxcb-xfixes0-dev{a}
  libxcb1-dev{a} libxdamage-dev{a} libxdmcp-dev{a} libxext-dev{a}
  libxfixes-dev{a} libxi-dev{a} libxmu-dev{a} libxmu-headers{a}
  libxnvctrl0{a} libxshmfence-dev{a} libxt-dev{a} libxxf86vm-dev{a}
  mesa-common-dev{a} nvidia-modprobe{a} nvidia-settings{a} pkg-config{a}
  screen-resolution-extra{a} x11proto-core-dev{a} x11proto-damage-dev{a}
  x11proto-dev{a} x11proto-dri2-dev{a} x11proto-fixes-dev{a}
  x11proto-gl-dev{a} x11proto-input-dev{a} x11proto-xext-dev{a}
  x11proto-xf86vidmode-dev{a} xorg-sgml-doctools{a} xtrans-dev{a}
The following packages are RECOMMENDED but will NOT be installed:
  libx11-doc
0 packages upgraded, 102 newly installed, 2 downgraded, 0 to remove and 3 not upgraded.
Need to get 4,950 kB/1,369 MB of archives. After unpacking 3,157 MB will be used.
Do you want to continue? [Y/n/?] y

Aptitude will show you exactly what will be changed. The conflicting packages downgraded to the correct version, and the rest of CUDA packages installed. You will be asked a final time before aptitude makes the changes.

After answering yes, all the required packages will be installed


Do you want to continue? [Y/n/?] y
Get: 1 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-license-10-0 10.0.130-1 [17.6 kB]
Get: 2 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-misc-headers-10-0 10.0.130-1 [640 kB]
Get: 3 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-nvcc-10-0 10.0.130-1 [20.0 MB]
Get: 4 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-cuobjdump-10-0 10.0.130-1 [130 kB]
Get: 5 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-nvprune-10-0 10.0.130-1 [36.8 kB]
Get: 6 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-compiler-10-0 10.0.130-1 [2,538 B]
Get: 7 http://ppa.launchpad.net/graphics-drivers/ppa/ubuntu bionic/main amd64 libxnvctrl0 amd64 418.56-0ubuntu0~gpu18.04.1 [18.3 kB]
Get: 8 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-nvdisasm-10-0 10.0.130-1 [22.1 MB]
Get: 9 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-gdb-10-0 10.0.130-1 [2,769 kB]
Get: 10 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-nvprof-10-0 10.0.130-1 [5,590 kB]
Get: 11 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-memcheck-10-0 10.0.130-1 [139 kB]
Get: 12 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-cudart-10-0 10.0.130-1 [109 kB]
Get: 13 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-driver-dev-10-0 10.0.130-1 [12.0 kB]
Get: 14 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-cudart-dev-10-0 10.0.130-1 [457 kB]
Get: 15 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-cupti-10-0 10.0.130-1 [1,564 kB]
Get: 16 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-gpu-library-advisor-10-0 10.0.130-1 [1,003 kB]
Get: 17 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-nvtx-10-0 10.0.130-1 [38.9 kB]
Get: 18 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-command-line-tools-10-0 10.0.130-1 [26.9 kB]
Get: 19 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-nsight-10-0 10.0.130-1 [2,590 B]
Get: 20 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-nvvp-10-0 10.0.130-1 [2,536 B]
Get: 21 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-nvrtc-10-0 10.0.130-1 [5,925 kB]
Get: 22 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-nvrtc-dev-10-0 10.0.130-1 [9,344 B]
Get: 23 http://ppa.launchpad.net/graphics-drivers/ppa/ubuntu bionic/main amd64 nvidia-settings amd64 418.56-0ubuntu0~gpu18.04.1 [964 kB]
Get: 24 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-cusolver-10-0 10.0.130-1 [38.4 MB]
Get: 25 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libx11-6 amd64 2:1.6.4-3 [572 kB]
Get: 26 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-cusolver-dev-10-0 10.0.130-1 [13.2 MB]
Get: 27 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-cublas-10-0 10.0.130-1 [30.3 MB]
Get: 28 http://aptmirror.acme.com/ubuntu180401 bionic/universe amd64 freeglut3 amd64 2.8.1-3 [73.6 kB]
Get: 29 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 xorg-sgml-doctools all 1:1.11-1 [12.9 kB]
Get: 30 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 x11proto-dev all 2018.4-4 [251 kB]
Get: 31 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 x11proto-core-dev all 2018.4-4 [2,620 B]
Get: 32 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libxau-dev amd64 1:1.0.8-1 [11.1 kB]
Get: 33 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libxdmcp-dev amd64 1:1.1.2-3 [25.1 kB]
Get: 34 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 x11proto-input-dev all 2018.4-4 [2,620 B]
Get: 35 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 xtrans-dev all 1.3.5-1 [70.5 kB]
Get: 36 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libpthread-stubs0-dev amd64 0.3-4 [4,068 B]
Get: 37 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libxcb1-dev amd64 1.13-1 [80.0 kB]
Get: 38 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libx11-dev amd64 2:1.6.4-3 [642 kB]
Get: 39 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-cublas-dev-10-0 10.0.130-1 [30.8 MB]
Get: 40 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libdrm-dev amd64 2.4.91-2 [238 kB]
Get: 41 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 mesa-common-dev amd64 18.0.0~rc5-1ubuntu1 [528 kB]
Get: 42 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libglvnd-core-dev amd64 1.0.0-2ubuntu2 [12.7 kB]
Get: 43 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libopengl0 amd64 1.0.0-2ubuntu2 [31.1 kB]
Get: 44 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libglvnd-dev amd64 1.0.0-2ubuntu2 [3,376 B]
Get: 45 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libx11-xcb1 amd64 2:1.6.4-3 [9,626 B]
Get: 46 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libx11-xcb-dev amd64 2:1.6.4-3 [9,660 B]
Get: 47 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libxcb-dri3-dev amd64 1.13-1 [7,368 B]
Get: 48 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libxcb-render0-dev amd64 1.13-1 [18.4 kB]
Get: 49 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libxcb-randr0-dev amd64 1.13-1 [20.4 kB]
Get: 50 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libxcb-shape0-dev amd64 1.13-1 [7,144 B]
Get: 51 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-cufft-10-0 10.0.130-1 [60.7 MB]
Get: 52 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libxcb-xfixes0-dev amd64 1.13-1 [11.7 kB]
Get: 53 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libxcb-sync-dev amd64 1.13-1 [10.6 kB]
Get: 54 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libxcb-present-dev amd64 1.13-1 [6,968 B]
Get: 55 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libxshmfence-dev amd64 1.3-1 [3,692 B]
Get: 56 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libxcb-dri2-0-dev amd64 1.13-1 [8,476 B]
Get: 57 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libxcb-glx0-dev amd64 1.13-1 [27.9 kB]
Get: 58 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 x11proto-fixes-dev all 1:2018.4-4 [2,620 B]
Get: 59 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libxfixes-dev amd64 1:5.0.3-1 [11.0 kB]
Get: 60 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 x11proto-damage-dev all 1:2018.4-4 [2,620 B]
Get: 61 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libxdamage-dev amd64 1:1.1.4-3 [5,028 B]
Get: 62 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 x11proto-xext-dev all 2018.4-4 [2,620 B]
Get: 63 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libxext-dev amd64 2:1.3.3-1 [82.1 kB]
Get: 64 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 x11proto-xf86vidmode-dev all 2018.4-4 [2,632 B]
Get: 65 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libxxf86vm-dev amd64 1:1.1.4-1 [13.3 kB]
Get: 66 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 x11proto-dri2-dev all 2018.4-4 [2,620 B]
Get: 67 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 x11proto-gl-dev all 2018.4-4 [2,612 B]
Get: 68 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libgl1-mesa-dev amd64 18.0.0~rc5-1ubuntu1 [4,440 B]
Get: 69 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libglu1-mesa-dev amd64 9.0.0-2.1build1 [206 kB]
Get: 70 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libice-dev amd64 2:1.0.9-2 [46.8 kB]
Get: 71 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libsm-dev amd64 2:1.2.2-1 [16.2 kB]
Get: 72 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libxt-dev amd64 1:1.1.5-1 [395 kB]
Get: 73 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-cufft-dev-10-0 10.0.130-1 [124 MB]
Get: 74 http://aptmirror.acme.com/ubuntu180401 bionic/universe amd64 freeglut3-dev amd64 2.8.1-3 [124 kB]
Get: 75 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libxmu-headers all 2:1.1.2-2 [54.3 kB]
Get: 76 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libxmu-dev amd64 2:1.1.2-2 [49.0 kB]
Get: 77 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 libxi-dev amd64 2:1.7.9-1 [186 kB]
Get: 78 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 pkg-config amd64 0.29.1-0ubuntu2 [45.0 kB]
Get: 79 http://aptmirror.acme.com/ubuntu180401 bionic/main amd64 screen-resolution-extra all 0.17.3 [11.7 kB]
Get: 80 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-curand-10-0 10.0.130-1 [38.9 MB]
Get: 81 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-curand-dev-10-0 10.0.130-1 [58.1 MB]
Get: 82 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-cusparse-10-0 10.0.130-1 [27.1 MB]
Get: 83 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-cusparse-dev-10-0 10.0.130-1 [27.2 MB]
Get: 84 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-npp-10-0 10.0.130-1 [54.2 MB]
Get: 85 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-npp-dev-10-0 10.0.130-1 [55.0 MB]
Get: 86 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-nvml-dev-10-0 10.0.130-1 [51.6 kB]
Get: 87 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-nvgraph-10-0 10.0.130-1 [12.8 MB]
Get: 88 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-nvgraph-dev-10-0 10.0.130-1 [33.4 MB]
Get: 89 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-nvjpeg-10-0 10.0.130-1 [281 kB]
Get: 90 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-nvjpeg-dev-10-0 10.0.130-1 [192 kB]
Get: 91 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-nsight-compute-10-0 10.0.130-1 [188 MB]
Get: 92 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-visual-tools-10-0 10.0.130-1 [394 MB]
Get: 93 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-tools-10-0 10.0.130-1 [2,498 B]
Get: 94 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-samples-10-0 10.0.130-1 [61.5 MB]
Get: 95 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-documentation-10-0 10.0.130-1 [52.0 MB]
Get: 96 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-libraries-dev-10-0 10.0.130-1 [2,606 B]
Get: 97 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-toolkit-10-0 10.0.130-1 [2,834 B]
Get: 98 file:/var/cuda-repo-10-0-local-10.0.130-410.48  nvidia-modprobe 410.48-0ubuntu1 [19.1 kB]
Get: 99 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-drivers 410.48-1 [2,568 B]
Get: 100 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-libraries-10-0 10.0.130-1 [2,586 B]
Get: 101 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-runtime-10-0 10.0.130-1 [2,540 B]
Get: 102 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-demo-suite-10-0 10.0.130-1 [3,868 kB]
Get: 103 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda-10-0 10.0.130-1 [2,562 B]
Get: 104 file:/var/cuda-repo-10-0-local-10.0.130-410.48  cuda 10.0.130-1 [2,514 B]
Fetched 4,950 kB in 32s (157 kB/s)
Extracting templates from packages: 100%
dpkg: warning: downgrading libx11-6:amd64 from 2:1.6.4-3ubuntu0.1 to 2:1.6.4-3
(Reading database ... 242417 files and directories currently installed.)
Preparing to unpack .../000-libx11-6_2%3a1.6.4-3_amd64.deb ...
Unpacking libx11-6:amd64 (2:1.6.4-3) over (2:1.6.4-3ubuntu0.1) ...
Selecting previously unselected package cuda-license-10-0.
Preparing to unpack .../001-cuda-license-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-license-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-misc-headers-10-0.
Preparing to unpack .../002-cuda-misc-headers-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-misc-headers-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-nvcc-10-0.
Preparing to unpack .../003-cuda-nvcc-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-nvcc-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-cuobjdump-10-0.
Preparing to unpack .../004-cuda-cuobjdump-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-cuobjdump-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-nvprune-10-0.
Preparing to unpack .../005-cuda-nvprune-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-nvprune-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-compiler-10-0.
Preparing to unpack .../006-cuda-compiler-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-compiler-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-nvdisasm-10-0.
Preparing to unpack .../007-cuda-nvdisasm-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-nvdisasm-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-gdb-10-0.
Preparing to unpack .../008-cuda-gdb-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-gdb-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-nvprof-10-0.
Preparing to unpack .../009-cuda-nvprof-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-nvprof-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-memcheck-10-0.
Preparing to unpack .../010-cuda-memcheck-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-memcheck-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-cudart-10-0.
Preparing to unpack .../011-cuda-cudart-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-cudart-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-driver-dev-10-0.
Preparing to unpack .../012-cuda-driver-dev-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-driver-dev-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-cudart-dev-10-0.
Preparing to unpack .../013-cuda-cudart-dev-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-cudart-dev-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-cupti-10-0.
Preparing to unpack .../014-cuda-cupti-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-cupti-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-gpu-library-advisor-10-0.
Preparing to unpack .../015-cuda-gpu-library-advisor-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-gpu-library-advisor-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-nvtx-10-0.
Preparing to unpack .../016-cuda-nvtx-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-nvtx-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-command-line-tools-10-0.
Preparing to unpack .../017-cuda-command-line-tools-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-command-line-tools-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-nsight-10-0.
Preparing to unpack .../018-cuda-nsight-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-nsight-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-nvvp-10-0.
Preparing to unpack .../019-cuda-nvvp-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-nvvp-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-nvrtc-10-0.
Preparing to unpack .../020-cuda-nvrtc-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-nvrtc-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-nvrtc-dev-10-0.
Preparing to unpack .../021-cuda-nvrtc-dev-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-nvrtc-dev-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-cusolver-10-0.
Preparing to unpack .../022-cuda-cusolver-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-cusolver-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-cusolver-dev-10-0.
Preparing to unpack .../023-cuda-cusolver-dev-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-cusolver-dev-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-cublas-10-0.
Preparing to unpack .../024-cuda-cublas-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-cublas-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-cublas-dev-10-0.
Preparing to unpack .../025-cuda-cublas-dev-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-cublas-dev-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-cufft-10-0.
Preparing to unpack .../026-cuda-cufft-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-cufft-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-cufft-dev-10-0.
Preparing to unpack .../027-cuda-cufft-dev-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-cufft-dev-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-curand-10-0.
Preparing to unpack .../028-cuda-curand-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-curand-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-curand-dev-10-0.
Preparing to unpack .../029-cuda-curand-dev-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-curand-dev-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-cusparse-10-0.
Preparing to unpack .../030-cuda-cusparse-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-cusparse-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-cusparse-dev-10-0.
Preparing to unpack .../031-cuda-cusparse-dev-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-cusparse-dev-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-npp-10-0.
Preparing to unpack .../032-cuda-npp-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-npp-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-npp-dev-10-0.
Preparing to unpack .../033-cuda-npp-dev-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-npp-dev-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-nvml-dev-10-0.
Preparing to unpack .../034-cuda-nvml-dev-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-nvml-dev-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-nvgraph-10-0.
Preparing to unpack .../035-cuda-nvgraph-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-nvgraph-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-nvgraph-dev-10-0.
Preparing to unpack .../036-cuda-nvgraph-dev-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-nvgraph-dev-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-nvjpeg-10-0.
Preparing to unpack .../037-cuda-nvjpeg-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-nvjpeg-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-nvjpeg-dev-10-0.
Preparing to unpack .../038-cuda-nvjpeg-dev-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-nvjpeg-dev-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-nsight-compute-10-0.
Preparing to unpack .../039-cuda-nsight-compute-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-nsight-compute-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-visual-tools-10-0.
Preparing to unpack .../040-cuda-visual-tools-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-visual-tools-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-tools-10-0.
Preparing to unpack .../041-cuda-tools-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-tools-10-0 (10.0.130-1) ...
Selecting previously unselected package freeglut3:amd64.
Preparing to unpack .../042-freeglut3_2.8.1-3_amd64.deb ...
Unpacking freeglut3:amd64 (2.8.1-3) ...
Selecting previously unselected package xorg-sgml-doctools.
Preparing to unpack .../043-xorg-sgml-doctools_1%3a1.11-1_all.deb ...
Unpacking xorg-sgml-doctools (1:1.11-1) ...
Selecting previously unselected package x11proto-dev.
Preparing to unpack .../044-x11proto-dev_2018.4-4_all.deb ...
Unpacking x11proto-dev (2018.4-4) ...
Selecting previously unselected package x11proto-core-dev.
Preparing to unpack .../045-x11proto-core-dev_2018.4-4_all.deb ...
Unpacking x11proto-core-dev (2018.4-4) ...
Selecting previously unselected package libxau-dev:amd64.
Preparing to unpack .../046-libxau-dev_1%3a1.0.8-1_amd64.deb ...
Unpacking libxau-dev:amd64 (1:1.0.8-1) ...
Selecting previously unselected package libxdmcp-dev:amd64.
Preparing to unpack .../047-libxdmcp-dev_1%3a1.1.2-3_amd64.deb ...
Unpacking libxdmcp-dev:amd64 (1:1.1.2-3) ...
Selecting previously unselected package x11proto-input-dev.
Preparing to unpack .../048-x11proto-input-dev_2018.4-4_all.deb ...
Unpacking x11proto-input-dev (2018.4-4) ...
Selecting previously unselected package xtrans-dev.
Preparing to unpack .../049-xtrans-dev_1.3.5-1_all.deb ...
Unpacking xtrans-dev (1.3.5-1) ...
Selecting previously unselected package libpthread-stubs0-dev:amd64.
Preparing to unpack .../050-libpthread-stubs0-dev_0.3-4_amd64.deb ...
Unpacking libpthread-stubs0-dev:amd64 (0.3-4) ...
Selecting previously unselected package libxcb1-dev:amd64.
Preparing to unpack .../051-libxcb1-dev_1.13-1_amd64.deb ...
Unpacking libxcb1-dev:amd64 (1.13-1) ...
Selecting previously unselected package libx11-dev:amd64.
Preparing to unpack .../052-libx11-dev_2%3a1.6.4-3_amd64.deb ...
Unpacking libx11-dev:amd64 (2:1.6.4-3) ...
Selecting previously unselected package libdrm-dev:amd64.
Preparing to unpack .../053-libdrm-dev_2.4.91-2_amd64.deb ...
Unpacking libdrm-dev:amd64 (2.4.91-2) ...
Selecting previously unselected package mesa-common-dev:amd64.
Preparing to unpack .../054-mesa-common-dev_18.0.0~rc5-1ubuntu1_amd64.deb ...
Unpacking mesa-common-dev:amd64 (18.0.0~rc5-1ubuntu1) ...
Selecting previously unselected package libglvnd-core-dev:amd64.
Preparing to unpack .../055-libglvnd-core-dev_1.0.0-2ubuntu2_amd64.deb ...
Unpacking libglvnd-core-dev:amd64 (1.0.0-2ubuntu2) ...
Selecting previously unselected package libopengl0:amd64.
Preparing to unpack .../056-libopengl0_1.0.0-2ubuntu2_amd64.deb ...
Unpacking libopengl0:amd64 (1.0.0-2ubuntu2) ...
Selecting previously unselected package libglvnd-dev:amd64.
Preparing to unpack .../057-libglvnd-dev_1.0.0-2ubuntu2_amd64.deb ...
Unpacking libglvnd-dev:amd64 (1.0.0-2ubuntu2) ...
dpkg: warning: downgrading libx11-xcb1:amd64 from 2:1.6.4-3ubuntu0.1 to 2:1.6.4-3
Preparing to unpack .../058-libx11-xcb1_2%3a1.6.4-3_amd64.deb ...
Unpacking libx11-xcb1:amd64 (2:1.6.4-3) over (2:1.6.4-3ubuntu0.1) ...
Selecting previously unselected package libx11-xcb-dev:amd64.
Preparing to unpack .../059-libx11-xcb-dev_2%3a1.6.4-3_amd64.deb ...
Unpacking libx11-xcb-dev:amd64 (2:1.6.4-3) ...
Selecting previously unselected package libxcb-dri3-dev:amd64.
Preparing to unpack .../060-libxcb-dri3-dev_1.13-1_amd64.deb ...
Unpacking libxcb-dri3-dev:amd64 (1.13-1) ...
Selecting previously unselected package libxcb-render0-dev:amd64.
Preparing to unpack .../061-libxcb-render0-dev_1.13-1_amd64.deb ...
Unpacking libxcb-render0-dev:amd64 (1.13-1) ...
Selecting previously unselected package libxcb-randr0-dev:amd64.
Preparing to unpack .../062-libxcb-randr0-dev_1.13-1_amd64.deb ...
Unpacking libxcb-randr0-dev:amd64 (1.13-1) ...
Selecting previously unselected package libxcb-shape0-dev:amd64.
Preparing to unpack .../063-libxcb-shape0-dev_1.13-1_amd64.deb ...
Unpacking libxcb-shape0-dev:amd64 (1.13-1) ...
Selecting previously unselected package libxcb-xfixes0-dev:amd64.
Preparing to unpack .../064-libxcb-xfixes0-dev_1.13-1_amd64.deb ...
Unpacking libxcb-xfixes0-dev:amd64 (1.13-1) ...
Selecting previously unselected package libxcb-sync-dev:amd64.
Preparing to unpack .../065-libxcb-sync-dev_1.13-1_amd64.deb ...
Unpacking libxcb-sync-dev:amd64 (1.13-1) ...
Selecting previously unselected package libxcb-present-dev:amd64.
Preparing to unpack .../066-libxcb-present-dev_1.13-1_amd64.deb ...
Unpacking libxcb-present-dev:amd64 (1.13-1) ...
Selecting previously unselected package libxshmfence-dev:amd64.
Preparing to unpack .../067-libxshmfence-dev_1.3-1_amd64.deb ...
Unpacking libxshmfence-dev:amd64 (1.3-1) ...
Selecting previously unselected package libxcb-dri2-0-dev:amd64.
Preparing to unpack .../068-libxcb-dri2-0-dev_1.13-1_amd64.deb ...
Unpacking libxcb-dri2-0-dev:amd64 (1.13-1) ...
Selecting previously unselected package libxcb-glx0-dev:amd64.
Preparing to unpack .../069-libxcb-glx0-dev_1.13-1_amd64.deb ...
Unpacking libxcb-glx0-dev:amd64 (1.13-1) ...
Selecting previously unselected package x11proto-fixes-dev.
Preparing to unpack .../070-x11proto-fixes-dev_1%3a2018.4-4_all.deb ...
Unpacking x11proto-fixes-dev (1:2018.4-4) ...
Selecting previously unselected package libxfixes-dev:amd64.
Preparing to unpack .../071-libxfixes-dev_1%3a5.0.3-1_amd64.deb ...
Unpacking libxfixes-dev:amd64 (1:5.0.3-1) ...
Selecting previously unselected package x11proto-damage-dev.
Preparing to unpack .../072-x11proto-damage-dev_1%3a2018.4-4_all.deb ...
Unpacking x11proto-damage-dev (1:2018.4-4) ...
Selecting previously unselected package libxdamage-dev:amd64.
Preparing to unpack .../073-libxdamage-dev_1%3a1.1.4-3_amd64.deb ...
Unpacking libxdamage-dev:amd64 (1:1.1.4-3) ...
Selecting previously unselected package x11proto-xext-dev.
Preparing to unpack .../074-x11proto-xext-dev_2018.4-4_all.deb ...
Unpacking x11proto-xext-dev (2018.4-4) ...
Selecting previously unselected package libxext-dev:amd64.
Preparing to unpack .../075-libxext-dev_2%3a1.3.3-1_amd64.deb ...
Unpacking libxext-dev:amd64 (2:1.3.3-1) ...
Selecting previously unselected package x11proto-xf86vidmode-dev.
Preparing to unpack .../076-x11proto-xf86vidmode-dev_2018.4-4_all.deb ...
Unpacking x11proto-xf86vidmode-dev (2018.4-4) ...
Selecting previously unselected package libxxf86vm-dev:amd64.
Preparing to unpack .../077-libxxf86vm-dev_1%3a1.1.4-1_amd64.deb ...
Unpacking libxxf86vm-dev:amd64 (1:1.1.4-1) ...
Selecting previously unselected package x11proto-dri2-dev.
Preparing to unpack .../078-x11proto-dri2-dev_2018.4-4_all.deb ...
Unpacking x11proto-dri2-dev (2018.4-4) ...
Selecting previously unselected package x11proto-gl-dev.
Preparing to unpack .../079-x11proto-gl-dev_2018.4-4_all.deb ...
Unpacking x11proto-gl-dev (2018.4-4) ...
Selecting previously unselected package libgl1-mesa-dev:amd64.
Preparing to unpack .../080-libgl1-mesa-dev_18.0.0~rc5-1ubuntu1_amd64.deb ...
Unpacking libgl1-mesa-dev:amd64 (18.0.0~rc5-1ubuntu1) ...
Selecting previously unselected package libglu1-mesa-dev:amd64.
Preparing to unpack .../081-libglu1-mesa-dev_9.0.0-2.1build1_amd64.deb ...
Unpacking libglu1-mesa-dev:amd64 (9.0.0-2.1build1) ...
Selecting previously unselected package libice-dev:amd64.
Preparing to unpack .../082-libice-dev_2%3a1.0.9-2_amd64.deb ...
Unpacking libice-dev:amd64 (2:1.0.9-2) ...
Selecting previously unselected package libsm-dev:amd64.
Preparing to unpack .../083-libsm-dev_2%3a1.2.2-1_amd64.deb ...
Unpacking libsm-dev:amd64 (2:1.2.2-1) ...
Selecting previously unselected package libxt-dev:amd64.
Preparing to unpack .../084-libxt-dev_1%3a1.1.5-1_amd64.deb ...
Unpacking libxt-dev:amd64 (1:1.1.5-1) ...
Selecting previously unselected package freeglut3-dev:amd64.
Preparing to unpack .../085-freeglut3-dev_2.8.1-3_amd64.deb ...
Unpacking freeglut3-dev:amd64 (2.8.1-3) ...
Selecting previously unselected package libxmu-headers.
Preparing to unpack .../086-libxmu-headers_2%3a1.1.2-2_all.deb ...
Unpacking libxmu-headers (2:1.1.2-2) ...
Selecting previously unselected package libxmu-dev:amd64.
Preparing to unpack .../087-libxmu-dev_2%3a1.1.2-2_amd64.deb ...
Unpacking libxmu-dev:amd64 (2:1.1.2-2) ...
Selecting previously unselected package libxi-dev:amd64.
Preparing to unpack .../088-libxi-dev_2%3a1.7.9-1_amd64.deb ...
Unpacking libxi-dev:amd64 (2:1.7.9-1) ...
Selecting previously unselected package cuda-samples-10-0.
Preparing to unpack .../089-cuda-samples-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-samples-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-documentation-10-0.
Preparing to unpack .../090-cuda-documentation-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-documentation-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-libraries-dev-10-0.
Preparing to unpack .../091-cuda-libraries-dev-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-libraries-dev-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-toolkit-10-0.
Preparing to unpack .../092-cuda-toolkit-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-toolkit-10-0 (10.0.130-1) ...
Selecting previously unselected package nvidia-modprobe.
Preparing to unpack .../093-nvidia-modprobe_410.48-0ubuntu1_amd64.deb ...
Unpacking nvidia-modprobe (410.48-0ubuntu1) ...
Selecting previously unselected package pkg-config.
Preparing to unpack .../094-pkg-config_0.29.1-0ubuntu2_amd64.deb ...
Unpacking pkg-config (0.29.1-0ubuntu2) ...
Selecting previously unselected package screen-resolution-extra.
Preparing to unpack .../095-screen-resolution-extra_0.17.3_all.deb ...
Unpacking screen-resolution-extra (0.17.3) ...
Selecting previously unselected package libxnvctrl0:amd64.
Preparing to unpack .../096-libxnvctrl0_418.56-0ubuntu0~gpu18.04.1_amd64.deb ...
Unpacking libxnvctrl0:amd64 (418.56-0ubuntu0~gpu18.04.1) ...
Selecting previously unselected package nvidia-settings.
Preparing to unpack .../097-nvidia-settings_418.56-0ubuntu0~gpu18.04.1_amd64.deb ...
Unpacking nvidia-settings (418.56-0ubuntu0~gpu18.04.1) ...
Selecting previously unselected package cuda-drivers.
Preparing to unpack .../098-cuda-drivers_410.48-1_amd64.deb ...
Unpacking cuda-drivers (410.48-1) ...
Selecting previously unselected package cuda-libraries-10-0.
Preparing to unpack .../099-cuda-libraries-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-libraries-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-runtime-10-0.
Preparing to unpack .../100-cuda-runtime-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-runtime-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-demo-suite-10-0.
Preparing to unpack .../101-cuda-demo-suite-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-demo-suite-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda-10-0.
Preparing to unpack .../102-cuda-10-0_10.0.130-1_amd64.deb ...
Unpacking cuda-10-0 (10.0.130-1) ...
Selecting previously unselected package cuda.
Preparing to unpack .../103-cuda_10.0.130-1_amd64.deb ...
Unpacking cuda (10.0.130-1) ...
Setting up libopengl0:amd64 (1.0.0-2ubuntu2) ...
Processing triggers for mime-support (3.60ubuntu1) ...
Setting up libxshmfence-dev:amd64 (1.3-1) ...
Processing triggers for desktop-file-utils (0.23-1ubuntu3.18.04.1) ...
Setting up libpthread-stubs0-dev:amd64 (0.3-4) ...
Setting up libdrm-dev:amd64 (2.4.91-2) ...
Setting up xorg-sgml-doctools (1:1.11-1) ...
Setting up libx11-6:amd64 (2:1.6.4-3) ...
Processing triggers for sgml-base (1.29) ...
Setting up x11proto-dev (2018.4-4) ...
Setting up x11proto-damage-dev (1:2018.4-4) ...
Setting up pkg-config (0.29.1-0ubuntu2) ...
Setting up libx11-xcb1:amd64 (2:1.6.4-3) ...
Setting up xtrans-dev (1.3.5-1) ...
Setting up x11proto-xext-dev (2018.4-4) ...
Setting up libxdmcp-dev:amd64 (1:1.1.2-3) ...
Processing triggers for libc-bin (2.27-3ubuntu1) ...
Setting up libice-dev:amd64 (2:1.0.9-2) ...
Setting up screen-resolution-extra (0.17.3) ...
Setting up x11proto-gl-dev (2018.4-4) ...
Setting up nvidia-modprobe (410.48-0ubuntu1) ...
Setting up cuda-license-10-0 (10.0.130-1) ...
*** LICENSE AGREEMENT ***
By using this software you agree to fully comply with the terms and
conditions of the EULA (End User License Agreement). The EULA is located
at /usr/local/cuda-10.0/doc/EULA.txt. The EULA can also be found at
http://docs.nvidia.com/cuda/eula/index.html. If you do not agree to the
terms and conditions of the EULA, do not use the software.

Processing triggers for man-db (2.8.3-2) ...
Setting up cuda-nsight-10-0 (10.0.130-1) ...
Processing triggers for gnome-menus (3.13.3-11ubuntu1) ...
Setting up cuda-nvdisasm-10-0 (10.0.130-1) ...
Setting up cuda-nvml-dev-10-0 (10.0.130-1) ...
Processing triggers for dbus (1.12.2-1ubuntu1.1) ...
Setting up cuda-nvprof-10-0 (10.0.130-1) ...
Setting up cuda-nvrtc-10-0 (10.0.130-1) ...
Setting up cuda-nvtx-10-0 (10.0.130-1) ...
Setting up libglvnd-core-dev:amd64 (1.0.0-2ubuntu2) ...
Setting up x11proto-input-dev (2018.4-4) ...
Setting up libxnvctrl0:amd64 (418.56-0ubuntu0~gpu18.04.1) ...
Setting up cuda-nvgraph-10-0 (10.0.130-1) ...
Setting up x11proto-dri2-dev (2018.4-4) ...
Setting up freeglut3:amd64 (2.8.1-3) ...
Setting up cuda-nvprune-10-0 (10.0.130-1) ...
Setting up libsm-dev:amd64 (2:1.2.2-1) ...
Setting up x11proto-core-dev (2018.4-4) ...
Setting up cuda-cusparse-10-0 (10.0.130-1) ...
Setting up cuda-cuobjdump-10-0 (10.0.130-1) ...
Setting up cuda-nvjpeg-10-0 (10.0.130-1) ...
Setting up cuda-gdb-10-0 (10.0.130-1) ...
Setting up cuda-nvjpeg-dev-10-0 (10.0.130-1) ...
Setting up cuda-cufft-10-0 (10.0.130-1) ...
Setting up cuda-nsight-compute-10-0 (10.0.130-1) ...
Setting up cuda-cudart-10-0 (10.0.130-1) ...
Setting up x11proto-fixes-dev (1:2018.4-4) ...
Setting up cuda-npp-10-0 (10.0.130-1) ...
Setting up cuda-cufft-dev-10-0 (10.0.130-1) ...
Setting up x11proto-xf86vidmode-dev (2018.4-4) ...
Setting up libxau-dev:amd64 (1:1.0.8-1) ...
Setting up libglvnd-dev:amd64 (1.0.0-2ubuntu2) ...
Setting up cuda-cusolver-10-0 (10.0.130-1) ...
Setting up cuda-misc-headers-10-0 (10.0.130-1) ...
Setting up cuda-nvvp-10-0 (10.0.130-1) ...
Setting up cuda-curand-10-0 (10.0.130-1) ...
Setting up nvidia-settings (418.56-0ubuntu0~gpu18.04.1) ...
Setting up cuda-drivers (410.48-1) ...
Setting up cuda-driver-dev-10-0 (10.0.130-1) ...
Setting up cuda-gpu-library-advisor-10-0 (10.0.130-1) ...
Setting up cuda-cublas-10-0 (10.0.130-1) ...
Setting up cuda-nvgraph-dev-10-0 (10.0.130-1) ...
Setting up cuda-cudart-dev-10-0 (10.0.130-1) ...
Setting up cuda-memcheck-10-0 (10.0.130-1) ...
Setting up cuda-nvrtc-dev-10-0 (10.0.130-1) ...
Setting up libxcb1-dev:amd64 (1.13-1) ...
Setting up libxcb-glx0-dev:amd64 (1.13-1) ...
Setting up cuda-npp-dev-10-0 (10.0.130-1) ...
Setting up libx11-dev:amd64 (2:1.6.4-3) ...
Setting up cuda-nvcc-10-0 (10.0.130-1) ...
Setting up libxxf86vm-dev:amd64 (1:1.1.4-1) ...
Setting up libxfixes-dev:amd64 (1:5.0.3-1) ...
Setting up cuda-curand-dev-10-0 (10.0.130-1) ...
Setting up libxcb-sync-dev:amd64 (1.13-1) ...
Setting up cuda-cusparse-dev-10-0 (10.0.130-1) ...
Setting up cuda-cusolver-dev-10-0 (10.0.130-1) ...
Setting up libx11-xcb-dev:amd64 (2:1.6.4-3) ...
Setting up cuda-cublas-dev-10-0 (10.0.130-1) ...
Setting up libxt-dev:amd64 (1:1.1.5-1) ...
Setting up cuda-libraries-dev-10-0 (10.0.130-1) ...
Setting up mesa-common-dev:amd64 (18.0.0~rc5-1ubuntu1) ...
Setting up libxmu-headers (2:1.1.2-2) ...
Setting up cuda-cupti-10-0 (10.0.130-1) ...
Setting up cuda-command-line-tools-10-0 (10.0.130-1) ...
Setting up cuda-visual-tools-10-0 (10.0.130-1) ...
Setting up libxdamage-dev:amd64 (1:1.1.4-3) ...
Setting up cuda-libraries-10-0 (10.0.130-1) ...
Setting up libxcb-dri2-0-dev:amd64 (1.13-1) ...
Setting up libxcb-render0-dev:amd64 (1.13-1) ...
Setting up libxcb-dri3-dev:amd64 (1.13-1) ...
Setting up libxext-dev:amd64 (2:1.3.3-1) ...
Setting up libxcb-shape0-dev:amd64 (1.13-1) ...
Setting up cuda-compiler-10-0 (10.0.130-1) ...
Setting up libxi-dev:amd64 (2:1.7.9-1) ...
Setting up cuda-runtime-10-0 (10.0.130-1) ...
Setting up libxcb-randr0-dev:amd64 (1.13-1) ...
Setting up cuda-tools-10-0 (10.0.130-1) ...
Setting up libxmu-dev:amd64 (2:1.1.2-2) ...
Setting up libxcb-xfixes0-dev:amd64 (1.13-1) ...
Setting up cuda-demo-suite-10-0 (10.0.130-1) ...
Setting up libxcb-present-dev:amd64 (1.13-1) ...
Setting up libgl1-mesa-dev:amd64 (18.0.0~rc5-1ubuntu1) ...
Setting up libglu1-mesa-dev:amd64 (9.0.0-2.1build1) ...
Setting up freeglut3-dev:amd64 (2.8.1-3) ...
Setting up cuda-samples-10-0 (10.0.130-1) ...
Setting up cuda-documentation-10-0 (10.0.130-1) ...
Setting up cuda-toolkit-10-0 (10.0.130-1) ...
Setting up cuda-10-0 (10.0.130-1) ...
Setting up cuda (10.0.130-1) ...
Processing triggers for libc-bin (2.27-3ubuntu1) ...

Linux: how to get the total amount of memory parsable by shell scripts

2019-12-26T20:41:00.000+08:00

To output the amount of total memory in kilobytes (KB), use this command


$ awk '/MemTotal/ {print $2}' /proc/meminfo
47869448

A slightly more user-friendly display


$ cat /proc/meminfo | grep MemTotal
MemTotal:       47869448 kB

How to install GCC 7 on Ubuntu 16.04

2019-12-25T12:41:00.001+08:00

Default version of GCC on Ubuntu Xenial 16.04 is 5.3.1-1ubuntu1.

I strongly suggest you to choose Ubuntu 18.04 if you have a choice, as the packages available are more up to date, and the Support and End of Life date is much further in the future - https://wiki.ubuntu.com/Releases

GCC 7 From Ubuntu Toolchains PPA

GCC 7.x is not available on Ubuntu 16 by default. To get GCC 7.x, you need to add the Ubuntu Toolchains PPA.

Install the apt pre-requisites


sudo apt-get install -y software-properties-common python-software-properties

Add the repository


sudo add-apt-repository ppa:ubuntu-toolchain-r/test

Install GCC 7 Toolchain


sudo apt update && sudo apt install g++-7 -y

Reading package lists... Done
Building dependency tree
Reading state information... Done
The following package was automatically installed and is no longer required:
  gcc-5-base:i386
Use 'sudo apt autoremove' to remove it.
The following additional packages will be installed:
  cpp-7 gcc-7 gcc-7-base gcc-8-base gcc-9-base gcc-9-base:i386 libasan4
  libatomic1 libcc1-0 libcilkrts5 libgcc-7-dev libgcc1 libgcc1:i386 libgomp1
  libitm1 liblsan0 libmpx2 libquadmath0 libstdc++-7-dev libstdc++6
  libstdc++6:i386 libtsan0 libubsan0
Suggested packages:
  gcc-7-locales g++-7-multilib gcc-7-doc libstdc++6-7-dbg gcc-7-multilib
  libgcc1-dbg libgomp1-dbg libitm1-dbg libatomic1-dbg libasan4-dbg
  liblsan0-dbg libtsan0-dbg libubsan0-dbg libcilkrts5-dbg libmpx2-dbg
  libquadmath0-dbg libstdc++-7-doc
The following NEW packages will be installed:
  cpp-7 g++-7 gcc-7 gcc-7-base gcc-8-base gcc-9-base gcc-9-base:i386 libasan4
  libgcc-7-dev libmpx2 libstdc++-7-dev
The following packages will be upgraded:
  libatomic1 libcc1-0 libcilkrts5 libgcc1 libgcc1:i386 libgomp1 libitm1
  liblsan0 libquadmath0 libstdc++6 libstdc++6:i386 libtsan0 libubsan0
13 upgraded, 11 newly installed, 0 to remove and 36 not upgraded.
Need to get 28.0 MB of archives.
After this operation, 109 MB of additional disk space will be used.
Get:1 http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu xenial/main amd64 gcc-9-base amd64 9.2.1-17ubuntu1~16.04 [18.9 kB]
Get:2 http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu xenial/main i386 gcc-9-base i386 9.2.1-17ubuntu1~16.04 [18.9 kB]
Get:3 http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu xenial/main i386 libgcc1 i386 1:9.2.1-17ubuntu1~16.04 [48.0 kB]
Get:4 http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu xenial/main amd64 libgcc1 amd64 1:9.2.1-17ubuntu1~16.04 [40.6 kB]
Get:5 http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu xenial/main i386 libstdc++6 i386 9.2.1-17ubuntu1~16.04 [556 kB]
Get:6 http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu xenial/main amd64 libstdc++6 amd64 9.2.1-17ubuntu1~16.04 [516 kB]
Get:7 http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu xenial/main amd64 gcc-7-base amd64 7.4.0-1ubuntu1~16.04~ppa1 [18.8 kB]
Get:8 http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu xenial/main amd64 gcc-8-base amd64 8.3.0-16ubuntu3~16.04 [18.3 kB]
Get:9 http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu xenial/main amd64 cpp-7 amd64 7.4.0-1ubuntu1~16.04~ppa1 [6,678 kB]
Get:10 http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu xenial/main amd64 libcc1-0 amd64 9.2.1-17ubuntu1~16.04 [40.3 kB]
Get:11 http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu xenial/main amd64 libgomp1 amd64 9.2.1-17ubuntu1~16.04 [89.1 kB]
Get:12 http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu xenial/main amd64 libitm1 amd64 9.2.1-17ubuntu1~16.04 [27.8 kB]
Get:13 http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu xenial/main amd64 libatomic1 amd64 9.2.1-17ubuntu1~16.04 [9,096 B]
Get:14 http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu xenial/main amd64 libasan4 amd64 7.4.0-1ubuntu1~16.04~ppa1 [360 kB]
Get:15 http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu xenial/main amd64 liblsan0 amd64 9.2.1-17ubuntu1~16.04 [139 kB]
Get:16 http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu xenial/main amd64 libtsan0 amd64 9.2.1-17ubuntu1~16.04 [301 kB]
Get:17 http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu xenial/main amd64 libubsan0 amd64 7.4.0-1ubuntu1~16.04~ppa1 [126 kB]
Get:18 http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu xenial/main amd64 libcilkrts5 amd64 7.4.0-1ubuntu1~16.04~ppa1 [42.4 kB]
Get:19 http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu xenial/main amd64 libmpx2 amd64 8.3.0-16ubuntu3~16.04 [11.6 kB]
Get:20 http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu xenial/main amd64 libquadmath0 amd64 9.2.1-17ubuntu1~16.04 [145 kB]
Get:21 http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu xenial/main amd64 libgcc-7-dev amd64 7.4.0-1ubuntu1~16.04~ppa1 [2,382 kB]
Get:22 http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu xenial/main amd64 gcc-7 amd64 7.4.0-1ubuntu1~16.04~ppa1 [7,394 kB]
Get:23 http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu xenial/main amd64 libstdc++-7-dev amd64 7.4.0-1ubuntu1~16.04~ppa1 [1,475 kB]
Get:24 http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu xenial/main amd64 g++-7 amd64 7.4.0-1ubuntu1~16.04~ppa1 [7,507 kB]
Fetched 28.0 MB in 2min 9s (216 kB/s)
Selecting previously unselected package gcc-9-base:amd64.
(Reading database ... 298106 files and directories currently installed.)
Preparing to unpack .../gcc-9-base_9.2.1-17ubuntu1~16.04_amd64.deb ...
Unpacking gcc-9-base:amd64 (9.2.1-17ubuntu1~16.04) ...
Selecting previously unselected package gcc-9-base:i386.
Preparing to unpack .../gcc-9-base_9.2.1-17ubuntu1~16.04_i386.deb ...
Unpacking gcc-9-base:i386 (9.2.1-17ubuntu1~16.04) ...
Setting up gcc-9-base:amd64 (9.2.1-17ubuntu1~16.04) ...
Setting up gcc-9-base:i386 (9.2.1-17ubuntu1~16.04) ...
(Reading database ... 298114 files and directories currently installed.)
Preparing to unpack .../libgcc1_1%3a9.2.1-17ubuntu1~16.04_amd64.deb ...
De-configuring libgcc1:i386 (1:6.0.1-0ubuntu1) ...
Unpacking libgcc1:amd64 (1:9.2.1-17ubuntu1~16.04) over (1:6.0.1-0ubuntu1) ...
Preparing to unpack .../libgcc1_1%3a9.2.1-17ubuntu1~16.04_i386.deb ...
Unpacking libgcc1:i386 (1:9.2.1-17ubuntu1~16.04) over (1:6.0.1-0ubuntu1) ...
Preparing to unpack .../libstdc++6_9.2.1-17ubuntu1~16.04_amd64.deb ...
De-configuring libstdc++6:i386 (5.4.0-6ubuntu1~16.04.12) ...
Unpacking libstdc++6:amd64 (9.2.1-17ubuntu1~16.04) over (5.4.0-6ubuntu1~16.04.12) ...
Preparing to unpack .../libstdc++6_9.2.1-17ubuntu1~16.04_i386.deb ...
Unpacking libstdc++6:i386 (9.2.1-17ubuntu1~16.04) over (5.4.0-6ubuntu1~16.04.12) ...
Selecting previously unselected package gcc-7-base:amd64.
Preparing to unpack .../gcc-7-base_7.4.0-1ubuntu1~16.04~ppa1_amd64.deb ...
Unpacking gcc-7-base:amd64 (7.4.0-1ubuntu1~16.04~ppa1) ...
Selecting previously unselected package gcc-8-base:amd64.
Preparing to unpack .../gcc-8-base_8.3.0-16ubuntu3~16.04_amd64.deb ...
Unpacking gcc-8-base:amd64 (8.3.0-16ubuntu3~16.04) ...
Selecting previously unselected package cpp-7.
Preparing to unpack .../cpp-7_7.4.0-1ubuntu1~16.04~ppa1_amd64.deb ...
Unpacking cpp-7 (7.4.0-1ubuntu1~16.04~ppa1) ...
Preparing to unpack .../libcc1-0_9.2.1-17ubuntu1~16.04_amd64.deb ...
Unpacking libcc1-0:amd64 (9.2.1-17ubuntu1~16.04) over (5.4.0-6ubuntu1~16.04.12) ...
Preparing to unpack .../libgomp1_9.2.1-17ubuntu1~16.04_amd64.deb ...
Unpacking libgomp1:amd64 (9.2.1-17ubuntu1~16.04) over (5.4.0-6ubuntu1~16.04.12) ...
Preparing to unpack .../libitm1_9.2.1-17ubuntu1~16.04_amd64.deb ...
Unpacking libitm1:amd64 (9.2.1-17ubuntu1~16.04) over (5.4.0-6ubuntu1~16.04.12) ...
Preparing to unpack .../libatomic1_9.2.1-17ubuntu1~16.04_amd64.deb ...
Unpacking libatomic1:amd64 (9.2.1-17ubuntu1~16.04) over (5.4.0-6ubuntu1~16.04.12) ...
Selecting previously unselected package libasan4:amd64.
Preparing to unpack .../libasan4_7.4.0-1ubuntu1~16.04~ppa1_amd64.deb ...
Unpacking libasan4:amd64 (7.4.0-1ubuntu1~16.04~ppa1) ...
Preparing to unpack .../liblsan0_9.2.1-17ubuntu1~16.04_amd64.deb ...
Unpacking liblsan0:amd64 (9.2.1-17ubuntu1~16.04) over (5.4.0-6ubuntu1~16.04.12) ...
Preparing to unpack .../libtsan0_9.2.1-17ubuntu1~16.04_amd64.deb ...
Unpacking libtsan0:amd64 (9.2.1-17ubuntu1~16.04) over (5.4.0-6ubuntu1~16.04.12) ...
Preparing to unpack .../libubsan0_7.4.0-1ubuntu1~16.04~ppa1_amd64.deb ...
Unpacking libubsan0:amd64 (7.4.0-1ubuntu1~16.04~ppa1) over (5.4.0-6ubuntu1~16.04.12) ...
Preparing to unpack .../libcilkrts5_7.4.0-1ubuntu1~16.04~ppa1_amd64.deb ...
Unpacking libcilkrts5:amd64 (7.4.0-1ubuntu1~16.04~ppa1) over (5.4.0-6ubuntu1~16.04.12) ...
Selecting previously unselected package libmpx2:amd64.
Preparing to unpack .../libmpx2_8.3.0-16ubuntu3~16.04_amd64.deb ...
Unpacking libmpx2:amd64 (8.3.0-16ubuntu3~16.04) ...
Preparing to unpack .../libquadmath0_9.2.1-17ubuntu1~16.04_amd64.deb ...
Unpacking libquadmath0:amd64 (9.2.1-17ubuntu1~16.04) over (5.4.0-6ubuntu1~16.04.12) ...
Selecting previously unselected package libgcc-7-dev:amd64.
Preparing to unpack .../libgcc-7-dev_7.4.0-1ubuntu1~16.04~ppa1_amd64.deb ...
Unpacking libgcc-7-dev:amd64 (7.4.0-1ubuntu1~16.04~ppa1) ...
Selecting previously unselected package gcc-7.
Preparing to unpack .../gcc-7_7.4.0-1ubuntu1~16.04~ppa1_amd64.deb ...
Unpacking gcc-7 (7.4.0-1ubuntu1~16.04~ppa1) ...
Selecting previously unselected package libstdc++-7-dev:amd64.
Preparing to unpack .../libstdc++-7-dev_7.4.0-1ubuntu1~16.04~ppa1_amd64.deb ...
Unpacking libstdc++-7-dev:amd64 (7.4.0-1ubuntu1~16.04~ppa1) ...
Selecting previously unselected package g++-7.
Preparing to unpack .../g++-7_7.4.0-1ubuntu1~16.04~ppa1_amd64.deb ...
Unpacking g++-7 (7.4.0-1ubuntu1~16.04~ppa1) ...
Processing triggers for libc-bin (2.23-0ubuntu10) ...
Processing triggers for man-db (2.7.5-1) ...
Setting up libgcc1:i386 (1:9.2.1-17ubuntu1~16.04) ...
Setting up libgcc1:amd64 (1:9.2.1-17ubuntu1~16.04) ...
Setting up libstdc++6:i386 (9.2.1-17ubuntu1~16.04) ...
Setting up libstdc++6:amd64 (9.2.1-17ubuntu1~16.04) ...
Setting up gcc-7-base:amd64 (7.4.0-1ubuntu1~16.04~ppa1) ...
Setting up gcc-8-base:amd64 (8.3.0-16ubuntu3~16.04) ...
Setting up cpp-7 (7.4.0-1ubuntu1~16.04~ppa1) ...
Setting up libcc1-0:amd64 (9.2.1-17ubuntu1~16.04) ...
Setting up libgomp1:amd64 (9.2.1-17ubuntu1~16.04) ...
Setting up libitm1:amd64 (9.2.1-17ubuntu1~16.04) ...
Setting up libatomic1:amd64 (9.2.1-17ubuntu1~16.04) ...
Setting up libasan4:amd64 (7.4.0-1ubuntu1~16.04~ppa1) ...
Setting up liblsan0:amd64 (9.2.1-17ubuntu1~16.04) ...
Setting up libtsan0:amd64 (9.2.1-17ubuntu1~16.04) ...
Setting up libubsan0:amd64 (7.4.0-1ubuntu1~16.04~ppa1) ...
Setting up libcilkrts5:amd64 (7.4.0-1ubuntu1~16.04~ppa1) ...
Setting up libmpx2:amd64 (8.3.0-16ubuntu3~16.04) ...
Setting up libquadmath0:amd64 (9.2.1-17ubuntu1~16.04) ...
Setting up libgcc-7-dev:amd64 (7.4.0-1ubuntu1~16.04~ppa1) ...
Setting up gcc-7 (7.4.0-1ubuntu1~16.04~ppa1) ...
Setting up libstdc++-7-dev:amd64 (7.4.0-1ubuntu1~16.04~ppa1) ...
Setting up g++-7 (7.4.0-1ubuntu1~16.04~ppa1) ...
Processing triggers for libc-bin (2.23-0ubuntu10) ...

Set Default GCC Tools to 7

You probably want your "gcc" command to be gcc & instead of the default GCC 5. Use "update-alternatives" to set the default version


sudo update-alternatives \

     --install /usr/bin/gcc gcc /usr/bin/gcc-7 60 \
     --slave /usr/bin/g++ g++ /usr/bin/g++-7 \
     --slave /usr/bin/gcc-ar gcc-ar /usr/bin/gcc-ar-7 \
     --slave /usr/bin/gcc-nm gcc-nm /usr/bin/gcc-nm-7 \
     --slave /usr/bin/gcc-ranlib gcc-ranlib /usr/bin/gcc-ranlib-7

Check that the default version of the tools is set to 7.4.0


$ gcc --version
gcc (Ubuntu 7.4.0-1ubuntu1~16.04~ppa1) 7.4.0
Copyright (C) 2017 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

$ g++ --version
g++ (Ubuntu 7.4.0-1ubuntu1~16.04~ppa1) 7.4.0
Copyright (C) 2017 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

How to fix Failed to initialize NVML - Driver/library version mismatch

2019-12-20T13:06:00.000+08:00

This error happens:


$ nvidia-smi
Failed to initialize NVML: Driver/library version mismatch

most likely due to upgrading the NVIDIA driver, and the old drivers are still loaded.

Reboot

The first step you should do after successfully installing a new version of NVIDIA GPU driver is to reboot the server. Reboot should automatically resolve the issue.

Unload NVIDIA kernel module

If reboot does not help, you will need to manually unload all the NVIDIA kernel modules.

Check to see which modules are loaded


$ lsmod | grep nvidia
nvidia_uvm            634880  8
nvidia_drm             53248  0
nvidia_modeset        790528  1 nvidia_drm
nvidia              12312576  86 nvidia_modeset,nvidia_uvm

Unload the kernel module


sudo rmmod nvidia_drm
sudo rmmod nvidia_modeset
sudo rmmod nvidia_uvm
sudo rmmod nvidi

Note: You need to follow the sequence above, or else you will get error about dependencies.

The error below means some processes are still using the GPU.


rmmod: ERROR: Module nvidia is in use

Check which processes are using the GPU and terminate them


sudo lsof /dev/nvidia*

Reload the NVIDIA kernel modules

Finally, run nvidia-smi to reload the new kernel modules


$ nvidia-smi
Fri Nov 22 09:48:00 2019
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 410.104      Driver Version: 410.104      CUDA Version: 10.0     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|===============================+======================+======================|
|   0  Tesla P100-PCIE...  Off  | 00000000:3B:00.0 Off |                    0 |
| N/A   24C    P0    24W / 250W |      0MiB / 12198MiB |      0%      Default |
+-------------------------------+----------------------+----------------------+
|   1  Tesla P100-PCIE...  Off  | 00000000:AF:00.0 Off |                    0 |
| N/A   29C    P0    29W / 250W |      0MiB / 12198MiB |      0%      Default |
+-------------------------------+----------------------+----------------------+
|   2  Tesla P100-PCIE...  Off  | 00000000:D8:00.0 Off |                    0 |
| N/A   28C    P0    24W / 250W |      0MiB / 12198MiB |      0%      Default |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                       GPU Memory |
|  GPU       PID   Type   Process name                             Usage      |
|=============================================================================|
|  No running processes found                                                 |
+-----------------------------------------------------------------------------+

How to upgrade all outdated chocolatey packages

2019-11-21T11:26:00.000+08:00

Let's first list out all outdated packages with choco outdated


λ choco outdated
Chocolatey v0.10.15
Outdated Packages
 Output is package name | current version | available version | pinned?

adb|28.0.3|29.0.5|false
adwcleaner|7.3|7.4.1|false
autohotkey.portable|1.1.30.03|1.1.31.01|false
chocolatey-core.extension|1.3.3|1.3.5|false
cloc|1.80|1.82|false
Cmder|1.3.11|1.3.12|false
ConEmu|19.5.26.0|19.10.12.0|false
cuda|10.1.168|10.1.243|false
docker-desktop|2.0.0.3|2.1.0.5|false
dotnetfx|4.7.2.20180712|4.8.0.20190930|false
f.lux|4.104|4.111|false
ffmpeg|4.1.3|4.2.1|false
fiddler|5.0.20192.25091|5.0.20194.41348|false
flashplayerplugin|32.0.0.255|32.0.0.293|false
Ghostscript|9.27|9.50|false
Ghostscript.app|9.27|9.50|false
git.install|2.22.0|2.24.0.2|false
gogs|0.11.86|0.11.91|false
golang|1.12.6|1.13.4|false
gpu-z|2.21.0|2.26.0|false
handbrake|1.2.2|1.3.0|false
handbrake.install|1.2.2|1.3.0|false
heidisql|10.1.0.5464|10.2.0.559900|false
imageglass|6.0.12.29|7.0.7.26|false
imagemagick|7.0.8.48|7.0.9.5|false
imagemagick.app|7.0.8.48|7.0.9.5|false
kitty|0.71.0.3|0.73.1.1|false
malwarebytes|3.8.3.296511868|3.8.3.296513137|false
mobaxterm|12.1.0|12.3.0|false
nodejs-lts|10.16.0|12.13.1|false
paint.net|4.1.6|4.2.5|false
peazip|6.8.0|6.9.2|false
peazip.install|6.8.0|6.9.2|false
pgadmin4|4.8|4.14|false
picpick.portable|5.0.4|5.0.6|false
postgresql|10.6.0.20190131|12.1|false
postgresql10|10.6.0.0|10.11|false
putty|0.71|0.73|false
putty.portable|0.71|0.73|false
python|3.7.3|3.8.0|false
python3|3.7.3|3.8.0|false
qownnotes|19.7|19.11.17|false
rust|1.36.0|1.39.0.20191117|false
seafile-client|7.0.2|7.0.4|false
shadowsocks|4.1.6|4.1.8.0|false
sourcetree|3.1.3|3.2.6|false
spotify|1.1.12.449|1.1.19.480|false
SQLite|3.28.0|3.30.1|false
sysinternals|2019.6.14|2019.9.23|false
vcredist140|14.21.27702.2|14.23.27820|false
veracrypt|1.23.2|1.24.20191107|false
vlc|3.0.7|3.0.8|false
vnc-viewer|6.19.325|6.19.1115|false
vscode|1.35.0|1.40.1|false
winscp|5.15.2|5.15.5|false
winscp.install|5.15.2|5.15.5|false
wireshark|3.0.2|3.0.6|false
yarn|1.17.3|1.19.1|false
youtube-dl|2019.09.01|2019.11.05|false

Chocolatey has determined 59 package(s) are outdated.

Next, use cup all -y to upgrade all of those outdated packages


λ cup all -y
Chocolatey v0.10.15
Upgrading the following packages:
all
By upgrading you accept licenses for the packages.
7zip v19.0 is the latest version available based on your source(s).
7zip.install v19.0 is the latest version available based on your source(s).

You have adb v28.0.3 installed. Version 29.0.5 is available based on your source(s).
Progress: Downloading adb 29.0.5... 100%

adb v29.0.5 [Approved]
adb package files upgrade completed. Performing other installation steps.
Downloading adb
  from 'https://dl-ssl.google.com/android/repository/platform-tools_r29.0.5-windows.zip'
Progress: 100% - Completed download of C:\Users\hanxuel\AppData\Local\Temp\chocolatey\adb\29.0.5\platform-tools_r29.0.5-windows.zip (6.83 MB).
Download of platform-tools_r29.0.5-windows.zip (6.83 MB) completed.
Hashes match.
Extracting C:\Users\hanxuel\AppData\Local\Temp\chocolatey\adb\29.0.5\platform-tools_r29.0.5-windows.zip to C:\ProgramData\chocolatey\lib\adb\tools...
C:\ProgramData\chocolatey\lib\adb\tools
 ShimGen has successfully created a shim for adb.exe
 ShimGen has successfully created a shim for fastboot.exe
 ShimGen has successfully created a shim for make_f2fs.exe
 ShimGen has successfully created a shim for mke2fs.exe
 The upgrade of adb was successful.

You can also upgrade individual package with


λ cup adb


λ choco upgrade adb

For more information on upgrading Chocolatey packages, refer to https://chocolatey.org/docs/commandsupgrade

ffmpeg: default: No such process

2019-09-28T12:26:00.003+08:00

You might be running ffmpeg and performing encoding/decoding


ffmpeg -f x11grab -s 1824x984 -framerate 15 -i :0.0 -f pulse -ac 2 -i default -c:v libx264 -preset fast -pix_fmt yuv420p -s 1280x800 -c:a aac -b:a 160k -ar 44100 -threads 0 -f flv "rtmp://a.rtmp.youtube.com/live2/key"

and get this error message


built with gcc 6.3.0 (Raspbian 6.3.0-18+rpi1+deb9u1) 20170516
  configuration: --prefix=/usr --extra-version='1~deb9u1+rpt1' --toolchain=hardened --libdir=/usr/lib/arm-linux-gnueabihf --incdir=/usr/include/arm-linux-gnueabihf --enable-gpl --disable-stripping --enable-avresample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libebur128 --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmp3lame --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-omx --enable-omx-rpi --enable-mmal --enable-openal --enable-opengl --enable-sdl2 --enable-libdc1394 --enable-libiec61883 --arch=armhf --enable-chromaprint --enable-frei0r --enable-libopencv --enable-libx264 --enable-shared
  libavutil      55. 34.101 / 55. 34.101
  libavcodec     57. 64.101 / 57. 64.101
  libavformat    57. 56.101 / 57. 56.101
  libavdevice    57.  1.100 / 57.  1.100
  libavfilter     6. 65.100 /  6. 65.100
  libavresample   3.  1.  0 /  3.  1.  0
  libswscale      4.  2.100 /  4.  2.100
  libswresample   2.  3.100 /  2.  3.100
  libpostproc    54.  1.100 / 54.  1.100
[x11grab @ 0x2211710] Stream #0: not enough frames to estimate rate; consider increasing probesize
Input #0, x11grab, from ':0.0':
  Duration: N/A, start: 1569634587.235443, bitrate: N/A
    Stream #0:0: Video: rawvideo (BGR[0] / 0x524742), bgr0, 1824x984, 15 fps, 1000k tbr, 1000k tbn, 1000k tbc
default: No such process

Or perhaps audio capture on Linux


ffmpeg -video_size 1024x768 -framerate 25 -f x11grab -i :0.0+100,200 -f pulse -ac 2 -i default output.mkv

and get this error message


ffmpeg exited with code 1: default: No such process

PulseAudio

In the two scenarios above, the PulseAudio application is missing. Install PulseAudio to solve the problem.

Here is how to install them on popular Linux distributions.

Debian or Ubuntu


sudo apt-get install pulseaudio-equalizer

Fedora


sudo dnf install pulseaudio-equalizer

CentOS and other RPM based distributions


sudo yum install pulseaudio-equalizer

ArchLinux


sudo pacman -S pulseaudio-equalizer

Installing Octave 5.1.0 dependencies

2019-09-24T14:36:00.001+08:00

The following dependencies are needed on CentOS 7.4 to run Octave 5.1.0


$ sudo yum install arpack portaudio alsa-lib jack-audio-connection-kit libffado libxml++ fontconfig libsndfile sundials-devel epstool gnuplot hdf5 java-1.8.0-openjdk-headless mesa-libGLU GraphicsMagick-c++ qt libX11 suitesparse libcurl  fftw-libs-double fltk freetype libgcc libgfortran gl2ps glpk ncurses-libs pcre qhull qrupdate qscintilla libquadmath readline libstdc++ atlas zlib texinfo