ArcGIS Enterprise

See also Docker and ArcGIS in Docker, a project I abandoned.

2018-Apr-29 Today I am installing the "ArcGIS Enterprise Builder for Linux" version 10.6 into a virtual machine running Ubuntu 16.04, on Bellman.

2018-May-05 I am tired of jumping through hoops and my license runs out in a month anyway, so skip it. Won't renew. Using PostGIS and its friends from now on. See Boundless stack.

SSL and HTTPS

Today I noticed error messages about a "weak certificate" in my debug log for OpenLayers. I had to navigate to the server to refresh the certificate (to tell it that a self signed cert was okay in other words.) Once I did that pages loaded again in OpenLayers.

I needed to get "Let's Encrypt" set up on my (Linux based) ArcGIS Server. I did this later on. Note Let's Encrypt only wants to install onto public facing web servers so you will have problems if you have a server that's locked up behind a firewall.

Installing into an Ubuntu VirtualBox VM on Bellman

After installing Ubuntu,

apt update
apt upgrade
apt install emacs-nox build-essential tomcat8 tomcat8-admin

I had to issue the mount command myself to get the VirtualBox additions cdrom to play.

mount /dev/cdrom /media/cdrom
cd /media/cdrom
./VBoxLinuxAdditions.run

Now I take a snapshot once the machine is configured and before installing ArcGIS... vboxmanage snapshot server take before_arcgis

I set the vm to share ~bwilson/Downloads and /green/GIS/Data_Repository

Set up tomcat

Edit /etc/tomcat8/tomcat-users.xml and add a user with the role manager-gui. For example,

<role rolename="manager-gui"/>
<user username="tomcat" password="s3cret" roles="manager-gui"/>

Running the Enterprise Builder

The tarball is already unpacked in Downloads, so I ssh into bellman and

sudo -s
cd /media/sf_Downloads
cd EnterpriseBuilder

The instructions are in HTML format, so I NFS mounted the folder on my Mac and opened the toplevel html file in Firefox.

• Gather prvc (provisioning files) good luck navigating the ESRI web site!
• Run ./Setup
• Get this message

WARNINGS:
------------------------------------------------------------------------
*** DIAG002: Unsupported Linux distribution.  Check the ArcGIS Data
Store System Requirements for supported Linux distributions.

This is like being slapped in the face with a wet Mackerel, since I chose the distribution from ESRI's website. Yep, here it is in the HTML docs too:

 Ubuntu Server LTS 16.04.3

I have this: PRETTY_NAME="Ubuntu 16.04.4 LTS" Hmmm... that looks okay and in fact their

./Setup -s `pwd`/server.prvc -p '`pwd`/portal.prvc -v
Deploying ArcGIS 10.6 Enterprise Builder requires a minimum of 7.5 GB of RAM. Please contact your system administrator.

Ah.. fixing... bumped it to 10GB. Bellman has 32GB so that should be fine. Now it's giving me more instructions. However clumsy these changes might seem to an experienced Linux user, make them to keep ESRI happy:

adduser arcgis
cat >> /etc/security/limits.conf <<EOF
arcgis soft nofile 65536
arcgis hard nofile 65536
arcgis soft nproc 25059
arcgis hard nproc 25059
EOF

/sbin/sysctl -w vm.max_map_count=262144
/sbin/sysctl -w vm.swappiness=1

I edited /etc/hosts to put this line in

192.168.123.72 duster.wildsong.biz duster

and I coerced the 127.1.0.1 line to have the domain in it, too.

Log out, log back in as arcgis and check

ulimit -Sn -Hn

Run setup again.

All is in readiness.

arcgis@duster:/media/sf_Downloads/EnterpriseBuilder$ ./Setup -p `pwd`/PortalforArcGIS_594279.prvc -s `pwd`/_ArcGISServer_594278.prvc -v
========================================================================
                  ArcGIS Server 10.6.0 Diagnostic Tool
                                    
                            Hostname: duster
========================================================================

 DIAG000: Check for installation as root                       [PASSED]
 DIAG001: Check for 64-bit architecture                        [PASSED]
 DIAG002: Check OS version                                     [PASSED]
 DIAG003: Check hostname for invalid characters                [PASSED]
 DIAG024: Check /etc/hosts for hostname entry                  [PASSED]
 DIAG004: Check installed packages                             [PASSED]
 DIAG005: Check system limits                                  [PASSED]
 DIAG008: Check HTTP port                                      [PASSED]
 DIAG009: Check HTTPS port                                     [PASSED]
 DIAG010: Check Xvfb ports                                     [PASSED]

------------------------------------------------------------------------
There were 0 failure(s) and 1 warning(s) found:


WARNINGS:
------------------------------------------------------------------------
*** DIAG024: The hostname entry in the /etc/hosts file must be in the
following format:

	<IP> <FQDN> <Machine_name>

For example:

	111.222.333.444 hostname.esri.com hostname

Federating an ArcGIS Server site with Portal for ArcGIS will fail if
this entry is formatted differently.  Update the hostname entry before
creating your ArcGIS Server site.


========================================================================
                Portal for ArcGIS 10.6.0 Diagnostic Tool
                                    
                            Hostname: duster
========================================================================

 DIAG000: Check for installation as root                       [PASSED]
 DIAG001: Check for 64-bit architecture                        [PASSED]
 DIAG002: Check OS version                                     [PASSED]
 DIAG003: Check hostname for invalid characters                [PASSED]
 DIAG005: Check system limits                                  [PASSED]
 DIAG004: Check installed packages                             [PASSED]
 DIAG016: Check Portal for ArcGIS ports                        [PASSED]
 DIAG024: Check localhost resolution                           [PASSED]
 DIAG029: Check file system type                               [PASSED]

------------------------------------------------------------------------
There were 0 failure(s) and 0 warning(s) found:



========================================================================
                ArcGIS Data Store 10.6.0 Diagnostic Tool
                                    
                            Hostname: duster
========================================================================

 DIAG000: Check for installation as root                          [PASSED]
 DIAG001: Check for 64-bit architecture                           [PASSED]
 DIAG002: Check OS version                                        [PASSED]
 DIAG003: Check hostname for invalid characters                   [PASSED]
 DIAG004: Check installed packages                                [PASSED]
 DIAG005: Check relational and tile cache data store requirements [PASSED]
 DIAG016: Check ArcGIS Data Store ports                           [PASSED]
 DIAG020: Check hostname IP address mismatches                    [PASSED]
 DIAG029: Check spatiotemporal big data store requirements        [PASSED]

------------------------------------------------------------------------
There were 0 failure(s) and 0 warning(s) found:



Enter 'q' to quit or press enter to continue: 

Oh BITE me!

Starting installation of ArcGIS 10.6 Enterprise Builder...
[ArcGIS 10.6 Enterprise Builder Setup Warning]
This setup has detected that the DISPLAY variable has not been set, but the silent UI mode was not selected.
Note: For information on the silent setup UI mode, please run this script with the --help option.

Run setup again!

./Setup -p `pwd`/PortalforArcGIS_594279.prvc -s `pwd`/_ArcGISServer_594278.prvc -v -l yes -m silent

Eventually, after a subtantial wait,

[ArcGIS 10.6 Enterprise Builder Installation Details]
UI Mode......................silent
Agreed to Esri License.......yes
Server Authorization File..../media/sf_Downloads/EnterpriseBuilder/_ArcGISServer_594278.prvc
Portal Authorization File..../media/sf_Downloads/EnterpriseBuilder/PortalforArcGIS_594279.prvc
Installation Directory......./home/arcgis
Install Set..................Typical

Starting installation of ArcGIS 10.6 Enterprise Builder...
...ArcGIS 10.6 Enterprise Builder installation is complete.

Before using ArcGIS 10.6 Enterprise Builder, please navigate to http://duster:6080/arcgis/enterprise to complete the configuration.

Curiously painful step 7

7. In the Web Adaptor URLs panel, enter the URLs for the Web Adaptors (https://webadaptorhost.domain.com/webadaptorname) 
that will be configured with the portal and server components of your deployment.
These Web Adaptors must already be installed and located on the same machine where you ran the ArcGIS Enterprise Builder.

Okay fine. You told me I don't need Web Adaptor in the deployment but now you block configuration. Over and over I read docs that say I don't need it but every time I try to install, I am blocked when I don't have it.

There is a configuration SCRIPT tucked away though, trying that... it requires -ws and -wp options, so, oh well.

tools/configurebasedeployment/configurebasedeployment.sh -e [email protected] -fn Brian -ln Wilson -qi 10 -qa 'secret' -u bwilson -p 'secret'

Hence... installing Web Adaptor

Running the Web Adaptor installer

Download and unpack tarball, then ignore the statement that you should be root. Log in as 'arcgis'

cd WebAdaptor
./Setup -v -m silent -l yes -d ~

[ArcGIS Web Adaptor (Java Platform) 10.6 Installation Details]
UI Mode..................silent
Agreed to Esri License...yes
Installation Directory.../home/arcgis/webadaptor10.6

Starting installation of ArcGIS Web Adaptor (Java Platform) 10.6...
Checking for POSIX df.
Found POSIX df.
Checking tail options...
Using tail -n 1.
True location of the self extractor: /media/sf_Downloads/WebAdaptor/WebAdaptor/Linux/Disk1/InstData/VM/install.bin
Creating installer data directory: /tmp/install.dir.32735
Creating installer data directory: /tmp/install.dir.32735/InstallerData
Gathering free-space information...
Space needed to complete the self-extraction: 451436 blocks
Available space: 43131176 blocks
Available blocks: 43131176    Needed blocks: 451436 (block = 512 bytes)
Computed number of blocks to extract: 2192
Extracting JRE from /media/sf_Downloads/WebAdaptor/WebAdaptor/Linux/Disk1/InstData/VM/install.bin to /tmp/install.dir.32735/Linux/resource/jre_padded ...
Extracting done, exit code = 0
Extracting JRE from /tmp/install.dir.32735/Linux/resource/jre_padded to /tmp/install.dir.32735/Linux/resource/vm.tar.Z ...
 Extracting done, exit code = 0
Unpacking the JRE...
gzip is /bin/gzip
 GZIP done.
 TAR done.
Extracting install.zip from /media/sf_Downloads/WebAdaptor/WebAdaptor/Linux/Disk1/InstData/VM/install.bin to /tmp/install.dir.32735/InstallerData/installer.padded ...
Extracting to padded done, exit code = 0
Extracting from padded to zip done, exit code = 0

========= Analyzing UNIX Environment =================================
Setting UNIX (linux) flavor specifics.
Importing UNIX environment into LAX properties.
Checking for POSIX awk.

========= Analyzing LAX ==============================================
LAX found............................ OK.
LAX properties read.................. OK.

========= Finding VM =================================================
Valid VM types.......................... 1.6+
Absolute LAX_VM path.................... /tmp/install.dir.32735/Linux/resource/jre/bin/java
Expanded Valid VM types.................  1.6+ 
Unzipping of installer.zip failed.
Using the Default JVM Search
Searching without JVM specs
* Using VM.....(lax.nl.current.vm)...... /tmp/install.dir.32735/Linux/resource/jre/bin/java

========= Virtual Machine Options ====================================
LAX properties incorporated............. OK.
classpath............................... "/tmp/install.dir.32735/InstallerData:/tmp/install.dir.32735/InstallerData/installer.zip"
main class.............................. "com.zerog.ia.installer.Main"
.lax file path.......................... "/tmp/install.dir.32735/temp.lax"
user directory.......................... "/tmp/install.dir.32735"
stdout to............................... "console"
sterr to................................ "console"
install directory....................... ""
JIT..................................... none
option (verify)......................... off
option (verbosity)...................... none
option (garbage collection extent)...... none
option (garbage collection thread)...... none
option (native stack max size).......... none
option (java stack max size)............ none
option (java heap max size)............. 201326592
option (java heap initial size)......... 16777216
option (lax.nl.java.option.additional).. none

========= Display settings ===========================================
X display............................... local
UI mode................................. silent
========= VM Command Line ============================================
options:   -Xmx201326592 -Xms16777216 
CLASSPATH:/tmp/install.dir.32735/InstallerData:/tmp/install.dir.32735/InstallerData/installer.zip:

========= Forking JAVA =============================================
LAX Version = 16.5
locale being set to: en

[AnalyzeSystemRequirements][install] Start
[AnalyzeSystemRequirements][install] Product=WebAdaptor
[AnalyzeSystemRequirements][checkUserHome] Start
[AnalyzeSystemRequirements][checkUserHome] /home/arcgis exists and is writable!
[AnalyzeSystemRequirements][checkUserHome] Finish
[AnalyzeSystemRequirements][install] Finish
[MiscUtils][getReleaseVersion] Simple version reported by setup: 10.6
[MiscUtils][runCommand][Threaded=false] About to execute: uname -n
[MiscUtils][runCommand][Threaded=false] StdOut Output: duster
[MiscUtils][runCommand][Threaded=false] StdErr Output: Ignored in non-threaded runCommand().
[MiscUtils][runCommand][Threaded=false] Exit Code    : 0
[MiscUtils][getESRIPropFilePath] ESRI.properties file path: /home/arcgis/.ESRI.properties.duster.10.6
[ReadESRIPropFile][install] ESRI prop file found at /home/arcgis/.ESRI.properties.duster.10.6
[PropertiesFileWrapper] Open existing prop file: /home/arcgis/.ESRI.properties.duster.10.6
[ReadESRIPropFile] Z_DEVKIT_HOME=
[ReadESRIPropFile] Z_ArcGISServer_INSTALL_DIR=/home/arcgis/server
[ReadESRIPropFile] Z_ENGINE_HOME=
[ReadESRIPropFile] Z_ArcGISDataStore_INSTALL_DIR=/home/arcgis/datastore
[ReadESRIPropFile] ARCLICENSEHOME=/home/arcgis/server/framework/runtime/.wine/drive_c/Program Files/ESRI/License10.6/sysgen
[ReadESRIPropFile] Z_WebGIS_INSTALL_DIR=/home/arcgis
[ReadESRIPropFile] ESRI_PROGRAM_FILES=
[ReadESRIPropFile] Z_ArcGISPortal_INSTALL_DIR=/home/arcgis/portal
[ReadESRIPropFile] Z_REAL_VERSION=10.6
[DetermineInstallDirWebAdaptor][install] InstallDir from IA: /home/arcgis/webadaptor10.6
[DetermineInstallDirWebAdaptor][install] Set USER_INSTALL_DIR to: /home/arcgis/webadaptor10.6/java
installUnixJRE:  the source VM tar: /tmp/install.dir.32735/Linux/resource/vm.tar
    exists = true
installUnixJRE:  the source VMRoot: /tmp/install.dir.32735/Linux/resource/jre
    exists = true
installUnixJRE:  the dest VMRoot: /home/arcgis/webadaptor10.6/java/.Setup/jre
    exists = true
#
# INSTALLING VM: /home/arcgis/webadaptor10.6/java/.Setup/jre
#

installUnixJRE: Using new TAR technique...
Destination path for tar extraction (sans 'jre') =
    /home/arcgis/webadaptor10.6/java/.Setup

installUnixJRE: install shell script:
#!/bin/sh
echo "InstallUnixJRE Script begun..."
cd '/home/arcgis/webadaptor10.6/java/.Setup/jre'
rm -rf  *''
cd '/home/arcgis/webadaptor10.6/java/.Setup'
tar xf '/tmp/install.dir.32735/Linux/resource/vm.tar'
chmod -R '755' '/home/arcgis/webadaptor10.6/java/.Setup/jre'
echo "...InstallUnixJRE Script complete."
##### SCRIPT END ############

XMLScriptWriter: No Installation Objects were skipped
[MiscUtils][getReleaseVersion] Simple version reported by setup: 10.6
[MiscUtils][runCommand][Threaded=false] About to execute: uname -n
[MiscUtils][runCommand][Threaded=false] StdOut Output: duster
[MiscUtils][runCommand][Threaded=false] StdErr Output: Ignored in non-threaded runCommand().
[MiscUtils][runCommand][Threaded=false] Exit Code    : 0
[MiscUtils][getESRIPropFilePath] ESRI.properties file path: /home/arcgis/.ESRI.properties.duster.10.6
[getCurrentESRIPropFilePath][install] Set ESRI_PROP_FILE_PATH to: /home/arcgis/.ESRI.properties.duster.10.6
[ReadESRIPropFile][install] ESRI prop file found at /home/arcgis/.ESRI.properties.duster.10.6
[PropertiesFileWrapper] Open existing prop file: /home/arcgis/.ESRI.properties.duster.10.6
[ReadESRIPropFile] Z_DEVKIT_HOME=
[ReadESRIPropFile] Z_ArcGISServer_INSTALL_DIR=/home/arcgis/server
[ReadESRIPropFile] Z_ENGINE_HOME=
[ReadESRIPropFile] Z_ArcGISDataStore_INSTALL_DIR=/home/arcgis/datastore
[ReadESRIPropFile] ARCLICENSEHOME=/home/arcgis/server/framework/runtime/.wine/drive_c/Program Files/ESRI/License10.6/sysgen
[ReadESRIPropFile] Z_WebGIS_INSTALL_DIR=/home/arcgis
[ReadESRIPropFile] ESRI_PROGRAM_FILES=
[ReadESRIPropFile] Z_ArcGISPortal_INSTALL_DIR=/home/arcgis/portal
[ReadESRIPropFile] Z_REAL_VERSION=10.6
[PropertiesFileWrapper] Open existing prop file: /home/arcgis/.ESRI.properties.duster.10.6
[PropFileUtils][setProperty] Set Z_WebAdaptor_INSTALL_DIR to /home/arcgis/webadaptor10.6/java in file /home/arcgis/.ESRI.properties.duster.10.6
[PropertiesFileWrapper][save] Saving /home/arcgis/.ESRI.properties.duster.10.6
[PropertiesFileWrapper] Open existing prop file: /home/arcgis/.ESRI.properties.duster.10.6
[PropFileUtils][setProperty] Set Z_REAL_VERSION to 10.6 in file /home/arcgis/.ESRI.properties.duster.10.6
[PropertiesFileWrapper][save] Saving /home/arcgis/.ESRI.properties.duster.10.6
[WriteESRIPropFile][install] PRODUCT_NAME: WebAdaptor
[PropertiesFileWrapper] Open existing prop file: /home/arcgis/.ESRI.properties.duster.10.6
[PropertiesFileWrapper][save] Saving /home/arcgis/.ESRI.properties.duster.10.6
[PropertiesFileWrapper][save] Saving /home/arcgis/.ESRI.properties.duster.10.6
[PropertiesFileWrapper][save] Saving /home/arcgis/.ESRI.properties.duster.10.6
Retrying Installables deferred in pass 0
Deferral retries done because: 
There were no deferrals in the last pass.
...ArcGIS Web Adaptor (Java Platform) 10.6 installation is complete.

Post-install work

Take another snapshot once it's running.

Set up the services to start automatically at boot. Or do it by hand...

ssh arcgis@duster
datastore/startdatastore.sh
server/startserver.sh
portal/startportal.sh

Versioning

When editing in ArcMap by default all edits are versioned.

https://desktop.arcgis.com/en/arcmap/latest/manage-data/geodatabases/changing-versions-in-arcmap.htm

"Change Version" is disabled (greyed out)

You can't change versions while an edit session is active.

Publishing a layer

I want the data to continue living in SQL Server so first I have to tell the server about it. They call this process registering.