Docker for Geoprocessing: Difference between revisions

From Wildsong
Jump to navigationJump to search
Brian Wilson (talk | contribs)
mNo edit summary
Brian Wilson (talk | contribs)
mNo edit summary
Line 6: Line 6:


On my home computer [[Murre]] which runs Windows 10, I needed to install
On my home computer [[Murre]] which runs Windows 10, I needed to install
* [https://visualstudiocode.com/ Visual Studio Code] for Windows with the extensions listed below
* [https://code.visualstudio.com/ Visual Studio Code] for Windows with the extensions listed below
* [https://docker.com/ Docker Desktop for Windows]
* [https://www.docker.com/products/docker-desktop Docker Desktop], for Windows
* [http://git-scm.com/ git for windows] because Visual Studio Code uses it
* [http://git-scm.com/ git for windows] because Visual Studio Code uses it
* [http://cygwin.com/ cygwin] so I'd have bash, maybe you don't care about bash and use Powershell instead?
* [http://cygwin.com/ cygwin] so I'd have bash, maybe you don't care about bash and use Powershell instead?
Line 22: Line 22:
The big picture is to create an elevation surface and then contours for Clatsop County from LiDAR data provided by DOGAMI.
The big picture is to create an elevation surface and then contours for Clatsop County from LiDAR data provided by DOGAMI.


I've created a Github project called [https://github.com/Wildsong/geoprocessing Wildsong/geoprocessing].
DOWNLOADER


Then I created another called [https://github.com/Wildsong/geoprocessing Wildsong/lidar_downloader]
I created https://github.com/Wildsong/geoprocessing Wildsong/lidar_downloader] to download all the data for the county
and got it working. This does no geoprocessing, it just grabs files from a remote server using a CSV full of URLs.
and got it working. This does no geoprocessing, it just grabs files from a remote server using a CSV full of URLs so it's not in a Docker (yet).
Now I have data at home to work with.
Now I have data at home to work with.


Still thinking about how to organize this.
DATA
 
I unpacked the zips here: /d/GIS/OR/DOGAMI/ClatsopCounty
 
MOSAICS
 
I am going to build VRT files using GDAL, so now I need the Docker.
I've created a Github project called [https://github.com/Wildsong/geoprocessing Wildsong/geoprocessing].

Revision as of 23:12, 24 March 2020

I am trying to get Geoprocessing jobs to run inside Docker so that they are more portable and easier to reuse across different machines.

COVID19 and WFH

COVID19 hit so I had to get set up to work at home. I had already been using git so my code was up there.

On my home computer Murre which runs Windows 10, I needed to install

What else? I'll add as I think of it.

VSCode extensions that I currently have installed

  • Debugger for Chrome
  • Docker
  • Python
  • Remote Development pack (includes Remote-Containers and Remote-SSH extensions)

The story so far

The big picture is to create an elevation surface and then contours for Clatsop County from LiDAR data provided by DOGAMI.

DOWNLOADER

I created https://github.com/Wildsong/geoprocessing Wildsong/lidar_downloader] to download all the data for the county and got it working. This does no geoprocessing, it just grabs files from a remote server using a CSV full of URLs so it's not in a Docker (yet). Now I have data at home to work with.

DATA

I unpacked the zips here: /d/GIS/OR/DOGAMI/ClatsopCounty

MOSAICS

I am going to build VRT files using GDAL, so now I need the Docker. I've created a Github project called Wildsong/geoprocessing.