Spatial New Features for Autonomous Cloud Services and

Oracle Database 19c

Siva Ravada, Senior Director of Development, Oracle
Oracle Spatial and Graph:
Natively manage all spatial content in the DB
Deployable Services Mapping Geocoding Routing Web Services (OGC)
• Core Geometry Storage
– Points, Lines, Polygons,
Collections, etc Polygons
Raster
• Specialized Data Storage
– Raster/Imagery
– Topology
– 3D
– Lidar
• Query and Analysis APIs
e1
(SQL, PL/SQL, Java, XML, f1 e3
OGC) Lines e2 n2
n1 f2 3D / LIDAR
• Deployable Java Services e4
Points Topologies
Networks

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | CVC Spatial Update for DWR
Spatial JSON support
• New JSON support in addition to GeoJSON
– The GeoJSON standard does not allow all the types and coordinate systems we support with SDO_GEOMETRY
– New JSON support is introduced to support all the data we can represent with SDO_GEOMETRY (both from and to
functions); this is in addition to the GeoJSON support introduced in 12.2.0.1
2D polygon: {"polygon": {"boundary": [{"line": {"datapoints": [[3.0, 0.0], [6.0, 0.0], [9.0, 3.0], [9.0, 6.0], [6.0,
9.0], [3.0, 9.0], [0.0, 6.0], [0.0, 3.0], [3.0, 0.0]]}}, {"line": {"datapoints": [[4.0, 2.0], [3.0, 3.0], [3.0, 4.0], [4.0,
5.0], [5.0, 5.0], [6.0, 4.0], [6.0, 3.0], [5.0, 2.0], [4.0, 2.0]]}}]}}
Voided Polygon (LRS 3303): Geodedic i/o rings connected by lines{"srid": 8307, "spatialdimension": 2,
"polygon": {"boundary": [{"line": {"datapoints": [[3.0, 0.0, 0.0], [6.0, 0.0, 3.0], [9.0, 3.0, 7.24264069], [9.0,
6.0, 10.2426407], [6.0, 9.0, 14.4852814], [3.0, 9.0, 17.4852814], [0.0, 6.0, 21.7279221], [0.0, 3.0,
24.7279221], [3.0, 0.0, 28.9705627]]}}, {"line": {"datapoints": [[4.0, 2.0, 28.9705627], [3.0, 3.0, 30.3847763],
[3.0, 4.0, 31.3847763], [4.0, 5.0, 32.7989899], [5.0, 5.0, 33.7989899]]}}]}}
• ORDS Support for Spatial operations is enabled using this feature

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted
Spatial operators without the index
• Data stored in an external table using text format for geometry
– NFS file, HDFS, Object Store, etc.
• Data from a JOIN view or some other complex view
• Spatial index not mandatory for using spatial operators
– Queries that use SDO_FILTER/SDO_RELATE, etc. can now be used even when there is no index on the table
– Spatial index is recommended when querying against the tables, but when queries need to be written against
views where the geometry data is constructed on the fly, this enhancement allows the queries to be written the
same way as if the data is coming from a table

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted
Spatial operators without the index
• Prior to 18c
select sdo_geom.SDO_DISTANCE(ci.geometry, SDO_GEOMETRY(tw.geometry, 4326), 0.05, 'UNIT=MILE'),
ci.name, tw.user_id
from CINEMA ci, TWEETS_EXT_TAB_FILE tw
where sdo_geom.WITHIN_DISTANCE(ci.geometry, 0.25, SDO_GEOMETRY(tw.geometry, 4326), 0.05,
'UNIT=MILE') = 'TRUE'

• In 18c
select sdo_geom.SDO_DISTANCE(ci.geometry, SDO_GEOMETRY(tw.geometry, 4326), 0.05, 'UNIT=MILE'),
ci.name, tw.user_id
from CINEMA ci, TWEETS_EXT_TAB_FILE tw
where SDO_WITHIN_DISTANCE(ci.geometry, SDO_GEOMETRY(tw.geometry, 4326),
'DISTANCE=0.25 UNIT=MILE') = 'TRUE'

• Turn this off with an DB init parameter

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted
Support distributed transactions
• The use of R-tree spatial indexes is not
supported in distributed and Oracle XA
transactions
– This is a restriction prior to the 18.1 release
• Enables web applications that modify spatial
data
• What we did
– Use regular tables instead of global temporary tables
for managing the transaction data when the
transaction is marked as XA

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted
Sharding in the DB
• Oracle Sharding is a scalability and
availability feature for custom-
designed OLTP applications that
enables distribution and replication
of data across a pool of Oracle
databases that do not share
hardware or software
• The pool of databases is presented
to the application as a single logical
database.

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 10
Spatial Specific Sharding concepts
• USER_SDO_GEOM_METADATA is created on each shard separately
– This is a pain now, we are looking to remove this restriction so that coordinator can do this
• All DDL (create index, alter index, etc.) are performed on the coordinator and they are
automatically propagated to the shards
• All queries that need to "cross-shards" are performed on the coordinator and are
automatically aggregated and shard-specific queries are performed on the individual
shards

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted
Location tracking Server

• Track objects against a set of • Track objects within a set of

polygons and generate polygons and generate
notifications when the moving notifications when the moving
objects enter the regions of objects leaves the regions of
interest interest

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 12

Tracking Server
• Tracker object notification types
– ‘I’ alert when object enters a region
– ‘O’ alert when the object leaves a region
– ‘U’ alert whenever the object state changes from inside->outside or outside->inside
• Notification Message
– ‘E’ generates a message when the alert condition is true
– ‘T’ generates a message when the alert condition flips between ‘I’ and ‘O’
• Tracking can be dynamically turned off for moving objects
– isActive: 'Y’ or ‘N’
• New Java API to enable Java applications

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 13
Location tracker Performance
• Linux Server: 8GB, 8 CPUs
• 9 regions, 900 objects tracked
– 100 steps in all regions, 810,000 polygon checks: (secs)40.42
– 1000 steps in all regions, 8,100,000 polygon checks: (min:sec) 6:08
– 10,000 steps in all regions, 81 million polygon checks: (min:sec) 48:34
– 100,000 steps all regions, 810 million polygon checks (hrs:min) 6:47
• A little round math shows each object having it’s location updated around
4 times a second

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 14
Map Visualization
• Dynamic Tile Layer
– Define tile layer dynamically in the V2 API (instead of pre-built in the server and
stored permanently in metadata view)
– Specify or change rendering style as needed
– Server generates tile images just like regular tile layer
• Supports large and complex queries, without unnecessary storage and
management overhead

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 15
Offline map cache
• Export and use tile images for offline usage
• User can select areas and zoom levels to generate the tiles
• The tiles can be compressed and downloaded
• V2 API changes have been made so that the tiles can be used even in off-
line mode (w/o connection to backend MapViewer server or database)

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 16
Vector Tiles
• Single layer vector tile generation
– MapViewer can now generate vector tiles in
the 'industry standard' vector tiles
– Requests look like this:

http://localhost:8080/mapviewer/vt/THEM
E_CUSTOMERS/8/41/99.mvt
– Any client mapping API that supports vector
tiles can utilize it (OpenLayers, MapBox GL JS)
– The screenshot showing the tax drop locations
(point dataset) as vector tiles

• Not supported for base maps

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 17
GeoRaster 18c New Features
• GDAL is Integrated into Oracle Database
– The new SDO_GEOR_GDAL Package integrates GDAL into Oracle database server
– It provides server-side raster data loading, exporting, and in-database terrain analysis capabilities
– It also enables and simplifies development of C/C++ plug-ins through the GDAL API
• Supports On-the-fly Image Processing
– equalize, normalize, piecewise stretch, stretch, and filter
• New Statistics on Virtual Mosaics
– New SDO_GEOR_AGGR.getMosaicStatistics Procedure generates statistics and histogram for virtual mosaics
enabling better visualization of virtual mosaics
• 4GB Limit Removed for External JPEG 2000 Image Files
– Large JPEG 2000 images can now be fast loaded into database without decompression
• Java API and GeoRaster Viewer Enhancements
– Java API supports all new features and the Viewer displays large images and virtual mosaics better

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Example – Image Mosaic with Histogram Matching

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 19

GeoRaster 19c New Features
• Supports On-the-fly Raster Algebra
– All subprograms in the SDP_GEOR_RA package support putting the result data in temporary BLOB so that users
can do raster analysis and cartographic modeling on-the-fly to support various real time applications
– Supported in both PL/SQL API and JAVA API
• GeoRaster Must Be Enabled at Schema Level
– Previously GeoRaster is enabled for the whole database
– This enhances database security for the cloud

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Web Services Support
• Console Enhancements
– The Spatial Web Services administration console for WFS, WCS, and CSW is enhanced
with standard user interfaces, as well as multiple data sources management
capabilities
– Make it easy to publish vector and raster data using console menu options (no code
required)
• The OpenGIS Catalogue Services Specification (CSW) 2.0.2
– ISO Metadata Application Profile is supported
• Multiple data source support
– WFS/CS-W/WCS can support reading the data from multiple data sources in the same
WLS instance

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 21
OGC Services: Multiple data sources
• Multiple data source support
– WFS/CS-W/WCS can support reading the data from multiple data sources in the same
WLS instance

http://<machine-name:port>/oraclespatial/wfs/<data source
name>?request=GetCapabilities&service=WFS&version=1.1.0

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 22
Autonomous Completes the Journey
Brings Full Automation to Entire Database Lifecycle

ORACLE ORACLE
AUTONOMOUS CLOUD
DATABASE

Complete Complete Automated

Infrastructure Database Data Center Operations
Automation Automation and Machine Learning

World’s First Autonomous Database

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 23

One Autonomous Database - Optimized by Workload

ORACLE
AUTONOMOUS
DATABASE
Available March 2018 Available August 2018

Autonomous Autonomous
Data Warehouse (ADW) Transaction Processing (ATP)
Best for all Analytic Workloads: Best for TP and Mixed Workloads:
• Data Warehouse, Data Mart • Transactions, Batch, Reporting, IoT
• Data Lake, Machine Learning • Application Dev, Machine Learning

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 24

Instant Elasticity: Pay for Exactly What you Use
• Size the DW to the exact number of OPCU’s and TB’s required
– Not constrained by fixed building blocks
• Scale the DW on demand
– Independently scale compute or storage
– Resizing occurs instantly, fully online
• Shut off idle compute save money
– Restart instantly

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Confidential
Oracle Data Visualization Desktop

• Self-service data exploration for

business users
– Rich, interactive visualizations
• Included with ADW*
– Also available as cloud version within
Oracle Analytics Cloud

* May be be use with ADW at no added cost

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 26

ATP and Autonomous related changes
• In ATP, Data Vault is enabled by default to protect customer data
• This means, Oracle created accounts cannot read the customer data
• MDSYS can no longer directly manage the index, statistics, and other
metadata data stored in the user schemas
– Security model and package execution model has to be changed so that everything
gets executed as the user
• All the J2EE components have to support the secure TNS protocol by
default
• The J2EE components re-packaged as Cloud Market place components

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 27
Spatial in ADW/ATP-Shared
• About 80% Spatial functionality in the DB is enabled by default
• No JAVAVM support in the current release
– The following are excluded due to no JAVAVM
• Topology
• Geocoder in the DB
• 3D functions (including LIDAR)
• Network Data Model and Routing Engine

• Following will be supported in 2020

• Spatial Visualization (MapViewer)
• OGC Services
• GeoRaster
• J2EE Geocoder

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Confidential
Oracle Spatial and Graph:
Natively manage all spatial content in the DB
Oracle Cloud Deployable Services Mapping Geocoding Routing Web Services (OGC)

Market Place
Polygons
Raster

Autonomous DB
e1
f1 e3
Lines e2 n2
n1 f2 3D / LIDAR
e4
Points Topologies
Networks

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | CVC Spatial Update for DWR
Spatial in ATP-Dedicated
• All the Spatial features in the DB are supported
• All of the J2EE components will be shipped as plugins in Oracle Cloud
Market Place
– Work in progress to make these components deployable from Cloud Market place
• Following will be supported in 2020
• Spatial Visualization (MapViewer)
• OGC Services
• J2EE Geocoder
• Network Data Model
• Routing Engine

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Confidential
Engage with the Spatial and Graph SIG
Promotes interaction and • Talk with us at the Summit!
communication to drive •
the market for spatial Morning Arrivals Receptions Birds of a Feather
technology and data Tues & Wed Tues & Wed Lunch
7:45-8:30 a.m. evenings Wednesday
Registration Area Spatial Table, 12-1pm
Members connect and lobby Auditorium
exchange knowledge via
online communities and
at conferences and • Join us online
events • tinyurl.com/oraclespatialcommunity
• Search for “Oracle Spatial and Graph Community”
• Contact us:
oraclespatialsig@gmail.com @oraspatialsig

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |