Digital Elevation Models (DEM) generated from Unmanned Aerial Vehicle (UAV) photogrammetry offer opportunities for on-demand DEM production in environmental modelling. The »Lightweight UAV digital elevation models and orthoimagery for environmental applications« article (International Journal of Remote Sensing, Feb 2017) presents some interesting results of the study, how progressive numbers of Ground Control Points (GCP) effect on the DEM and orthoimage accuracies.
In the study the following specific questions were addressed:
- What orthoimage and DEM accuracies can be achieved without using exterior GNSS ground referencing data?
- What improvements in DEM and orthoimage accuracy can be achieved using progressive numbers of GCPs
The results of the research were intended for use in environmental projects such as flood studies and flood risk simulations, where the accuracy of the DEM is particularly important, but the study is also interesting for other fields of application.
The survey area was comprised of 29 Ha of urban parkland in the City of Glasgow, Scotland in the United Kingdom.
The aerial survey was carried out using a SenseFly Swinglet CAM UAV. A survey plan was set up using the SenseFly E-motion software, specifying a minimum image endlap & sidelap of 80%, with no segment of the survey extending outside a 500 m line of sight radius from the intended flight launch point. A maximum flying height of 90m above launch height was selected, generating a ground pixel size of approximately 3.5 cm x 3.5cm.
The ground targets consisted of 20cm x 20cm black and white 4-panel checkerboard grids printed and laminated at A4 size. These were nailed to the ground surface at the locations outlined in the target plan immediately before the aerial survey. The XYZ coordinates of the centre points of the in-situ targets were then re-surveyed with the Leica GS08 GNSS receiver, generating a set of high accuracy XYZ coordinates for all 61 target locations.
A new orthoimage and DEM was produced for each of six subsets of the full 61 GCP set. These subsets consisted of: 5, 10, 15, 30, 45 and 61 GCPs. This progressive introduction of additional GCPs was undertaken in order to demonstrate the orthoimage and DEM accuracies that were achievable using differing numbers of ground control points. This information may be of interest to those who are considering the use of UAV DEM data in environmental modelling applications, helping to approximate the numbers of GCPs that may typically be required to achieve the accuracy required for a given application. The spatial distribution of each GCP subset was selected to achieve an approximately equal separation in each case (approximately 1 GCP for every 2 Hectares). Successive subsets encapsulated the previous set, adding further GCPs to that set (Picture 1). In total (including the orthoimage and DEM that were generated using interior orientation) this produced a final tally of seven sets of orthoimages and DEMs.
Picture 1
Orthoimage and DEM accuracy
Photogrammetric processing was carried out using Agisoft PhotoScan Professional. The accuracies of orthoimages and DEMs were quantified in PhotoScan, with some additional external checks being performed in ArcGIS.
The table below shows the RMSE (Root Mean Square Error) accuracy statistics for all seven orthoimages and DEMs that were generated via photogrammetric processing. More detailed statistics are published in the original article.
NUMBER OF GCPs |
|||||||
0 |
5 | 10 | 15 | 30 | 45 |
61 |
|
(Orthoimage) Mean xy error |
2.90 m |
0.28 m |
0.13 m |
0.046 m |
0.046 m |
0.046 m |
0.05 m |
(Orthoimage) RMSE xy error |
3.265 m |
– | – | 0.076 m |
– |
– |
0.074 m |
(DEM) RMSE z |
2.20 m |
1.31 m |
0.34 m |
0.08 m | 0.08 m |
0.08 m |
0.09 m |
Table: RMSE accuracy statistics for all seven orthoimages and DEMs
Accuracies achieved using internal orientation only (no GCPs)
The zero-GCP orthoimage appeared at first glance to achieve generally good horizontal accuracies, but even a visual comparison of feature edges with national mapping agency 1:10,000 vector data indicated that some horizontal errors were apparent: positioning errors of up to 6m, and mean errors of just under 3m (RMSE XY 3.265). Errors were generally smaller in portions of the survey area that were at similar elevations to the launch point, but were approximately twice as large elsewhere.
The DEM that was generated from internal positioning and orientation data (i.e. the zero GCP DEM) was characterised by elevation errors that ranged up to 6m, with 95% of these errors as large as 5m, and with an overall RMS elevation error of 2.2m. This DEM also failed to represent all but the most prominent 3D features (a few buildings were vaguely discernible in the data) presenting an unrealistically smooth model of the topography.
Data accuracy using a small number of GCPs
Using as a little as 5 GCPs for orthoimage generation produced significantly improved results. Mean horizontal orthoimage errors reduced to 0.28m, suggesting that even a relatively small number of external GNSS GCPs (one for every 6 hectares when 5 GCPs were used) may produce a useable orthoimage. Doubling the number of GCPs to 10 produced additional marked improvements, with mean horizontal errors reducing to 0.14m.
The DEM generated using 5 GCPs performed better as well. The overall RMS elevation error was reduced to 1.3 m. The 10 GCP DEM performed even better, with the overall RMS error for elevation of 0.34m.
Orthoimage and DEM accuracy improved very substantially when 15 GCPs were used. Orthoimage positioning errors in this case reduced to a total range of under 0.4m and with an overall RMS horizontal error of 0.08m.
Data accuracy using larger numbers of GCPs
Orthoimages generated using 30, 45 and 61 GCPs were characterised by very similar accuracies to when 15 GCPs were used. Maximum horizontal errors remained the same, and mean x and mean y errors reduced very slightly. Marginally smaller RMS positioning errors were observed compared to the 15 GCP orthoimage.
DEMs derived from the use of 30, 45 GCPs were characterised by almost identical elevation errors as when 15 GCPs were used also, with an identical RMSE of 0.08m being achieved in these cases. No further increases in elevation accuracy were observed in the 61 GCP DEM, where RMS elevation errors were 0.09m.
Summarised Conclusions
- Orthoimagery generated using internal positioning and orientation was not accurate enough to be used as a large-scale mapping product
- The DEM that was created using internal positioning and orientation sensors was characterised by elevation errors that were too large to be used in any environmental modelling application
- Good orthoimage accuracies were achieved using as few as one ground control point for every 6 hectares of ground area
- Exceptionally accurate orthoimages and DEMs were generated when using approximately one GCP for every 2 hectares of ground area
- Doubling and re-doubling the number of GCPs produced no better results
Original article: Lightweight UAV digital elevation models and orthoimagery for environmental applications (International Journal of Remote Sensing, Feb 2017)