On Mon, Apr 25, 2022 at 9:38 PM Martin Budaj <m.budaj@gmail.com> wrote:

On Mon, Apr 25, 2022 at 11:27 AM Bruce Mutton <bruce@tomo.co.nz> wrote:

...

Before reporting this I thought I'd better at least try 6.0.6+3bc6556

I get a crash right away as the therion.log transcript below indicates.

OK, I could reproduce it and will fix it soon.

Should be fixed in 14fac78. Martin

Besides that, I cant compile due to missing deps. Does someone already have info on what debian packages i need to install? g++ -DIMG_API_VERSION=1 -Wall -DTHLINUX -O2 -DPROJ_VER=9 -I/usr/include -Iextern -Iextern/shapelib -Iextern/fmt/include -std=c++14 -o ./therion therion-main.cxx ./thdate.o ./extern/shapelib/shpopen.o ./extern/shapelib/dbfopen.o ./extern/shapelib/safileio.o ./thbuffer.o ./thmbuffer.o ./thlogfile.o ./thtmpdir.o ./thlocale.o ./thparse.o ./thcmdline.o ./thconfig.o ./thinput.o ./thchenc.o ./thdatabase.o ./thdataobject.o ./thdatareader.o ./thsurvey.o ./thendsurvey.o ./thdata.o ./thperson.o ./thtf.o ./thtfangle.o ./thtflength.o ./thtfpwf.o ./thdataleg.o ./thobjectname.o ./thinfnan.o ./thlayout.o ./thlookup.o ./thcomment.o ./thinit.o ./thdb1d.o ./thsvxctrl.o ./thdatastation.o ./thobjectid.o ./thobjectsrc.o ./thgrade.o ./thlibrary.o ./thgeomag.o ./thbezier.o ./thexport.o ./thexporter.o ./thselector.o ./extern/img.o ./thexpmodel.o ./thdb2d00.o ./thscrapis.o ./thcs.o ./thcsdata.o ./thexptable.o ./thdb2d.o ./thscrap.o ./thendscrap.o ./th2ddataobject.o ./thdb2dprj.o ./thdb2dpt.o ./thdb2dlp.o ./thdb2dab.o ./thdb2dji.o ./thdb2dmi.o ./thdb2dcp.o ./thdb2dxm.o ./thdb2dxs.o ./thscraplo.o ./thscraplp.o ./thscrapen.o ./thpoint.o ./thline.o ./tharea.o ./thlegenddata.o ./thmpost.o ./thsymbolsets.o ./thjoin.o ./thmap.o ./thexpmap.o ./thlayoutln.o ./thlayoutclr.o ./thexpsys.o ./thexpuni.o ./thconvert.o ./thpdf.o ./thpdfdbg.o ./thpdfdata.o ./thtexfonts.o ./thsymbolset.o ./thlang.o ./thmapstat.o ./thexpdb.o ./thpic.o ./thsketch.o ./thproj.o ./extern/lxMath.o ./extern/lxFile.o ./thdb3d.o ./thsurface.o ./thimport.o ./thsvg.o ./thepsparse.o ./thtrans.o ./thwarpp.o ./thwarppt.o ./thwarppme.o ./thwarp.o ./thexpshp.o ./thattr.o ./thtex.o ./extern/poly2tri/common/shapes.o ./extern/poly2tri/sweep/advancing_front.o ./extern/poly2tri/sweep/sweep.o ./extern/poly2tri/sweep/cdt.o ./extern/poly2tri/sweep/sweep_context.o ./extern/fmt/src/format.o ./extern/fmt/src/os.o ./extern/quickhull/QuickHull.o ./therion.o -s -L/usr/lib/x86_64-linux-gnu/mit-krb5 -lproj -lpthread -lstdc++ -lm -lsqlite3 -lm -ldl -lz -lpthread -ltiff -lwebp -lzstd -llzma -ljbig -ljpeg -ldeflate -lz -lm -lcurl -lnghttp2 -lidn2 -lrtmp -lssh2 -lpsl -lssl -lcrypto -lssl -lcrypto -lgssapi_krb5 -llber -lldap -llber -lzstd -lbrotlidec -lz -pthread /usr/bin/ld: cannot find -lnghttp2: Datei oder Verzeichnis nicht gefunden /usr/bin/ld: cannot find -lidn2: Datei oder Verzeichnis nicht gefunden /usr/bin/ld: cannot find -lrtmp: Datei oder Verzeichnis nicht gefunden /usr/bin/ld: cannot find -lssh2: Datei oder Verzeichnis nicht gefunden /usr/bin/ld: cannot find -lpsl: Datei oder Verzeichnis nicht gefunden /usr/bin/ld: cannot find -lgssapi_krb5: Datei oder Verzeichnis nicht gefunden /usr/bin/ld: cannot find -llber: Datei oder Verzeichnis nicht gefunden /usr/bin/ld: cannot find -lldap: Datei oder Verzeichnis nicht gefunden /usr/bin/ld: cannot find -llber: Datei oder Verzeichnis nicht gefunden collect2: error: ld returned 1 exit status make: *** [Makefile:186: therion] Fehler 1 Am 2022-04-26 11:45, schrieb Bruce Mutton:

Thanks Martin

14fac78 solved both the proj download related crash and the ~100 m positional error for lat-long and NZTM fixed points. I have attached a cut down version of the therion.log file that was produced.

I am a little confused, as Therion automatically downloaded the grid and yet my therion.ini does not have any of the proj-auto or proj-missing-grid settings mentioned in the 14fac78 Therion Book pg 86-87, which raises for me many questions. I assume the functionality of those ini statements is now superseded by the proj.ini that is now present in the install folders (as you described as "use the best transformation and download the grids if needed") and that the Therion Book is yet to be updated?

Or maybe I am not looking I the correct place for the ini files that Therion is actually using?

Can Therion be run without having internet access (or without first having had internet access for a particular survey dataset at some previous time)?

In the attached file, do the transformations marked [no] and [yes] relate to whether they are used or not?

And presumably the accuracies listed are the estimated accuracies?

Can I use proj-missing-grid to improve the accuracy of my example further or is 4m accuracy the best I am likely to get for this particular dataset?

Regards

Bruce

From: Therion <therion-bounces@speleo.sk> On Behalf Of Bruce Mutton Sent: Monday, 25 April 2022 21:12 To: 'List for Therion users' <therion@speleo.sk> Subject: [Therion] Problem with new default settings and recent proj changes

Martin

Something bad happened between 6.0.0 and 6.0.5 that we only just noticed today (because for day to day work we only compile small sections of the cave).

Therion 6.05 has moved some of our fixed stations about 100 m north (those specified with cs lat-long and cs EPSG:2193 NZTM) and others (specified with cs EPSG:27200 NZMG) stayed in their correct locations, severely distorting our cave. No errors reported, just outputs with large loop errors and distorted cave.

Interestingly, it is the old archaic format NZMG that performs correctly and the modern and lat-long are relocated.

The image below is located with NZMG, as is the cave entrance in the centre. The cave entrances left and right are located with either lat-long or NZTM.

Before reporting this I thought I'd better at least try 6.0.6+3bc6556

I get a crash right away as the therion.log transcript below indicates.

therion 6.0.6+3bc6556 (2022-04-21)

- using Proj 9.0.0, compiled against 9.0.0

initialization file: C:\Program Files (x86)\Therion/therion.ini

reading ... done

configuration file: thconfig-GLMESM_System5000Map.thc

reading ... done

reading source files ... downloading the grid https://cdn.proj.org/nz_linz_nzgd2kgrid0005.tif...

C:\Program Files (x86)\Therion\therion.exe: error -- couldn't download the grid

writing xtherion file ... done

Should I be using one of the new cs-trans or proj-* commands or is there something else?

Regards

Bruce

-----Original Message----- From: Therion <therion-bounces@speleo.sk> On Behalf Of Martin Budaj Sent: Friday, 22 April 2022 07:32 To: List for Therion users <therion@speleo.sk> Subject: [Therion] new default settings

Hi all,

Therion has been supporting the advanced features of the Proj library for some time now. (Proj's purpose is to do transformations between coordinate systems.) This functionality was disabled by default and you could enable it using 'proj-auto' and 'proj-missing-grid' options in the initialization file.

'proj-auto' lets Proj choose the best transformation and you can set 'proj-missing-grid' to download a grid file (see

https://proj.org/usage/transformation.html#grid-based-datum-adjustments)

if the transformation needs it; see the therion book for details. The log file lists all the transformations chosen and used at the end.

The latest commit (3bc6556) enables this "use the best transformation and download the grids if needed" functionality. We know that automatic downloads are a sensitive issue, but in this case we can trust the Proj library not to do any harm

( https://proj.org/usage/network.html ) and the user experience is much better.

Could you check if this version works well with your data sets? The windows installer is available here:

https://github.com/therion/therion/actions/runs/2203811478 (use the

msys2 version which uses up-to-date Proj library; you need to be logged in to github to download it).

M.

_______________________________________________

Therion mailing list

Therion@speleo.sk

https://mailman.speleo.sk/listinfo/therion [1]

Links: ------ [1] https://mailman.speleo.sk/listinfo/therion _______________________________________________ Therion mailing list Therion@speleo.sk https://mailman.speleo.sk/listinfo/therion

Yes, seems excessive. Why ldap?

Am 26.04.2022 um 14:40 schrieb Wookey <wookey@wookware.org>:

On 2022-04-26 12:40 +0200, Benedikt Hallinger wrote:

...

Besides that, I cant compile due to missing deps. Does someone already have info on what debian packages i need to install?

The list in https://sources.debian.org/src/therion/6.0.6-1/debian/control/ should be sufficient, unless some new dependency has been introduced by 6.06

Build-Depends: dpkg (>=1.16.2), debhelper, debhelper-compat (=13), perl (>= 5.5), tcl, libvtk9-dev, libwxgtk3.0-gtk3-dev, libfreetype6-dev, libjpeg-dev, libpng-dev, pkg-config, texlive-base, libproj-dev, libsqlite3-tcl, python3, libshp-dev, catch2, cmake, ninja-build, libfmt-dev Build-Depends-Indep: texlive-metapost, imagemagick, ghostscript

...

-L/usr/lib/x86_64-linux-gnu/mit-krb5 -lproj -lpthread -lstdc++ -lm -lsqlite3 -lm -ldl -lz -lpthread -ltiff -lwebp -lzstd -llzma -ljbig -ljpeg -ldeflate -lz -lm -lcurl -lnghttp2 -lidn2 -lrtmp -lssh2 -lpsl -lssl -lcrypto -lssl -lcrypto -lgssapi_krb5 -llber -lldap -llber -lzstd -lbrotlidec -lz -pthread /usr/bin/ld: cannot find -lnghttp2: Datei oder Verzeichnis nicht gefunden /usr/bin/ld: cannot find -lidn2: Datei oder Verzeichnis nicht gefunden /usr/bin/ld: cannot find -lrtmp: Datei oder Verzeichnis nicht gefunden /usr/bin/ld: cannot find -lssh2: Datei oder Verzeichnis nicht gefunden /usr/bin/ld: cannot find -lpsl: Datei oder Verzeichnis nicht gefunden /usr/bin/ld: cannot find -lgssapi_krb5: Datei oder Verzeichnis nicht gefunden /usr/bin/ld: cannot find -llber: Datei oder Verzeichnis nicht gefunden /usr/bin/ld: cannot find -lldap: Datei oder Verzeichnis nicht gefunden /usr/bin/ld: cannot find -llber: Datei oder Verzeichnis nicht gefunden

This does seem to be a pile of new dependencies: libnghttp2-dev, libidn2-dev, librtmp-dev, libssh2-1-dev, libpsl-dev, libkrb5-dev, libldb-dev, lidldap-dev.

Put that lot in and it should build.

Is that all from libproj's online download facility? ssh, kerberos, ldap, real-time streaming? Seems excessive.

Wookey -- Principal hats: Debian, Wookware, ARM http://wookware.org/ _______________________________________________ Therion mailing list Therion@speleo.sk https://mailman.speleo.sk/listinfo/therion

On Tue, Apr 26, 2022 at 11:45 AM Bruce Mutton <bruce@tomo.co.nz> wrote:

I am a little confused, as Therion automatically downloaded the grid and yet my therion.ini does not have any of the proj-auto or proj-missing-grid settings mentioned in the 14fac78 Therion Book pg 86-87, which raises for me many questions. I assume the functionality of those ini statements is now superseded by the proj.ini that is now present in the install folders (as you described as "use the best transformation and download the grids if needed") and that the Therion Book is yet to be updated?

Indeed, thbook needs an update. Now, proj-auto is 'on' by default and proj-missing-grid is 'download'.

Or maybe I am not looking I the correct place for the ini files that Therion is actually using?

If the setting is missing in therion.ini, therion just uses the defaults. You can always override them in the therion.ini file.

Can Therion be run without having internet access (or without first having had internet access for a particular survey dataset at some previous time)?

Definitely. With the new defaults, it would attempt to download the grid (only if proj can't find it locally) and end with an error message if there is no internet connection. You can do either of these: * change the proj-missing-grid setting to warn, e.g. (this prints a warning stating which grid you need to download manually, then download it and put somewhere where proj finds it) * set proj-auto off (this is the old behaviour where proj doesn't look for the optimal transformation) * get online, run therion once, and the grids would be reused in the subsequent runs without internet connection

In the attached file, do the transformations marked [no] and [yes] relate to whether they are used or not?

All listed transformations are used. AoU: [no] or [yes] indicates, whether proj optimised a transformation for your particular area (defined by the fixed stations in your data set) [yes] or not [no].

And presumably the accuracies listed are the estimated accuracies?

Yes, estimated by proj.

Can I use proj-missing-grid to improve the accuracy of my example further or is 4m accuracy the best I am likely to get for this particular dataset?

Sure, the accuracy when using grids should be in centimeters. It's interesting that in your log file the grid is downloaded (twice!) but not actually used by proj, it would be worth investigating why. Anyway, for cases when you think you can do better than proj (including using a grid file), you can use 'cs-trans' to define a custom transformation between two coordinate systems; see an example in thbook. Probably your local GIS community has already defined such transformations; in the case of Slovakia, our cartographic office published such a list for QGIS users, which can be easily adopted for therion. Martin