firethorn

changeset 4233:fffadd6887cb

Notes and New Deploy
author Stelios <stv@roe.ac.uk>
date Sat May 11 00:07:50 2019 +0300 (2019-05-11)
parents 5e46b62423d3
children f573b002a9ae
files doc/notes/stv/20190510-TAP-Deploy.txt doc/notes/stv/20190510-TAPlint.txt
line diff
     1.1 --- /dev/null	Thu Jan 01 00:00:00 1970 +0000
     1.2 +++ b/doc/notes/stv/20190510-TAP-Deploy.txt	Sat May 11 00:07:50 2019 +0300
     1.3 @@ -0,0 +1,591 @@
     1.4 +#
     1.5 +# <meta:header>
     1.6 +#   <meta:licence>
     1.7 +#     Copyright (c) 2018, ROE (http://www.roe.ac.uk/)
     1.8 +#
     1.9 +#     This information is free software: you can redistribute it and/or modify
    1.10 +#     it under the terms of the GNU General Public License as published by
    1.11 +#     the Free Software Foundation, either version 3 of the License, or
    1.12 +#     (at your option) any later version.
    1.13 +#
    1.14 +#     This information is distributed in the hope that it will be useful,
    1.15 +#     but WITHOUT ANY WARRANTY; without even the implied warranty of
    1.16 +#     MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
    1.17 +#     GNU General Public License for more details.
    1.18 +#  
    1.19 +#     You should have received a copy of the GNU General Public License
    1.20 +#     along with this program.  If not, see <http://www.gnu.org/licenses/>.
    1.21 +#   </meta:licence>
    1.22 +# </meta:header>
    1.23 +#
    1.24 +#
    1.25 +
    1.26 +##########################################################
    1.27 +##### Notes on Deploying WFAU TAP Services on trop02 #####
    1.28 +##########################################################
    1.29 +stv@trop02:~$ createvm
    1.30 +
    1.31 +INFO : Base pool  [base]
    1.32 +INFO : Live pool  [live]
    1.33 +INFO : Connection [qemu:///system]
    1.34 +
    1.35 +INFO : Data path  [/var/local/projects/ischnura/github/src/dat]
    1.36 +
    1.37 +INFO : Machines   [/var/local/projects/ischnura/github/src/dat/tropo-machines.txt]
    1.38 +INFO : Template   [/var/local/projects/ischnura/github/src/dat/tropo-template.xml]
    1.39 +
    1.40 +[1] Araybwyn
    1.41 +[2] Lothigometh
    1.42 +[3] Ulov
    1.43 +[4] Dwiema
    1.44 +[5] Ibalehar
    1.45 +[6] Eterathiel
    1.46 +[7] Siamond
    1.47 +[8] Acilamwen
    1.48 +Select machine name (1) ^C
    1.49 +stv@trop02:~$ virsh -c 'qemu:///system' list --all
    1.50 +setlocale: No such file or directory
    1.51 + Id    Name                           State
    1.52 +----------------------------------------------------
    1.53 + 3     Acilamwen                      running
    1.54 + 10    Ulov                           running
    1.55 + 11    Araybwyn                       running
    1.56 + -     Eterathiel                     shut off
    1.57 + -     Ibalehar                       shut off
    1.58 + -     Lothigometh                    shut off
    1.59 +
    1.60 +stv@trop02:~$ ^C
    1.61 +stv@trop02:~$ createvm
    1.62 +
    1.63 +INFO : Base pool  [base]
    1.64 +INFO : Live pool  [live]
    1.65 +INFO : Connection [qemu:///system]
    1.66 +
    1.67 +INFO : Data path  [/var/local/projects/ischnura/github/src/dat]
    1.68 +
    1.69 +INFO : Machines   [/var/local/projects/ischnura/github/src/dat/tropo-machines.txt]
    1.70 +INFO : Template   [/var/local/projects/ischnura/github/src/dat/tropo-template.xml]
    1.71 +
    1.72 +[1] Araybwyn
    1.73 +[2] Lothigometh
    1.74 +[3] Ulov
    1.75 +[4] Dwiema
    1.76 +[5] Ibalehar
    1.77 +[6] Eterathiel
    1.78 +[7] Siamond
    1.79 +[8] Acilamwen
    1.80 +Select machine name (1) 2
    1.81 +setlocale: No such file or directory
    1.82 +
    1.83 +[1] fedora-28-docker-base-20180708.qcow
    1.84 +[2] fedora-28-8G-docker-base-20181016.qcow
    1.85 +[3] fedora-28-32G-docker-base-20181016.qcow
    1.86 +[4] fedora-28-16G-docker-base-20181016.qcow
    1.87 +Select base image (1) 3
    1.88 +setlocale: No such file or directory
    1.89 +
    1.90 +INFO : Node name [Lothigometh]
    1.91 +INFO : Base name [fedora-28-32G-docker-base-20181016.qcow]
    1.92 +INFO : Base path [/var/lib/libvirt/images/base/fedora-28-32G-docker-base-20181016.qcow]
    1.93 +INFO : Disc name [Lothigometh.qcow]
    1.94 +INFO : Disc size [32GiB]
    1.95 +
    1.96 +INFO : MAC  [52:54:00:02:02:09]
    1.97 +INFO : IPv4 [192.168.202.9]
    1.98 +INFO : IPv6 []
    1.99 +
   1.100 +Create virtual machine (Y/n)Y
   1.101 +
   1.102 +Found existing virtual machine [Lothigometh]
   1.103 +Delete existing virtual machine (Y/n)Y
   1.104 +setlocale: No such file or directory
   1.105 +Delete associated storage (Y/n)Y
   1.106 +Deleting virtual machine [Lothigometh]
   1.107 +setlocale: No such file or directory
   1.108 +Domain 03d2d8cc-581f-4cf2-ae93-6f0ca29ad6cb has been undefined
   1.109 +Volume 'vda'(/libvirt/storage/live/Lothigometh.qcow) removed.
   1.110 +Volume 'vdb'(/var/lib/libvirt/images/init/Lothigometh.iso) removed.
   1.111 +
   1.112 +Creating new volume [Lothigometh.qcow]
   1.113 +setlocale: No such file or directory
   1.114 +Vol Lothigometh.qcow created
   1.115 +setlocale: No such file or directory
   1.116 +Name:           Lothigometh.qcow
   1.117 +Type:           file
   1.118 +Capacity:       32.00 GiB
   1.119 +Allocation:     196.00 KiB
   1.120 +
   1.121 +setlocale: No such file or directory
   1.122 +Vol Lothigometh.iso created
   1.123 +setlocale: No such file or directory
   1.124 +setlocale: No such file or directory
   1.125 +setlocale: No such file or directory
   1.126 +Creating new virtual machine [Lothigometh]
   1.127 +setlocale: No such file or directory
   1.128 +Domain Lothigometh defined from /tmp/tmp.WfdyEwYwJW
   1.129 +Starting new virtual machine [Lothigometh]
   1.130 +setlocale: No such file or directory
   1.131 +Domain Lothigometh started
   1.132 +stv@trop02:~$ exit
   1.133 +logout
   1.134 +Connection to trop02.roe.ac.uk closed.
   1.135 +
   1.136 +
   1.137 +
   1.138 +ssh Stevedore@Lothigometh
   1.139 +
   1.140 +
   1.141 +[Stevedore@Lothigometh ~]$ 
   1.142 +
   1.143 +# -----------------------------------------------------
   1.144 +# Add secret function.
   1.145 +# -----------------------------------------------------
   1.146 +
   1.147 +    secrethost='stv@shepseskaf.roe.ac.uk'
   1.148 +    secretfile='${HOME:?}/secret.store.20181212'
   1.149 +
   1.150 +    secret()
   1.151 +    {
   1.152 +        local key=${1:?}
   1.153 +        ssh -o 'VisualHostKey=no' "${secrethost:?}" "sed -n 's/${key}=\\(.*\\)/\\1/p' \"${secretfile:?}\"" 
   1.154 +    }
   1.155 +
   1.156 +    secret 'firethorn.ssh.keys' >> "${HOME}/.ssh/authorized_keys"
   1.157 +
   1.158 +
   1.159 +
   1.160 +# -----------------------------------------------------
   1.161 +# Set the target branch and builtag
   1.162 +# -----------------------------------------------------
   1.163 +
   1.164 +
   1.165 +    export buildtag=2.1.31
   1.166 +    export branch=default
   1.167 +
   1.168 +
   1.169 +
   1.170 +# -----------------------------------------------------
   1.171 +# Create our chain.properties file
   1.172 +# -----------------------------------------------------
   1.173 +
   1.174 +cat > "${HOME:?}/chain.properties" << EOF
   1.175 +
   1.176 +metadata=postgres
   1.177 +metauser=$(pwgen 20 1)
   1.178 +metapass=$(pwgen 20 1)
   1.179 +
   1.180 +userhost=$(secret 'firethorn.user.host')
   1.181 +userdata=$(secret 'firethorn.user.data')
   1.182 +useruser=$(secret 'firethorn.user.user')
   1.183 +userpass=$(secret 'firethorn.user.pass')
   1.184 +usertype=mssql
   1.185 +
   1.186 +datahost=$(secret 'firethorn.data.host')
   1.187 +datadata=$(secret 'firethorn.data.data')
   1.188 +datacatalog=$(secret 'firethorn.data.catalog')
   1.189 +datatype=$(secret 'firethorn.data.type')
   1.190 +datauser=$(secret 'firethorn.data.user')
   1.191 +datapass=$(secret 'firethorn.data.pass')
   1.192 +
   1.193 +tapschemadata=$(secret 'firethorn.tapschema.database.name')
   1.194 +tapschemauser=$(secret 'firethorn.tapschema.database.user')
   1.195 +tapschemapass=$(secret 'firethorn.tapschema.database.pass')
   1.196 +tapschemahost=$(secret 'firethorn.tapschema.database.host')
   1.197 +tapschemaport=$(secret 'firethorn.tapschema.database.port')
   1.198 +tapschematype=$(secret 'firethorn.tapschema.database.type')
   1.199 +tapschemajdbc=$(secret 'firethorn.tapschema.jdbc.name')
   1.200 +
   1.201 +tunneluser=$(secret 'ssh.tunnel.user')
   1.202 +tunnelhost=$(secret 'ssh.tunnel.host')
   1.203 +
   1.204 +admingroup=$(pwgen 20 1)	
   1.205 +adminuser=$(pwgen 20 1)
   1.206 +adminpass=$(pwgen 20 1)
   1.207 +
   1.208 +adql_query_delay_first=$(secret 'adql.query.delay.first')
   1.209 + 
   1.210 +firethorn_limits_rows_absolute=$(secret 'firethorn.limits.rows.absolute')
   1.211 +firethorn_limits_rows_default=$(secret 'firethorn.limits.rows.default')
   1.212 +
   1.213 +guestgroup=friends
   1.214 +endpoint=$(secret 'endpoint')
   1.215 +
   1.216 +EOF
   1.217 +
   1.218 +
   1.219 +
   1.220 +# -----------------------------------------------------
   1.221 +# Create our Firethorn properties.
   1.222 +# -----------------------------------------------------
   1.223 +
   1.224 +source "${HOME:?}/chain.properties"
   1.225 +cat > "${HOME:?}/firethorn.properties" << EOF
   1.226 +
   1.227 +firethorn.meta.type=pgsql
   1.228 +firethorn.meta.driver=org.postgresql.Driver
   1.229 +firethorn.meta.host=bethany
   1.230 +firethorn.meta.url=jdbc:postgresql://bethany/${metadata}
   1.231 +firethorn.meta.data=postgres
   1.232 +firethorn.meta.user=${metauser:?}
   1.233 +firethorn.meta.pass=${metapass:?}
   1.234 +
   1.235 +firethorn.user.type=mssql
   1.236 +firethorn.user.url=jdbc:jtds:sqlserver://${userhost:?}/${userdata:?}
   1.237 +firethorn.user.driver=net.sourceforge.jtds.jdbc.Driver
   1.238 +firethorn.user.host=${userhost:?}
   1.239 +firethorn.user.data=${userdata:?}
   1.240 +firethorn.user.user=${useruser:?}
   1.241 +firethorn.user.pass=${userpass:?}
   1.242 +
   1.243 +firethorn.tapschema.resource.name=${tapschemajdbc}
   1.244 +firethorn.tapschema.database.name=${tapschemadata}
   1.245 +firethorn.tapschema.database.host=${tapschemahost}
   1.246 +firethorn.tapschema.database.port=${tapschemaport}
   1.247 +firethorn.tapschema.database.user=${tapschemauser}
   1.248 +firethorn.tapschema.database.pass=${tapschemapass}
   1.249 +
   1.250 +firethorn.admin.community=${admingroup:?}
   1.251 +firethorn.admin.user.name=${adminuser:?}
   1.252 +firethorn.admin.user.pass=${adminpass:?}
   1.253 +
   1.254 +firethorn.guest.community=${guestgroup:?}
   1.255 +
   1.256 +adql.query.delay.first=${adql_query_delay_first:?}
   1.257 +
   1.258 +firethorn.limits.rows.absolute=${firethorn_limits_rows_absolute:?}
   1.259 +firethorn.limits.rows.default=${firethorn_limits_rows_default:?}
   1.260 +	
   1.261 +
   1.262 +EOF
   1.263 +
   1.264 +
   1.265 +
   1.266 +# -----------------------------------------------------
   1.267 +# Create our compose env file.
   1.268 +# -----------------------------------------------------
   1.269 +
   1.270 +source "${HOME:?}/chain.properties"
   1.271 +cat > "${HOME:?}/.env" << EOF
   1.272 +
   1.273 +	buildtag=${branch:?}
   1.274 +
   1.275 +	metadata=postgres
   1.276 +	metauser=${metauser:?}
   1.277 +	metapass=${metapass:?}
   1.278 +
   1.279 +        datadata=${datadata:?}
   1.280 +        datauser=${datauser:?}
   1.281 +        datapass=${datapass:?}
   1.282 +	datahost=${datahost:?}
   1.283 +	datacatalog=${datacatalog:?}
   1.284 +	datatype=mssql
   1.285 +
   1.286 +	tapschemadata=${tapschemadata:?}
   1.287 +	tapschemauser=${tapschemauser:?}
   1.288 +	tapschemapass=${tapschemapass:?}
   1.289 +	tapschemahost=${tapschemahost}
   1.290 +	tapschemaport=${tapschemaport:?}
   1.291 +	tapschemajdbc=${tapschemajdbc:?}
   1.292 +	tapschematype=${tapschematype:?}
   1.293 +
   1.294 +	userhost=${userhost:?}
   1.295 +	userdata=${userdata:?}
   1.296 +	useruser=${useruser:?}
   1.297 +	userpass=${userpass:?}
   1.298 +        usertype=mssql
   1.299 +
   1.300 +	admingroup=${admingroup:?}
   1.301 +	adminuser=${adminuser:?}
   1.302 +	adminpass=${adminpass:?}
   1.303 +	guestgroup=${guestgroup:?}
   1.304 +
   1.305 +	adql_query_delay_first=${adql_query_delay_first:?}
   1.306 +
   1.307 +	firethorn_limits_rows_absolute=${firethorn_limits_rows_absolute:?}
   1.308 +	firethorn_limits_rows_default=${firethorn_limits_rows_default:?}
   1.309 +
   1.310 +	endpoint=${endpoint:?}
   1.311 +EOF
   1.312 +
   1.313 +
   1.314 +
   1.315 +# -----------------------------------------------------
   1.316 +# Fetch the TAP Deployer
   1.317 +# -----------------------------------------------------
   1.318 +
   1.319 +
   1.320 + wget http://wfau.metagrid.co.uk/code/firethorn/raw-file/20b8901d807c/docker/compose/deploy/tap-deployer.yml  -O  docker-compose.yml
   1.321 +
   1.322 +
   1.323 +
   1.324 +# -----------------------------------------------------
   1.325 +# Run Docker Compose tap-deployer.yml from firethorn.py
   1.326 +# -----------------------------------------------------
   1.327 +
   1.328 +source "${HOME:?}/chain.properties"
   1.329 +
   1.330 +docker-compose --file "docker-compose.yml" run firethorn-py
   1.331 +
   1.332 +import firethorn
   1.333 +import firethorn_utils.configurator as configur
   1.334 +ft = firethorn.Firethorn(endpoint="http://gillian:8080/firethorn")
   1.335 +ft.login(firethorn.config.adminuser, firethorn.config.adminpass, firethorn.config.admingroup)
   1.336 +configurator =  configur.Configurator(ft)
   1.337 +
   1.338 +>>> configurator.load_resources("/home/firethorn.py/firethorn/data/osa-tap.json")
   1.339 +Importing JDBC Schema: ATLASDR1
   1.340 +Importing JDBC Schema: ATLASDR2
   1.341 +Importing JDBC Schema: ATLASDR3
   1.342 +Importing JDBC Schema: 2MASS
   1.343 +Importing JDBC Schema: 2XMM
   1.344 +Importing JDBC Schema: WISE
   1.345 +Importing JDBC Schema: VIKINGDR3
   1.346 +Importing JDBC Schema: VHSDR1
   1.347 +Importing JDBC Schema: MGC
   1.348 +Importing JDBC Schema: GLIMPSE
   1.349 +Importing JDBC Schema: FIRST
   1.350 +Importing JDBC Schema: DENIS
   1.351 +TAP Service available at: http://gillian:8080/firethorn/tap/56/
   1.352 +
   1.353 +>>> configurator.load_resources("/home/firethorn.py/firethorn/data/ssa-tap.json")
   1.354 +Importing JDBC Schema: SSA
   1.355 +Importing JDBC Schema: 2MASS
   1.356 +Importing JDBC Schema: 2MPZ
   1.357 +Importing JDBC Schema: WISExSCOSPZ
   1.358 +Importing JDBC Schema: SDSSDR1
   1.359 +Importing JDBC Schema: SDSSDR5
   1.360 +Importing JDBC Schema: SDSSDR7
   1.361 +Importing JDBC Schema: SDSSDR8
   1.362 +Importing JDBC Schema: SDSSDR9
   1.363 +Importing JDBC Schema: 6dF
   1.364 +TAP Service available at: http://gillian:8080/firethorn/tap/59/
   1.365 +
   1.366 +
   1.367 +## Modify VSA  json file to load from ramses19
   1.368 +>>> configurator.load_resources("/home/firethorn.py/firethorn/data/vsa-tap.json")
   1.369 +Importing JDBC Schema: VVVDR1
   1.370 +Importing JDBC Schema: VVVDR2
   1.371 +Importing JDBC Schema: VVVDR4
   1.372 +ERROR:root:HTTP Error 404: 
   1.373 +Traceback (most recent call last):
   1.374 +  File "/usr/local/lib/python3.5/dist-packages/firethorn/models/base/base_object.py", line 90, in get_json
   1.375 +    with urllib.request.urlopen( req, data) as response:
   1.376 +  File "/usr/lib/python3.5/urllib/request.py", line 163, in urlopen
   1.377 +    return opener.open(url, data, timeout)
   1.378 +  File "/usr/lib/python3.5/urllib/request.py", line 472, in open
   1.379 +    response = meth(req, response)
   1.380 +  File "/usr/lib/python3.5/urllib/request.py", line 582, in http_response
   1.381 +    'http', request, response, code, msg, hdrs)
   1.382 +  File "/usr/lib/python3.5/urllib/request.py", line 510, in error
   1.383 +    return self._call_chain(*args)
   1.384 +  File "/usr/lib/python3.5/urllib/request.py", line 444, in _call_chain
   1.385 +    result = func(*args)
   1.386 +  File "/usr/lib/python3.5/urllib/request.py", line 590, in http_error_default
   1.387 +    raise HTTPError(req.full_url, code, msg, hdrs, fp)
   1.388 +urllib.error.HTTPError: HTTP Error 404: 
   1.389 +ERROR:root:Expecting value: line 1 column 1 (char 0)
   1.390 +Traceback (most recent call last):
   1.391 +  File "/usr/local/lib/python3.5/dist-packages/firethorn/models/adql/adql_resource.py", line 112, in import_jdbc_schema
   1.392 +    response_json_list = json.loads(response.text)
   1.393 +  File "/usr/lib/python3.5/json/__init__.py", line 319, in loads
   1.394 +    return _default_decoder.decode(s)
   1.395 +  File "/usr/lib/python3.5/json/decoder.py", line 339, in decode
   1.396 +    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
   1.397 +  File "/usr/lib/python3.5/json/decoder.py", line 357, in raw_decode
   1.398 +    raise JSONDecodeError("Expecting value", s, err.value) from None
   1.399 +json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
   1.400 +Importing JDBC Schema: VHSDR1
   1.401 +Importing JDBC Schema: VHSDR2
   1.402 +Importing JDBC Schema: VHSDR3
   1.403 +Importing JDBC Schema: VMCDR1
   1.404 +Importing JDBC Schema: VMCDR2
   1.405 +Importing JDBC Schema: VMCDR3
   1.406 +Importing JDBC Schema: VMCDR4
   1.407 +Importing JDBC Schema: VIKINGDR2
   1.408 +Importing JDBC Schema: VIKINGDR3
   1.409 +Importing JDBC Schema: VIKINGDR4
   1.410 +Importing JDBC Schema: VIDEODR2
   1.411 +Importing JDBC Schema: VIDEODR3
   1.412 +Importing JDBC Schema: VIDEODR4
   1.413 +Importing JDBC Schema: VIDEODR5
   1.414 +Importing JDBC Schema: UKIDSSDR4PLUS
   1.415 +Importing JDBC Schema: UKIDSSDR5PLUS
   1.416 +Importing JDBC Schema: UKIDSSDR6PLUS
   1.417 +Importing JDBC Schema: UKIDSSDR7PLUS
   1.418 +Importing JDBC Schema: UKIDSSDR8PLUS
   1.419 +Importing JDBC Schema: UKIDSSDR9PLUS
   1.420 +Importing JDBC Schema: UKIDSSDR10PLUS
   1.421 +Importing JDBC Schema: SDSSDR1
   1.422 +Importing JDBC Schema: SDSSDR3
   1.423 +ERROR:root:HTTP Error 404: 
   1.424 +Traceback (most recent call last):
   1.425 +  File "/usr/local/lib/python3.5/dist-packages/firethorn/models/base/base_object.py", line 90, in get_json
   1.426 +    with urllib.request.urlopen( req, data) as response:
   1.427 +  File "/usr/lib/python3.5/urllib/request.py", line 163, in urlopen
   1.428 +    return opener.open(url, data, timeout)
   1.429 +  File "/usr/lib/python3.5/urllib/request.py", line 472, in open
   1.430 +    response = meth(req, response)
   1.431 +  File "/usr/lib/python3.5/urllib/request.py", line 582, in http_response
   1.432 +    'http', request, response, code, msg, hdrs)
   1.433 +  File "/usr/lib/python3.5/urllib/request.py", line 510, in error
   1.434 +    return self._call_chain(*args)
   1.435 +  File "/usr/lib/python3.5/urllib/request.py", line 444, in _call_chain
   1.436 +    result = func(*args)
   1.437 +  File "/usr/lib/python3.5/urllib/request.py", line 590, in http_error_default
   1.438 +    raise HTTPError(req.full_url, code, msg, hdrs, fp)
   1.439 +urllib.error.HTTPError: HTTP Error 404: 
   1.440 +ERROR:root:Expecting value: line 1 column 1 (char 0)
   1.441 +Traceback (most recent call last):
   1.442 +  File "/usr/local/lib/python3.5/dist-packages/firethorn/models/adql/adql_resource.py", line 112, in import_jdbc_schema
   1.443 +    response_json_list = json.loads(response.text)
   1.444 +  File "/usr/lib/python3.5/json/__init__.py", line 319, in loads
   1.445 +    return _default_decoder.decode(s)
   1.446 +  File "/usr/lib/python3.5/json/decoder.py", line 339, in decode
   1.447 +    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
   1.448 +  File "/usr/lib/python3.5/json/decoder.py", line 357, in raw_decode
   1.449 +    raise JSONDecodeError("Expecting value", s, err.value) from None
   1.450 +json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
   1.451 +Importing JDBC Schema: SDSSDR5
   1.452 +ERROR:root:HTTP Error 404: 
   1.453 +Traceback (most recent call last):
   1.454 +  File "/usr/local/lib/python3.5/dist-packages/firethorn/models/base/base_object.py", line 90, in get_json
   1.455 +    with urllib.request.urlopen( req, data) as response:
   1.456 +  File "/usr/lib/python3.5/urllib/request.py", line 163, in urlopen
   1.457 +    return opener.open(url, data, timeout)
   1.458 +  File "/usr/lib/python3.5/urllib/request.py", line 472, in open
   1.459 +    response = meth(req, response)
   1.460 +  File "/usr/lib/python3.5/urllib/request.py", line 582, in http_response
   1.461 +    'http', request, response, code, msg, hdrs)
   1.462 +  File "/usr/lib/python3.5/urllib/request.py", line 510, in error
   1.463 +    return self._call_chain(*args)
   1.464 +  File "/usr/lib/python3.5/urllib/request.py", line 444, in _call_chain
   1.465 +    result = func(*args)
   1.466 +  File "/usr/lib/python3.5/urllib/request.py", line 590, in http_error_default
   1.467 +    raise HTTPError(req.full_url, code, msg, hdrs, fp)
   1.468 +urllib.error.HTTPError: HTTP Error 404: 
   1.469 +ERROR:root:Expecting value: line 1 column 1 (char 0)
   1.470 +Traceback (most recent call last):
   1.471 +  File "/usr/local/lib/python3.5/dist-packages/firethorn/models/adql/adql_resource.py", line 112, in import_jdbc_schema
   1.472 +    response_json_list = json.loads(response.text)
   1.473 +  File "/usr/lib/python3.5/json/__init__.py", line 319, in loads
   1.474 +    return _default_decoder.decode(s)
   1.475 +  File "/usr/lib/python3.5/json/decoder.py", line 339, in decode
   1.476 +    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
   1.477 +  File "/usr/lib/python3.5/json/decoder.py", line 357, in raw_decode
   1.478 +    raise JSONDecodeError("Expecting value", s, err.value) from None
   1.479 +json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
   1.480 +Importing JDBC Schema: SDSSDR7
   1.481 +Importing JDBC Schema: SDSSDR8
   1.482 +Importing JDBC Schema: SDSSDR9
   1.483 +Importing JDBC Schema: 2MASS
   1.484 +Importing JDBC Schema: ROSAT
   1.485 +Importing JDBC Schema: FIRST
   1.486 +Importing JDBC Schema: IRAS
   1.487 +Importing JDBC Schema: SSA
   1.488 +Importing JDBC Schema: GLIMPSE
   1.489 +Importing JDBC Schema: 2XMM
   1.490 +Importing JDBC Schema: MGC
   1.491 +Importing JDBC Schema: Stripe82
   1.492 +Importing JDBC Schema: WISE
   1.493 +TAP Service available at: http://gillian:8080/firethorn/tap/62/
   1.494 +
   1.495 +>>> configurator.load_resources("/home/firethorn.py/firethorn/data/wsa-tap.json")
   1.496 +Importing JDBC Schema: UKIDSSDR1PLUS
   1.497 +Importing JDBC Schema: UKIDSSDR2PLUS
   1.498 +Importing JDBC Schema: UKIDSSDR3PLUS
   1.499 +Importing JDBC Schema: UKIDSSDR4PLUS
   1.500 +Importing JDBC Schema: UKIDSSDR5PLUS
   1.501 +Importing JDBC Schema: UKIDSSDR6PLUS
   1.502 +Importing JDBC Schema: UKIDSSDR7PLUS
   1.503 +Importing JDBC Schema: UKIDSSDR8PLUS
   1.504 +Importing JDBC Schema: UKIDSSDR9PLUS
   1.505 +Importing JDBC Schema: UKIDSSDR10PLUS
   1.506 +Importing JDBC Schema: SDSSDR1
   1.507 +Importing JDBC Schema: SDSSDR3
   1.508 +Importing JDBC Schema: SDSSDR5
   1.509 +Importing JDBC Schema: SDSSDR7
   1.510 +Importing JDBC Schema: SDSSDR8
   1.511 +Importing JDBC Schema: SDSSDR9
   1.512 +Importing JDBC Schema: 2MASS
   1.513 +Importing JDBC Schema: ROSAT
   1.514 +Importing JDBC Schema: FIRST
   1.515 +Importing JDBC Schema: IRAS
   1.516 +Importing JDBC Schema: SSA
   1.517 +Importing JDBC Schema: GLIMPSE
   1.518 +Importing JDBC Schema: 2XMM
   1.519 +Importing JDBC Schema: MGC
   1.520 +Importing JDBC Schema: Stripe82
   1.521 +Importing JDBC Schema: WISE
   1.522 +TAP Service available at: http://gillian:8080/firethorn/tap/65/
   1.523 +
   1.524 +
   1.525 +
   1.526 +# -----------------------------------------------------
   1.527 +# WFAU TAP Service endpoints
   1.528 +# -----------------------------------------------------
   1.529 +
   1.530 +TAP Service available at: http://gillian:8080/firethorn/tap/56/ - OSA
   1.531 +TAP Service available at: http://gillian:8080/firethorn/tap/59/ - SSA
   1.532 +TAP Service available at: http://gillian:8080/firethorn/tap/62/ - VSA
   1.533 +TAP Service available at: http://gillian:8080/firethorn/tap/65/ - WSA
   1.534 +
   1.535 +
   1.536 +## Had to recreate resources after network connection issues
   1.537 +
   1.538 +# -----------------------------------------------------
   1.539 +# Update the Proxy Entry
   1.540 +# -----------------------------------------------------
   1.541 +ssh Stevedore@Acilamwen 
   1.542 +
   1.543 +[Stevedore@Acilamwen ~]$ nano tap.roe.ac.uk.conf 
   1.544 +
   1.545 +..
   1.546 +    ## PROXY ENTRIES HERE ##
   1.547 +    ProxyPassMatch    ^/osa\/(.*)$  http://ulov:8080/firethorn/tap/56/$1
   1.548 +    ProxyPassReverse  ^/osa\/(.*)$  http://ulov:8080/firethorn/tap/56/$1
   1.549 +
   1.550 +    ProxyPassMatch    ^/ssa\/(.*)$  http://ulov:8080/firethorn/tap/59/$1
   1.551 +    ProxyPassReverse  ^/ssa\/(.*)$  http://ulov:8080/firethorn/tap/59/$1
   1.552 +
   1.553 +    ProxyPassMatch    ^/vsa\/(.*)$  http://ulov:8080/firethorn/tap/62/$1
   1.554 +    ProxyPassReverse  ^/vsa\/(.*)$  http://ulov:8080/firethorn/tap/62/$1
   1.555 +
   1.556 +    ProxyPassMatch    ^/wsa\/(.*)$  http://ulov:8080/firethorn/tap/65/$1
   1.557 +    ProxyPassReverse  ^/wsa\/(.*)$  http://ulov:8080/firethorn/tap/65/$1
   1.558 +
   1.559 +    ProxyPassMatch    ^/firethorn\/(.*)$  http://ulov:8080/firethorn/$1
   1.560 +    ProxyPassReverse  ^/firethorn\/(.*)$  http://ulov:8080/firethorn/$1
   1.561 +
   1.562 +
   1.563 +...   
   1.564 +
   1.565 +[Stevedore@Acilamwen ~]$ nano tap.roe.ac.uk.conf 
   1.566 +[Stevedore@Acilamwen ~]$ docker exec -it  apache bash
   1.567 +[root@bc8d6979e451 /]# nano /etc/httpd/conf.d/tap.roe.ac.uk.conf
   1.568 +
   1.569 +..
   1.570 +
   1.571 +    ## PROXY ENTRIES HERE ##
   1.572 +    ProxyPassMatch    ^/osa\/(.*)$  http://ulov:8080/firethorn/tap/56/$1
   1.573 +    ProxyPassReverse  ^/osa\/(.*)$  http://ulov:8080/firethorn/tap/56/$1
   1.574 +
   1.575 +    ProxyPassMatch    ^/ssa\/(.*)$  http://ulov:8080/firethorn/tap/59/$1
   1.576 +    ProxyPassReverse  ^/ssa\/(.*)$  http://ulov:8080/firethorn/tap/59/$1
   1.577 +
   1.578 +    ProxyPassMatch    ^/vsa\/(.*)$  http://ulov:8080/firethorn/tap/62/$1
   1.579 +    ProxyPassReverse  ^/vsa\/(.*)$  http://ulov:8080/firethorn/tap/62/$1
   1.580 +
   1.581 +    ProxyPassMatch    ^/wsa\/(.*)$  http://ulov:8080/firethorn/tap/65/$1
   1.582 +    ProxyPassReverse  ^/wsa\/(.*)$  http://ulov:8080/firethorn/tap/65/$1
   1.583 +
   1.584 +    ProxyPassMatch    ^/firethorn\/(.*)$  http://ulov:8080/firethorn/$1
   1.585 +    ProxyPassReverse  ^/firethorn\/(.*)$  http://ulov:8080/firethorn/$1
   1.586 +
   1.587 +
   1.588 +..
   1.589 +[root@bc8d6979e451 /]# exit
   1.590 +exit
   1.591 +
   1.592 +[Stevedore@Acilamwen ~]$ docker kill --signal 'USR1' 'apache'
   1.593 +
   1.594 +
     2.1 --- /dev/null	Thu Jan 01 00:00:00 1970 +0000
     2.2 +++ b/doc/notes/stv/20190510-TAPlint.txt	Sat May 11 00:07:50 2019 +0300
     2.3 @@ -0,0 +1,159 @@
     2.4 +#
     2.5 +# <meta:header>
     2.6 +#   <meta:licence>
     2.7 +#     Copyright (c) 2018, ROE (http://www.roe.ac.uk/)
     2.8 +#
     2.9 +#     This information is free software: you can redistribute it and/or modify
    2.10 +#     it under the terms of the GNU General Public License as published by
    2.11 +#     the Free Software Foundation, either version 3 of the License, or
    2.12 +#     (at your option) any later version.
    2.13 +#
    2.14 +#     This information is distributed in the hope that it will be useful,
    2.15 +#     but WITHOUT ANY WARRANTY; without even the implied warranty of
    2.16 +#     MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
    2.17 +#     GNU General Public License for more details.
    2.18 +#  
    2.19 +#     You should have received a copy of the GNU General Public License
    2.20 +#     along with this program.  If not, see <http://www.gnu.org/licenses/>.
    2.21 +#   </meta:licence>
    2.22 +# </meta:header>
    2.23 +#
    2.24 +#
    2.25 +stelios@stelios-pc:~/Downloads$ java -jar stilts.jar taplint tapurl=http://tap.roe.ac.uk/osa debug=true
    2.26 +This is STILTS taplint, 3.1-5/0e19ffc (2018-11-02)
    2.27 +Static report types: ERROR(123), WARNING(48), INFO(21), SUMMARY(9), FAILURE(21)
    2.28 +
    2.29 +Section TMV: Validate table metadata against XML schema
    2.30 +I-TMV-VURL-1 Validating http://tap.roe.ac.uk/osa/tables as tableset (http://www.ivoa.net/xml/VODataService/v1.1)
    2.31 +S-TMV-VALI-1 SAX report: warnings 0, errors 0, fatal 0
    2.32 +
    2.33 +Section TME: Check content of tables metadata from /tables
    2.34 +I-TME-TURL-1 Reading table metadata from http://tap.roe.ac.uk/osa/tables
    2.35 +S-TME-SUMM-1 Schemas: 13, Tables: 333, Columns: 9071, Foreign Keys: 0
    2.36 +S-TME-FLGS-1 Standard column flags: indexed: 0, primary: 0, nullable: 0
    2.37 +S-TME-FLGO-1 Other column flags: none
    2.38 +
    2.39 +Section TMS: Check content of tables metadata from TAP_SCHEMA
    2.40 +I-TMS-QSUB-1 Submitting query: SELECT COUNT(*) AS nr FROM TAP_SCHEMA.schemas
    2.41 +I-TMS-QGET-1 Query GET URL: http://tap.roe.ac.uk/osa/sync?REQUEST=doQuery&LANG=ADQL&QUERY=SELECT+COUNT%28*%29+AS+nr+FROM+TAP_SCHEMA.schemas
    2.42 +I-TMS-QSUB-2 Submitting query: SELECT COUNT(*) AS nr FROM TAP_SCHEMA.tables
    2.43 +I-TMS-QGET-2 Query GET URL: http://tap.roe.ac.uk/osa/sync?REQUEST=doQuery&LANG=ADQL&QUERY=SELECT+COUNT%28*%29+AS+nr+FROM+TAP_SCHEMA.tables
    2.44 +I-TMS-QSUB-3 Submitting query: SELECT COUNT(*) AS nr FROM TAP_SCHEMA.columns
    2.45 +I-TMS-QGET-3 Query GET URL: http://tap.roe.ac.uk/osa/sync?REQUEST=doQuery&LANG=ADQL&QUERY=SELECT+COUNT%28*%29+AS+nr+FROM+TAP_SCHEMA.columns
    2.46 +I-TMS-QSUB-4 Submitting query: SELECT COUNT(*) AS nr FROM TAP_SCHEMA.keys
    2.47 +I-TMS-QGET-4 Query GET URL: http://tap.roe.ac.uk/osa/sync?REQUEST=doQuery&LANG=ADQL&QUERY=SELECT+COUNT%28*%29+AS+nr+FROM+TAP_SCHEMA.keys
    2.48 +I-TMS-QSUB-5 Submitting query: SELECT COUNT(*) AS nr FROM TAP_SCHEMA.key_columns
    2.49 +I-TMS-QGET-5 Query GET URL: http://tap.roe.ac.uk/osa/sync?REQUEST=doQuery&LANG=ADQL&QUERY=SELECT+COUNT%28*%29+AS+nr+FROM+TAP_SCHEMA.key_columns
    2.50 +I-TMS-QSUB-6 Submitting query: SELECT principal, indexed, std, "size" FROM TAP_SCHEMA.columns
    2.51 +I-TMS-QGET-6 Query GET URL: http://tap.roe.ac.uk/osa/sync?REQUEST=doQuery&LANG=ADQL&QUERY=SELECT+principal%2C+indexed%2C+std%2C+%22size%22+FROM+TAP_SCHEMA.columns&MAXREC=9081
    2.52 +I-TMS-QSUB-7 Submitting query: SELECT TOP 1 * FROM TAP_SCHEMA.columns
    2.53 +I-TMS-QGET-7 Query GET URL: http://tap.roe.ac.uk/osa/sync?REQUEST=doQuery&LANG=ADQL&QUERY=SELECT+TOP+1+*+FROM+TAP_SCHEMA.columns&MAXREC=1
    2.54 +I-TMS-QSUB-8 Submitting query: SELECT ft_column_id, std, indexed, principal, arraysize, ts_column_id, datatype, utype, ucd, unit, description, column_name, table_name FROM TAP_SCHEMA.columns
    2.55 +I-TMS-QGET-8 Query GET URL: http://tap.roe.ac.uk/osa/sync?REQUEST=doQuery&LANG=ADQL&QUERY=SELECT+ft_column_id%2C+std%2C+indexed%2C+principal%2C+arraysize%2C+ts_column_id%2C+datatype%2C+utype%2C+ucd%2C+unit%2C+description%2C+column_name%2C+table_name+FROM+TAP_SCHEMA.columns&MAXREC=9081
    2.56 +I-TMS-QSUB-9 Submitting query: SELECT from_column, target_column, key_id FROM TAP_SCHEMA.key_columns
    2.57 +I-TMS-QGET-9 Query GET URL: http://tap.roe.ac.uk/osa/sync?REQUEST=doQuery&LANG=ADQL&QUERY=SELECT+from_column%2C+target_column%2C+key_id+FROM+TAP_SCHEMA.key_columns&MAXREC=9081
    2.58 +S-TMS-SUMM-1 Schemas: 13, Tables: 333, Columns: 9071, Foreign Keys: 0
    2.59 +S-TMS-FLGS-1 Standard column flags: indexed: 0, principal: 7, std: 33
    2.60 +S-TMS-QNUM-1 Successful/submitted TAP queries: 13/13
    2.61 +S-TMS-QTIM-1 Average successful query time: 2.1s
    2.62 +I-TMS-QSUB-x (4 more)
    2.63 +I-TMS-QGET-x (4 more)
    2.64 +
    2.65 +Section TMC: Compare table metadata from /tables and TAP_SCHEMA
    2.66 +
    2.67 +Section CPV: Validate capabilities against XML schema
    2.68 +I-CPV-VURL-1 Validating http://tap.roe.ac.uk/osa/capabilities as capabilities (http://www.ivoa.net/xml/VOSICapabilities/v1.0)
    2.69 +S-CPV-VALI-1 SAX report: warnings 0, errors 0, fatal 0
    2.70 +
    2.71 +Section CAP: Check content of TAPRegExt capabilities record
    2.72 +I-CAP-CURL-1 Reading capability metadata from http://tap.roe.ac.uk/osa/capabilities
    2.73 +
    2.74 +Section AVV: Validate availability against XML schema
    2.75 +I-AVV-VURL-1 Validating http://tap.roe.ac.uk/osa/availability as availability (http://www.ivoa.net/xml/VOSIAvailability/v1.0)
    2.76 +S-AVV-VALI-1 SAX report: warnings 0, errors 0, fatal 0
    2.77 +
    2.78 +Section QGE: Make ADQL queries in sync GET mode
    2.79 +I-QGE-QSUB-1 Submitting query: SELECT TOP 10 surveyID FROM ATLASDR3.Survey
    2.80 +I-QGE-QGET-1 Query GET URL: http://tap.roe.ac.uk/osa/sync?REQUEST=doQuery&LANG=ADQL&QUERY=SELECT+TOP+10+surveyID+FROM+ATLASDR3.Survey
    2.81 +I-QGE-QSUB-2 Submitting query: SELECT surveyID FROM ATLASDR3.Survey
    2.82 +I-QGE-QGET-2 Query GET URL: http://tap.roe.ac.uk/osa/sync?REQUEST=doQuery&LANG=ADQL&QUERY=SELECT+surveyID+FROM+ATLASDR3.Survey&MAXREC=0
    2.83 +I-QGE-QSUB-3 Submitting query: SELECT TOP 1 surveyID FROM ATLASDR3.Survey
    2.84 +I-QGE-QGET-3 Query GET URL: http://tap.roe.ac.uk/osa/sync?REQUEST=doQuery&LANG=ADQL-2.0&QUERY=SELECT+TOP+1+surveyID+FROM+ATLASDR3.Survey
    2.85 +I-QGE-QSUB-4 Submitting query: SELECT TOP 1 surveyID FROM ATLASDR3.Survey
    2.86 +I-QGE-QGET-4 Query GET URL: http://tap.roe.ac.uk/osa/sync?REQUEST=doQuery&LANG=ADQL&QUERY=SELECT+TOP+1+surveyID+FROM+ATLASDR3.Survey
    2.87 +I-QGE-QSUB-5 Submitting query: SELECT TOP 8 sdssPrimary, sdssType AS taplint_c_2, A.distanceMins, slaveObjID AS taplint_c_4, masterObjID FROM ATLASDR3.atlasSourceXDR5PhotoObj AS A
    2.88 +I-QGE-QGET-5 Query GET URL: http://tap.roe.ac.uk/osa/sync?REQUEST=doQuery&LANG=ADQL&QUERY=SELECT+TOP+8+sdssPrimary%2C+sdssType+AS+taplint_c_2%2C+A.distanceMins%2C+slaveObjID+AS+taplint_c_4%2C+masterObjID++FROM+ATLASDR3.atlasSourceXDR5PhotoObj+AS+A
    2.89 +I-QGE-QSUB-6 Submitting query: SELECT masterObjID FROM ATLASDR3.atlasSourceXDR5PhotoObjAll
    2.90 +I-QGE-QGET-6 Query GET URL: http://tap.roe.ac.uk/osa/sync?REQUEST=doQuery&LANG=ADQL&QUERY=SELECT+masterObjID+FROM+ATLASDR3.atlasSourceXDR5PhotoObjAll&MAXREC=0
    2.91 +I-QGE-DUFF-1 Submitting duff query: DUFF QUERY
    2.92 +I-QGE-QGET-7 Query GET URL: http://tap.roe.ac.uk/osa/sync?REQUEST=doQuery&LANG=ADQL&QUERY=DUFF+QUERY
    2.93 +S-QGE-QNUM-1 Successful/submitted TAP queries: 6/6
    2.94 +S-QGE-QTIM-1 Average successful query time: 1.5s
    2.95 +
    2.96 +Section QPO: Make ADQL queries in sync POST mode
    2.97 +I-QPO-QSUB-1 Submitting query: SELECT TOP 10 surveyID FROM ATLASDR3.Survey
    2.98 +I-QPO-QSUB-2 Submitting query: SELECT surveyID FROM ATLASDR3.Survey
    2.99 +I-QPO-QSUB-3 Submitting query: SELECT TOP 8 sdssPrimary, sdssType AS taplint_c_2, A.distanceMins, slaveObjID AS taplint_c_4, masterObjID FROM ATLASDR3.atlasSourceXDR5PhotoObj AS A
   2.100 +I-QPO-QSUB-4 Submitting query: SELECT masterObjID FROM ATLASDR3.atlasSourceXDR5PhotoObjAll
   2.101 +I-QPO-DUFF-1 Submitting duff query: DUFF QUERY
   2.102 +S-QPO-QNUM-1 Successful/submitted TAP queries: 4/4
   2.103 +S-QPO-QTIM-1 Average successful query time: 1.4s
   2.104 +
   2.105 +Section QAS: Make ADQL queries in async mode
   2.106 +I-QAS-QSUB-1 Submitting query: SELECT TOP 10 surveyID FROM ATLASDR3.Survey
   2.107 +I-QAS-QJOB-1 Submitted query at http://tap.roe.ac.uk/firethorn/tap/56/async/505777
   2.108 +I-QAS-QSUB-2 Submitting query: SELECT surveyID FROM ATLASDR3.Survey
   2.109 +I-QAS-QJOB-2 Submitted query at http://tap.roe.ac.uk/firethorn/tap/56/async/505778
   2.110 +I-QAS-QSUB-3 Submitting query: SELECT TOP 8 sdssPrimary, sdssType AS taplint_c_2, A.distanceMins, slaveObjID AS taplint_c_4, masterObjID FROM ATLASDR3.atlasSourceXDR5PhotoObj AS A
   2.111 +I-QAS-QJOB-3 Submitted query at http://tap.roe.ac.uk/firethorn/tap/56/async/505779
   2.112 +I-QAS-QSUB-4 Submitting query: SELECT masterObjID FROM ATLASDR3.atlasSourceXDR5PhotoObjAll
   2.113 +I-QAS-QJOB-4 Submitted query at http://tap.roe.ac.uk/firethorn/tap/56/async/505780
   2.114 +I-QAS-DUFF-1 Submitting duff query: DUFF QUERY
   2.115 +I-QAS-QJOB-5 Submitted query at http://tap.roe.ac.uk/firethorn/tap/56/async/505781
   2.116 +S-QAS-QNUM-1 Successful/submitted TAP queries: 4/4
   2.117 +S-QAS-QTIM-1 Average successful query time: 2.2s
   2.118 +
   2.119 +Section UWS: Test asynchronous UWS/TAP behaviour
   2.120 +I-UWS-CJOB-1 Created new job http://tap.roe.ac.uk/firethorn/tap/56/async/505782
   2.121 +I-UWS-POPA-1 POSTed runId=TAPLINT-002 to http://tap.roe.ac.uk/firethorn/tap/56/async/505782/parameters
   2.122 +I-UWS-POPA-2 POSTed PHASE=ABORT to http://tap.roe.ac.uk/firethorn/tap/56/async/505782/phase
   2.123 +I-UWS-POPA-3 POSTed ACTION=DELETE to http://tap.roe.ac.uk/firethorn/tap/56/async/505782
   2.124 +I-UWS-CJOB-2 Created new job http://tap.roe.ac.uk/firethorn/tap/56/async/505783
   2.125 +I-UWS-CJOB-3 Created new job http://tap.roe.ac.uk/firethorn/tap/56/async/505784
   2.126 +I-UWS-VUWS-1 UWS job document implicitly V1.0
   2.127 +I-UWS-POPA-4 POSTed PHASE=RUN to http://tap.roe.ac.uk/firethorn/tap/56/async/505784/phase
   2.128 +
   2.129 +Section MDQ: Check table query result columns against declared metadata
   2.130 +I-MDQ-QSUB-1 Submitting query: SELECT TOP 1 * FROM "FIRST".first08Jul16Source
   2.131 +I-MDQ-QSUB-2 Submitting query: SELECT TOP 1 * FROM "FIRST".firstSource
   2.132 +I-MDQ-QSUB-3 Submitting query: SELECT TOP 1 * FROM "FIRST".firstSource12Feb16
   2.133 +E-MDQ-RRTO-1 Too many rows returned (2 > 1 for SELECT TOP 1 * FROM "FIRST".firstSource12Feb16
   2.134 +I-MDQ-QSUB-4 Submitting query: SELECT TOP 1 * FROM ATLASDR1.ArchiveCurationHistory
   2.135 +I-MDQ-QSUB-5 Submitting query: SELECT TOP 1 * FROM ATLASDR1.AstrCalVers
   2.136 +I-MDQ-QSUB-6 Submitting query: SELECT TOP 1 * FROM ATLASDR1.CurationTask
   2.137 +I-MDQ-QSUB-7 Submitting query: SELECT TOP 1 * FROM ATLASDR1.CurrentAstrometry
   2.138 +I-MDQ-QSUB-8 Submitting query: SELECT TOP 1 * FROM ATLASDR1.ExternalSurvey
   2.139 +I-MDQ-QSUB-9 Submitting query: SELECT TOP 1 * FROM ATLASDR1.ExternalSurveyTable
   2.140 +S-MDQ-QNUM-1 Successful/submitted TAP queries: 333/333
   2.141 +S-MDQ-QTIM-1 Average successful query time: 1.6s
   2.142 +I-MDQ-QSUB-x (324 more)
   2.143 +
   2.144 +Section OBS: Test implementation of ObsCore Data Model
   2.145 +I-OBS-NODM-1 Table capabilities lists no ObsCore DataModel - no ObsCore tests
   2.146 +
   2.147 +Section UPL: Make queries with table uploads
   2.148 +F-UPL-NOUP-1 Table capabilities lists no upload methods - will not attempt upload tests
   2.149 +
   2.150 +Section EXA: Check content of examples document
   2.151 +I-EXA-EURL-1 Reading examples document from http://tap.roe.ac.uk/osa/examples
   2.152 +F-EXA-EXNO-1 No examples document at http://tap.roe.ac.uk/osa/examples
   2.153 +
   2.154 +Totals: Errors: 1; Warnings: 0; Infos: 403; Summaries: 18; Failures: 2
   2.155 +
   2.156 +
   2.157 +
   2.158 +## E-MDQ-RRTO-1 Too many rows returned (2 > 1 for SELECT TOP 1 * FROM "FIRST".firstSource12Feb16
   2.159 +## Have not seen this one before..
   2.160 +
   2.161 +
   2.162 +