Pablo Rodríguez Gonzálvez and Luis Javier Sánchez Aparicio research stay at University of Minho (Portugal).

Dr. Pablo Rodríguez Gonzálvez and PhD student Luis Javier Sánchez Aparicio, during the month of December 2015, carried out a research stay at University of Minho. This stay allowed the setup of several potential research lines listed below:

  • DIC 3D (Digital Image Correlation 3d). The basic principle of DIC is the tracking (or matching) of the different areas of the images, captured by a digital camera during the test (before and after deformation occurs). This approach allows the evaluation of the displacements suffered in different parts of the specimen and the evaluation of the so-called stress-strain curves. This methodology proves to have important advantages, in comparison with traditional sensors like strain gauges or LVDT´s, such as non-invasiveness or its full-field data information.
  • Characterization of knots, fibber’s direction and other relevant aspect in timber structures. The use of image-based approaches can reconstruct timber structures with great density, accuracy and feature-rich (photorealistic texture) on which is possible to evaluate different geometrical imperfections of timber structures such as the presence of knots or lack of material. Also the density of the product (point cloud or orthophoto) allows the characterization of the fibber direction. This potential research line can complement the Italian code (UNI 11035) for the mechanical characterization of timber structures.
    Timber_2 Timber_1Orthophoto of different timber speciments evaluated. 
  • Photogrammetry with borescope and endoscope cameras. Borescope and endoscope cameras are useful tools in medicine and engineering. Allowing the inspection of inner parts of elements (such as pipes or masonry walls). However this inspection only provides visual data (images or videos) without any metric property of the scene capture. Is in this field where the photogrammetry can provided the solution.

 

Endoscope

Detail if the point cloud obtained with a endoscope camera.

Comparison

 

Comparison between the photogrammetric model carried out with a Canon 700d and a endoscope camera.

Both researchers also carrie dout some investigation of the Saint Francisco and Saint Antonio entrances (Almeida,Portugal).

 

Almeida

Research and collaboration stay of Diego Gonzalez-Aguilera at the Dublin City University-DCU (Ireland)

U_dublin

 

During the month of November, 2015, several research lines and transfer of technology were setup with different research groups at DCU. In addition, several seminars based on image-based modelling applied to engineering and architecture and innovation and technology transfer to other areas of interest were given trying to find pontential areas of sinergies and new applications.

FaceMAP

  • It consists of a patented device (hardware) along with a software program registered with intellectual property.
  • At present, there is no police database working with 3D facial models.
  • There are no recognition strategies that allow working with 3D models, only those supported by images.
  • There are recognition algorithms of 3D objects.
  • 3D facial models would provide greater reliability and accuracy in the recognition and identification of individuals in contrast to the traditional 2D police reviews

Weldmap

WELDMAP enables testing and validating welds by generating 3D micro models with metric properties and submillimeter resolution. Its application is focused on the external inspection and control of welds. Its primary target shall be companies specialized to quality controls for the metallurgical sector.

Currently, visual inspections of welds are performed in situ by a inspector, weld to weld, with the consequent increase in operating costs for companies. Despite performed this task by a qualified inspector, providing accuracy in the verification according to the ISO standards is not possible due to the degree of detail required (millimeter/submillimeter) and the limitations of the available tools for that purpose (e.g. calipers). In addition, whenever an inspection is done there is no comprehensive record of their status, so that processes and maintenance costs cannot be optimized. This last point is crucial to the case of infrastructures which have a large number of welded joints such as oil and gas pipelines.

DCU

Diego González Aguilera research stay at Visual Attention Lab (Boston, USA)

  Diego González Aguilera research stay at Visual Attention Lab

Diego Gonzalez Aguilera was invited by the Visual Attention Lab (Dr. Marc Pomplun) in the University of Massachusset (Boston, USA) for carrying out a research stay during 3 months (July-October, 2015). The research was focused on advancing methods and algorithms for connecting visual attention and photogrammetry. In particular, a connection between photogrammetry and the visual attention devices (Eye Tracker) was proposed. More precisely, we took advantage of the algorithms and approaches of photogrammetry to integrate them in the visual attention workflow. To this end, we exploited the General Method of Photogrammetry (GMP) making a parallelism between its main steps and those required by the eye trackers. As a result we aimed to improve the precision and reliability of the eye tracker measurements: from its calibration and determination of eye pose to the computation of visual attention object’s coordinates (gaze position). We also tried to improve the current applications performed on the laboratory and under a 2D context, extending towards the visual attention in a 3D environment. 

Understand the basis of photogrammetry and its principles entails to advance in the knowledge and comprehension of the human vision and how we are able to perceive the reality through eyes in three dimensions. The acquisition of reality through the vision system involves that the light rays (coming from natural or artificial light source) reach and pass through the eyes, which are sensible to the electromagnetic radiation of specific wavelengths (i.e. visible spectrum). In particular, when the light comes into the eye passes through the cornea, the pupil and the crystalline, arriving to the retina where the electromagnetic energy is converted into nerve impulses that can be used by the brain. These impulses leave the eye through the optic nerve. In photogrammetric terms, the region most important of the eye is located around a small region in the retina well-known as fovea. At this place all the light coming from the field of view is focused what is equivalent to the field of view of the camera. However, it should be remarked that although the field of view of each eye separately is around 120º-200º and 130º for the overlap area of both eyes (i.e. equivalent to the fisheye objectives), the retina’s effective region is only between 40-60º (even less if we are focusing on small objects at very close distances). So, the rest of the field of view of the eye is only useful for perceiving large objects or movements. Likewise, for the digital cameras this field of view is dependent of two main geometric parameters (focal length and sensor size) which are perfectly defined, whereas for the human vision this is complicated since the eye is curved and the level of detail decreases as we move away from the fovea’s center.

 

The next figure outlines the relationship between the geometry of the human eye with the geometry of the camera lens.

Diego González Aguilera research stay at Visual Attention Lab

Geometric eye model. (a) Outer view and (b) cross-section of the human eye with important components marked red. (c) Geometric eye model with components involved in the eye pose estimation.

The next figure outlines some of the experiments performed trying to improve eye-tracker calibration and thus to improve eye-tracker measurements.

Diego González Aguilera research stay at Visual Attention LabEyeLink 1000 during the experimental tests performed.

Diego González Aguilera research stay at Visual Attention Lab

Collaboration stay of Monica Herrero Huerta at The Technological University Of Delft (The Netherlands)

Monica_herrero_huerta_stay

Visit to the Dutch meteorological institute KNMI in Utrecht with the Remote Sensing group of TUDelft.

Collaboration stay of Monica Herrero Huerta at the Technological University of Delft (The Netherlands) from February to July 2015 in the department of Geoscience and Remote Sensing.

The stay was focused on the direct participation in the FP7 project IQmulus (http://iqmulus.eu/), “A High-volume Fusion and Analysis Platform for Geospatial Point Clouds, Coverages and Volumetric Data Sets”, led by Dc. Roderik Linderbergh. Specifically, the research was centered on:

  • Data processing through Laser Mobile Mapping System (LMMS) to extract sizes and locations of urban trees. This work considers the automated,large scale extraction of parameters of trees sampled by a laser mobile mapping system. The input point clouds areconsecutivelydownsampled,retiled, classified and segmentedintoindivual trees. The applicationofLMMS enables to fast and accurately capture 3D data of individual trees along the road.

    Mónica_herrero_huerta_2.jpgMónica_herrero_huerta_3.jpg

  • Extraction of tree geometrical parameters coming from LMMS for direct application in urban trees inventories. A non-invasive low-cost, precise and innovative methodology was developing, to automatically obtain the diameter at breast height (DBH) of urban trees destined for inventories based on point clouds by LMMS. Among the various urban tree measurements, DBH is an important tree inventory attribute because it serves as a fundamental parameter in tree allometry and estimation of basal area, thus providing valuable information about individual trees and tree stand structure.

Monica_herrero_huerta_stay_4.jpg

The work will be presented at the ISPRS geospatial week in La Grande Motte (France) between 28th October and 3rd Setpember 2015.

Página 4 de 512345
×
Análisis termográfico de edificios

 

El uso de la termografía infrarroja comMapaEnergeticoo técnica sobradamente provada para la inspección de edificios y localización de patologías como fugas de aire, humedades, etc. Nos permite realizar un examen visual “in-situ” de calidad de los objetos de estudio gracias a la posibilidad de visualizar en tiempo real los resultados pudiendo detectar sin dificultad los desperfectos o elementos característicos de estos. Estas técnicas de medición cualitativa nos proporcionan la posibilidad de realizar inspecciones rápidas y eficaces sin contacto directo con el objeto y de forma no destructiva, lo que disminuye tanto el riesgo de incidentes para los operarios como los daños producidos en los propios objetos de estudio ocasionados por otras técnicas intrusivas. Además, también se ha demostrado la utilidad de la termografía infrarroja como técnica puramente de medida a través de su utilización para el cálculo de propiedades termofísicas de materiales tales como difusividad y transmitancia térmica.

En el caso de termografía cualitativa, las publicaciones existentes tratan de estudios realizados in-situ, principalmente en edificios históricos o elementos del patrimonio cultural, mientras que los estudios cualitativos se realizan, en la mayor parte de los casos, en laboratorios sobre muestras de tamaño limitado. En aquellos casos en los que se han realizado estudios termográficos cuantitativos sobre edificios in-situ, los valores de temperatura son empleados con el objetivo de obtener propiedades termofísicas (conductancia térmica) reales del cerramiento, sin embargo su distribución espacial no es considerada.

Conjugar ambas aplicaciones permitirá la automatización del cálculo de pérdidas de calor a partir de las temperaturas medidas con una cámara termográfica. De este modo, no solo se usa la termografía para representar el estado de la pared, sino que también se usan los valores de temperatura contenidos en la termografía para la extracción de parámetros métricos del edificio en estudio, por lo que la hibridación de la información termográfica con el material cartográfico de precisión permitiría extraer la geometría real del objeto de estudio con textura termográfica, pudiendo así realizar mediciones precisas de los elementos de interés directamente sobre el resultado obtenido.

 

20140220-usal-ensmart-panoramica-728

 

Estudios como el publicado por EuroACE en 2010 colocan la mejora de la eficiencia energética en edificación en cabeza de las acciones necesarias para la reducción de emisiones de gases del efecto invernadero y gasto energético, así como para servir de empuje a la generación de empleo. Especial es el caso del parque de edificios ya construidos, la mayoría procedente de los años 1940-80, con normativa inexistente y recursos escasos. En ellos las obras de rehabilitación energética pueden suponer un ahorro de hasta el 75% en consumo de energía. En España existen 13 millones de viviendas susceptibles de intervención, cuya rehabilitación energética supondría una reducción de las emisiones del sector del 34% con respecto al año 2001.

×
Building thermographic analysis

 

 

The use of infraMapaEnergeticored thermography as a widely tested technique for building inspection and location of pathologies such as air leakage and moisture allows the performance of  quality “in-situ” visual examination of the objects under study due to the possibility of obtaining real-time results, being able to detect without difficulty damages or material characteristics. This qualitative measurement technique provides the capability of doing quick, effective and non-destructive inspection without direct contact with the object under study, decreasing the risk of incidents to operators and the damage of the objects comparing with other intrusive techniques. Furthermore, the utility of infrared thermography as a measurement technique has been proved by its use for the determination of the thermophysical properties of materials such as diffusivity and thermal transmittance.

In the qualitative approach, some authors have performed in-situ studies, mainly in historical buildings or cultural heritage elements, whereas quantitative studies are performed mainly in laboratories with limited size samples. In those cases where quantitative thermography studies were performed in-situ, temperature values were employed in order to obtain the real thermophysical properties (thermal conductance) of the building envelope, but their spatial distribution is not considered.

Combine both applications will enable the automation of the heat loss computation from the measured temperatures with a thermographic camera. Thus, the thermography is not only used to represent the state of the wall, but also temperature values represented on the thermography for extracting the metric parameters of the study object so the hybridization of the thermographic information with precise cartographic material would  allow to extract the actual geometry of the object of study with thermal texture, being able to make accurate measurements of the elements of interest directly on the obtained results.

 

20140220-usal-ensmart-panoramica-728

 

Studies such as the one published by EuroACE in 2010, places improved energy efficiency in building construction at the top of the list of actions that need to be taken to reduce greenhouse gases and energy costs, in addition to acting as a stimulus to generate employment. In particular is the case of existing buildings stock, most of which dates back to the period 1940-80, constructed using non-existent standards and scarce resources. Here, energy refurbishment works could represent a saving of up to 75% in energy consumption. In Spain there are 13 million homes that could be the subject of intervention, where energy refurbishment could result in a reduction in sector emissions of 34% compared to 2001.

 

×
×
Ventana modal ingles
×
Ventana modal español
×
Mobile Laser System (MLS) applied to urban tree inventory

In urbanized Western Europe trees are considered an important component of the built-up environment. This also means that there is an increasing demand for tree inventories. Laser mobile mapping systems provide an efficient and accurate way to sample the 3D road surrounding including notable roadside trees. In this research line, a processing chain aiming at the extraction of tree locations and tree sizes from laser mobile mapping data is reached.

  • Vegetation extraction

MLS_urban_3

  • Tree parameter extraction

MLS_urban_2

 

Such steps, in combination with code optimization are expected to be sufficient to reach the final goal of automatized estimation of features sampled by mobile mapping at a rate that matches the acquisition speed and at a quality that matches the result of a human operator.

×
Miembro del grupo TIDOP

Lloyd A. Courtenay

Graduado en arqueología por la Universidad Complutense de Madrid. Actualmente está acabando un Máster en Arqueología del Cuaternario y Evolución Humana por la Universidad Rovira i Virgili, Tarragona, con el objetivo de seguir con su formación investigadora matriculándose en un programa de Doctorado en prehistoria para el próximo año académico. Habiéndose especializado en el campo de la tafonomía, trabaja principalmente en el estudio microscópico de los restos óseos que aparecen en los yacimientos arqueológicos y paleontológicos. Su principal campo de investigación está dirigido hacia la aplicación de nuevas metodologías en yacimientos del Pleistoceno Inferior Africano. En los últimos años ha emprendido su carrera profesional adaptando los nuevos avances estadísticos en otros campos como la Inteligencia Artificial, buscando maneras de aplicarlos al estudio del registro fósil. Siguiendo esta línea de investigación, ha conseguido desarrollar una serie de algoritmos aplicando métodos de Machine y Deep Learning para el procesado de datos derivados de modelos 3D. Con el diseño de algoritmos complejos como las Redes de Neuronas Artificiales y las Máquinas de Vectores de Soporte, ha desarrollado nuevos modelos estadísticos que pueden distinguir entre la actividad de diferentes carnívoros a través de las marcas de dientes que dejan. Estos modelos permiten también la clasificación de las alteraciones microscópicas halladas como producto de agentes naturales o por el contrario, si fueron consecuencia de las actividades de caza de los antiguos homínidos.

Líneas de investigación:

  • Tafonomía y zooarqueología aplicado al estudio del Pleistoceno Inferior
  • Desarrollo de nuevos métodos para el estudio microscópico de los restos fósiles
  • Diseño y aplicación de nuevos métodos estadísticos en la arqueología, incluyendo la aplicación de técnicas 3D para la documentación de restos óseos, y el uso de algoritmos de Inteligencia Artificial para procesar tales datos
×
TIDOP Member

Lloyd A. Courtenay

An Archaeology graduate having studied in the Complutense University of Madrid, he is currently finishing his Master’s degree in Quaternary Archaeology and Human Evolution in the University Rovira I Virgili, Tarragona. Starting next academic year, he intends to continue his professional career by enrolling in a Doctoral programme in prehistory. Specialised in the field of taphonomy, he works primarily on the microscopic study of osteological materials found in archaeological and paleontological sites. His main field of research lies in the development of new methods for the study of Lower Pleistocene sites in Africa. Over the last couple of years, he has focused his research on the adaptation of new statistical advances from other fields of research, such as Artificial Intelligence, with the hope of finding new means of applying these techniques to the prehistoric fossil register. Through this line of research, he has achieved the development of Machine and Deep Learning algorithms for the processing of 3D data. His most notable advances have included the development of Artificial Neural Networks and Support Vector Machines for the differentiation of carnivore activity through the tooth marks animals may leave on bone. He has also achieved models that are able to successfully classify microscopic traces, discerning between natural agents and those produced by ancient hominids in prehistoric butchery practices.

Research lines:

  • Taphonomy and zooarchaeology applied to the Lower Pleistocene
  • Development of new methodological approaches for the study of fossil remains
  • Design and application of new statistical models for archaeological studies, including 3D modelling for the documentation of bone, and the use of Artificial Intelligence algorithms for the processing of this data
×
Drones terrestres aplicados al modelizado tridimensional e inspección de infraestructuras críticas y de difícil acceso.

dron_2

Equipar drones con sensores láser, detectores de obstáculos y sistemas de control remoto permite obtener de forma segura y fiable los modelos tridimensionales de escenarios críticos, entendiendo como escenarios críticos todos aquellos escenarios en los que una persona correría peligro realizando los trabajos.

Este tipo de escenarios abarcan desde grutas angostas y estrechas a las que es difícil acceder, hasta escenarios industriales complejos, como subestaciones eléctricas, en las que existen riesgos de descargas eléctricas, salas de calderas, edificios con problemas estructurales etc.

A pesar de ser lugares críticos, su mantenimiento e inspección es un aspecto clave en el campo del control preventivo de averías y deformaciones, por lo que obtener el modelo tridimensional de estos lugares es fundamental. En este sentido, los drones terrestres, cada vez más sofisticados, permiten integrar escáner láser terrestre para capturar el entorno, asi como detectores de obstáculos y diferentes sistemas de comunicación, de modo que pueden moverse de forma autónoma o ser teledirigidos de forma remota.

Hasta el momento se ha investigado la integración de drones terrestres y escáner láser utilizando dos metodologías de trabajo diferentes, según el grado de precisión y detalle que se necesite y dependiendo de las dimensiones del espacio en el que se esté trabajando.

 

Finalmente, se está investigando la manera de combinar los modelos tridimensionales obtenidos por los drones terrestres con datos procedentes de drones aéreos equipados con cámaras fotográficas o cámaras termográficas. Combinar ambos modelos es esencial para obtener una cobertura total de la escena de estudio y poder detectar anomalías en cualquier lugar. Ésta línea de acción se está introduciendo para controlar subestaciones eléctricas y plantas solares fotovoltaicas ya que en ambos casos es posible detectar zonas con un calentamiento anormal que indiquen un funcionamiento que deberá revisarse.

 

dron_4 dron_3

×
Land drones applied to three-dimensional modeling and control of complex industrial environments

dron_2

Land drones can be armed with different devices such as terrestrial laser scanner, obstacle detectors or remote control systems, in order to provide accurate 3D models of unattended or critical environments in a safe way.

Environments like narrow caves that are difficult to access, electrical substations where there are risk of electric shock, boiler rooms or buildings with structural problems are considered critical environments for human operators due to the danger they entail.

Despite being critical spaces, its maintenance, inspection and control are essential to prevent damages and detect breakdowns, so accurate three-dimensional models are indispensable. For this purpose, terrestrial drones allow the integration of terrestrial laser scanners to capture the environment, as well as obstacle detectors and different communication systems, so that they can be autonomous vehicles or remote-controlled vehicles.

Depending on the accuracy needed and the dimensions of the study case, two different  combinations of technologies have been explored, both combining laser scanner with land drones.

To complete this research line, we are working in different methodologies to combine 3D models obtained with land drones and data obtained with aerial drones equipped with conventional cameras or thermo graphic cameras.

Mix both kind of models make the three-dimensional model much more complete and it is possible to detect pathologies in almost everywhere.  Some of this process has been used with success in electrical substations and photovoltaic solar plants, detecting, for example, anomalies in some panels.

 

dron_4 dron_3

×
Ingeniero del grupo TIDOP

Daniel Barrio Aguilera

Titulado el primero de su promoción como Técnico Superior en Sistemas de Telecomunicaciones e Informáticos en 2018 por el IES Vasco de la Zarza. Consiguió la titulación de Cisco “CCNA Routing and Switching” con carta de recomendación del CEO de Cisco gracias a la demostración de sus habilidades y conocimientos en el campo de las redes informáticas con equipo Cisco. Actualmente estudiando un Ciclo Formativo de Grado Superior en Desarrollo de Aplicaciones Multiplataforma en el IES Alonso de Madrigal, enfocándose en la programación y desarrollo de aplicaciones informáticas.

Líneas de investigación:

  • Desarrollo de apliaciones geotecnologicas
×
TIDOP Engineering

Daniel Barrio Aguilera

Titled the first of his promotion as Senior Technician in Telecommunications and Computer Systems in 2018 by the IES Vasco de la Zarza. He obtained the Cisco degree “CCNA Routing and Switching” with a letter of recommendation from the Cisco CEO thanks to his skills and knowledge shown in the field of computer networks with Cisco equipment. Currently he is studying a Superior Degree Formative Cycle in Multiplatform Applications Development at the IES Alonso de Madrigal, focusing on the programming and development of computer applications.

Research lines:

  • Development of geomatic applications
×
Miembro del grupo TIDOP

Damián Ortega Terol

PhD en Geotecnologías Aplicadas a la Construcción, Energía e Industria (2018, Universidades de Salamanca y Vigo) con mención “cum laude” tras la finalización de su tesis doctoral titulada: “Innovación en el desarrollo de herramientas basadas en software libre para la explotación de imágenes aéreas y espaciales adquiridas con sensores de última generación”. Completa su formación académica con las titulaciones del graduado en Ingeniería Geomática y Topografía (2013, Universidad de Salamanca), Master Universitario en Geotecnologías Cartográficas en Ingeniería y Arquitectura (2011, Universidades de Salamanca y Valladolid), Ingeniero en Geodesia y Cartografía (2001, Universidad Politécnica de Valencia) e Ingeniero Técnico en Topografía (1998, Universidad Politécnica de Valencia). Posee una amplia experiencia en la programación de herramientas geomáticas basadas en software libre desarrollada en los diferentes puestos que ha ocupado: empresa pública Tragsatec (2001-2008), funcionario grupo A1 de la Escala de Técnicos Facultativos Superiores de los OOAA del Ministerio de Medio Ambiente (2008-2016) y en su reciente incorporación como funcionario de carrera en el Instituto Geográfico Nacional del Ministerio de Fomento (2016-actualidad).

Líneas de investigación:

  • Desarrollo de herramientas geomáticas basadas en software libre relacionadas con Sistemas de Información Geográfica, explotación de datos de Observación de la Tierra y Gestión Integrada de Recursos Hídricos.
×
TIDOP Member

Damián Ortega Terol

.

Research lines:

  • .
×