Abstract: A 3D camera and a photographing method thereof are provided. The 3D camera includes an image 1 photographing unit and an image 2 photographing unit in the same optical system and a processing system that processes data of the image 1 photographing unit and the image 2 photographing unit. The processing system includes a control unit that controls image photographing by the image 1 photographing unit and the image 2 photographing unit, a recording and storage unit that performs processing on the control unit, and a 3D coordinate calculation unit that performs calculation on the recording and storage unit. 3D coordinates of an object point in 3D space or all space object points constituting a 3D object directly facing the camera are calculated by simultaneously photographing one or more pairs of images for the object point in the 3D space or all space object points constituting the 3D object.

Abstract: According to an embodiment of the present invention, disclosed is a camera module comprising: a light output unit for outputting an optical signal to an object; a sensor for receiving an optical signal reflected from the object; and a control unit for acquiring distance information about the object by using the phase difference of the received optical signal, wherein the sensor includes a non-extraction area from which the phase different is not extracted and an extraction area from which the phase difference is extracted and the control unit stops timing control for the received optical signal in the non-extraction area.

Abstract: The invention relates to a computer-implemented method for providing a standardized position for anatomic structural data (ASD) of a patient scan, in particular as a basis for individually fitting an orthosis or prosthesis to a first patient. The method comprises the steps of receiving anatomic structural data (ASD) of a body part of the first patient, receiving and/or selecting template structural data (TSD) corresponding to the body part and adapting the orientation and/or the pose of the anatomic structural data (ASD) using the armature of the template structural data (TSD). Further, the invention refers to a computer-implemented method for providing standardized measurement on anatomic structural data (ASD) of a patient scan, a data processing system and a computer-readable medium.

Abstract: The present disclosure relates to an information processing device and a method capable of suppressing a reduction in encoding efficiency of point cloud data. As for a point cloud representing an object having a three-dimensional shape as a point group, position information of a point to be processed is predicted on the basis of position information of a reference point, position information of a prediction point is generated, a difference between the generated position information of the prediction point and the position information of the point to be processed is derived, the derived difference is encoded, and a bitstream is generated. The present disclosure may be applied to, for example, an information processing device, an electronic device, an information processing method, a program or the like.

Abstract: Metasurface elements, integrated systems incorporating such metasurface elements with light sources and/or detectors, and methods of the manufacture and operation of such optical arrangements and integrated systems are provided. Systems and methods for integrating transmissive metasurfaces with other semiconductor devices or additional metasurface elements, and more particularly to the integration of such metasurfaces with substrates, illumination sources and sensors are also provided. The metasurface elements provided may be used to shape output light from an illumination source or collect light reflected from a scene to form two unique patterns using the polarization of light. In such embodiments, shaped-emission and collection may be combined into a single co-designed probing and sensing optical system.

Abstract: A method for generating a 3D model of a scene is disclosed herein. An imaging device included in a 3D modeling system obtains a first set of depth data. The first set of depth data includes pixels of a plurality of frames of depth images. A scanning device included in the 3D modeling system obtains a second set of depth data. The second set of depth data includes depth data points of a plurality of image frames. The 3D modeling system receives a set of color data of the scene. The set of color data includes pixels of a plurality of color images. The 3D modeling system generates the 3D model of the scene based on the set of color data, the first set of depth data and the second set of depth data. The 3D modeling system causes display of the 3D model of the scene.

Abstract: A camera module according to an embodiment of the present invention comprises: a light output portion for successively outputting a first output light signal and a second output light signal, which are emitted to an object, during a single period; a lens portion for concentrating a first input light signal and a second input light signal, which are reflected from the object, the lens portion comprising an infrared (IR) filter and at least one lens disposed on the IR filter; an image sensor for generating a first electric signal and a second electric signal from the first input light signal and the second input light signal, which have been concentrated by the lens portion; a tilting portion for shifting optical paths of the first input light signal and the second input light signal according to a predetermined rule; and an image control portion for acquiring depth information of the object by using the first electric signal and a phase difference between the first output light signal and the first input light

Abstract: A method for autonomously parking a vehicle-trailer system is provided. The method includes receiving sensor system data from a sensor system supported by the vehicle. The sensor system data includes images of surroundings along a driving path of the vehicle-trailer system. The method includes determining a local map based on the sensor system data. The local map includes surroundings along the driving path. The method includes receiving a user selection of an image location within the images. The image location representing a position in the local map associated with a selected location within the surroundings. The method includes determining a parking path from a current location of the vehicle-trailer system to the position based on the local map and instructing a drive system to execute an autonomous parking behavior causing the vehicle-trailer system to autonomously drive along the parking path and autonomously park in the selected location.

Abstract: An appearance inspection device (three-dimensional measuring device) includes a first measurement unit configured to measure three-dimensional information by a phase shift method, a second measurement unit configured to measure three-dimensional information by an optical cutting method, and a control device configured or programmed to acquire three-dimensional information on a measurement target based on measurement results of both the first measurement unit and the second measurement unit.

Abstract: A method for analyzing a rock sample includes segmenting a digital image volume corresponding to an image of the rock sample, to associate voxels in the digital image volume with a plurality of rock fabrics of the rock sample. The method also includes identifying a set of digital planes through the digital image volume. The set of digital planes intersects with each of the plurality of rock fabrics. The method further includes machining the rock sample to expose physical faces that correspond to the identified digital planes, performing scanning electron microscope (SEM) imaging of the physical faces to generate two-dimensional (2D) SEM images of the physical faces, and performing image processing on the SEM images to determine a material property associated with each of the rock fabrics.

Abstract: A memory array device includes a stack of transistors over a semiconductor substrate, a first transistor of the stack being disposed over a second transistor of the stack. The first transistor includes a first memory film along a first word line and a first channel region along a source line and a bit line, the first memory film being disposed between the first channel region and the first word line. The second transistor includes a second memory film along a second word line and a second channel region along the source line and the bit line, the second memory film being disposed between the second channel region and the second word line. The memory array device includes a first via electrically connected to the first word line and a second via electrically connected to the second word line, the second staircase via and the first staircase via having different widths.

Abstract: A method for performing light shaping with aid of an adaptive projector and associated apparatus are provided.

Abstract: A method includes, receiving: (i) a selected three-dimensional (3D) section that has been ablated in a patient organ in accordance with a specified contour, and (ii) a dataset, which is indicative of a set of lesions formed during ablation of the selected 3D section. The selected 3D section is transformed into a two-dimensional (2D) map, and checking, on the 2D map, whether the set of lesions covers the specified contour.

Abstract: An image processing apparatus includes a first processing task configured to acquire surface normal information of an object, a second processing task configured to acquire a plurality of first images acquired by capturing the object while changing a polarization angle of light from the object, a third processing task configured to acquire polarization information of the object, and a fourth processing task configured to generate a second image in which an illumination state of the object is different from that of each first image. The third processing task acquires light intensity information that changes according to the polarization angle, using the first images. The fourth processing task extracts a partial area of the first images using the surface normal information, and generates the second image using the partial area and the light intensity information.

Abstract: The technology described in this document can be used to implement beam steering in optical systems and photonic devices, to provide a nonmechanical beam steering system for projecting optical energy and controlling the direction of the optical energy using a collection of devices and components that are fixed in position to selectively direct light from an array of different optical emitters at different locations.

Abstract: A system for capturing a 3D image of a subject includes a detection device which is structured to capture images of the subject and surrounding environment, a projection device which is structured to provide a source of structured light, and a processing unit in communication with the detection device and the projection device. The processing unit is programmed to: analyze an image of the subject captured by the detection device; modify one or more of: the output of the projection device or the intensity of a source of environmental lighting illuminating the subject based on the analysis of the image; and capture a 3D image of the subject with the detection device and the projection device using the modified one or more of the output of the projection device or the intensity of the source of environmental lighting illuminating the subject.

Abstract: An apparatus including a capture device, an illumination device and a processor. The capture device may be configured to generate pixel data corresponding to an exterior view from a vehicle. The illumination device may be configured to generate light for the exterior view. The processor may be configured to generate video frames from the pixel data, perform computer vision operations on the video frames to detect objects in the video frames and generate a control signal. The objects detected may provide data for a vehicle maneuver. The control signal may adjust characteristics of the light generated by the illumination device. The characteristics of the light may be adjusted in response to the objects detected by the processor. The light from the illumination device may facilitate detection of the objects by the processor.

Abstract: According to an example, a method for determining an ergonomic layout for a plurality of secondary devices comprises detecting the plurality of secondary devices, determining characterizing data for each of the detected secondary devices, the characterizing data comprising a type of secondary device and a location of a secondary device with respect to a primary device, determining a workspace layout based on the determined location, determining an ergonomic layout in which the primary device and the plurality of secondary devices are distributed in accordance with the type of secondary device, comparing the ergonomic layout to the workspace layout, and determining a set of changes for the plurality of secondary devices based on the comparison.

Abstract: A quantitative evaluation method for integrity and damage evolution of a cement sheath in an oil-gas well is provided based on a fractal theory, an image processing technology, structural features and failure mechanisms of a casing-cement sheath-formation combination. The method uses correlations among fractal dimensions of casing-cement sheath interface morphology, cement sheath microscopic pore morphology, particle morphology of an initial blank group, and macroscopic mechanical properties including a radial cementing strength of the cement sheath interface, a tensile strength, and a compressive strength to quantitatively evaluate the integrity of the cement sheath of the blank group.

Abstract: Sub-diffraction limited fluorescent images using a fiber-based stimulated emission depletion (STED) microscope are reported. Both excitation and depletion beams are transported through polarization-maintaining fiber and a lateral resolution of 100 nm has been achieved.

Abstract: According to one embodiment, a method, computer system, and computer program product for wearable device activity analysis is provided. A computer receives a video of an activity. The computer identifies the activity based on analyzing the video. The computer identifies body movements from the video. The computer correlates the activity and the body movements to a wearable device. The computer identifies additional inputs for the activity and updates the wearable device based on the identified additional inputs.

Abstract: Systems and methods for training and utilizing predictive models that ignore missing features in accordance with embodiments of the invention are illustrated. One embodiment includes a method for generating representations of inputs with missing values. The method includes steps for, at a single layer in a multi-layer model, receiving an input includes a set of one or more values for several features and identifying a missingness pattern of the input, wherein the missingness pattern indicates whether the set of values is missing a value for each of the several features. The method further includes determining a set of one or more transformation weights based on the missingness pattern and transforming the input based on the determined transformation weights.

Abstract: Methods, systems and computer program products (“software”) enable a virtual three-dimensional visual experience (referred to herein as “V3D”) in videoconferencing and other applications, and capturing, processing and displaying of images and image streams.

Abstract: Techniques of designing a sensing system for pseudo 3D mapping in robotic applications are described. According to one aspect of the present invention, an image system is designed to include at least two linear sensors, where these two linear sensors are positioned or disposed orthogonally. In one embodiment, the two linear sensors are a horizontal sensor and a vertical sensor. The horizontal sensor is used for the lidar application while the vertical sensor is provided to take videos, namely scanning the environment wherever the horizontal sensor misses. As a result, the videos can be analyzed to detect anything below or above a blind height in conjunction with the detected distance by the lidar.

Abstract: Sensors, including time-of-flight sensors, may be used to detect objects in an environment. In an example, a vehicle may include a time-of-flight sensor that images objects around the vehicle, e.g., so the vehicle can navigate relative to the objects. Sensor data generated by the time-of-flight sensor can include returns associated with highly reflective objects that cause glare. In some examples, a depth of a sensed surface is determined from the sensor data and additional pixels at the same depth are identified. The subset of pixels at the depth are filtered by comparing a measured intensity value to a threshold intensity value for the depth. Other threshold intensity values can be applied to subsets of pixels at different depths.

Abstract: The embodiments of the disclosure provide a method for interacting with a virtual world, a host, and a computer readable storage medium. The method includes: determining a hand gesture and accordingly determining an indicator in the virtual world; in response to determining that the hand gesture is a pinch gesture, performing a specific function corresponding to a position indicated by the indicator in the virtual world or a specific object indicated by the indicator in the virtual world.

Abstract: Disclosed is a touch control method for a display. The method includes: after a reflection signal is received by means of a receiving component of a laser sensor, generating an image according to a laser signal and the reflection signal; acquiring gesture information of a user according to the image; and executing a control operation corresponding to the gesture information. Further disclosed are a terminal device and a computer-readable storage medium.

Abstract: A multipulse LIDAR system, including: a transmitting device for generating a transmission laser beam from a temporal sequence of single laser pulses; a receiving device with a detection surface, including a subdetector system made up of multiple subdetectors, for receiving the transmission laser beam that is reflected/scattered on objects in an observation area, the receiving device imaging a sampling point on the detection surface in the form of a pixel; a scanning device generating a scanning movement for successive sampling of the observation area along multiple sampling points situated in succession, the scanning movement to image a pixel on the detection surface, in each case shifted along the subdetector system; and a control device for determining distance information of the sampling points based on propagation times of the particular single laser pulses, the control device grouping subdetectors to form a macropixel individually associated with the particular pixel, for shared evaluation.

Abstract: A controller (11) for a vehicle, the vehicle comprising an imaging device for generating image data and the imaging device further comprising an imaging accelerometer (24) for generating imaging accelerometer data for determining the orientation of the imaging device relative to the vehicle, the controller (11) comprising: an input for receiving a signal indicative of the imaging accelerometer data and the generated image data; a processor arranged to identify alignment artefacts in the received image data in dependence on the received imaging device imaging accelerometer data; and an output for outputting an error signal in dependence on the identified alignment artefacts.

Abstract: Embodiments include providing a computer vision video stream and a human vision video stream using a single camera. The camera can comprise a single, high-resolution senor and a wide-angle lens providing high resolution video having a wide aspect ratio field of view. The streams can be generated, wherein the computer vision video stream maintains the wide aspect ratio field of view and the human vision video stream comprises high resolution video. The computer vision video stream can be provided to a computer vision system, wherein the computer vision system uses the computer vision video stream as input for an automated process, and the human vision video stream can be provided to a system that displays the human vision video stream to a user.

Abstract: A method for incorporating a real object at varying depths within a rendered three-dimensional architectural design space can include capturing data from a real environment, wherein the real environment comprises at least one real object within a physical architectural space. The method can also comprise extracting the at least one real object from the captured data from the real environment. Further, the method can include providing a rendered three-dimensional architectural design space comprising at least one virtual architectural component. The method can also include projecting the captured data from the real environment on a first plane within the rendered three-dimensional architectural design space and projecting the extracted at least one real object on a at least one additional plane within the rendered three-dimensional architectural design space, such that the rendered at least one real object is properly occluded within the rendered three-dimensional architectural design space.

Abstract: A method of measuring a distance between a vehicle and one or more objects, includes generating a modulation signal; generating a modulated light emitting diode (LED) transmission signal, via a vehicle LED driver assembly; transmitting a plurality of light beams based at least in part on the generated modulated LED transmission signal; capturing a reflection of the plurality of light beams off the one or more objects, utilizing one or more lens assemblies and a camera, the camera including an array of pixel sensors and being positioned on the vehicle; communicating a series of measurements representing the captured plurality of light beam reflections; calculating, utilizing the time-of-flight sensor module, time of flight measurements between the vehicle LED light assembly and the one or more objects and calculating distances, utilizing a depth processor module, between the vehicle LED light assembly and the one or more objects based on the time-of-flight measurements.

Abstract: An optical sensing system and a method for eliminating misjudgment of a reflective light are provided. The optical sensing system includes a first light source, a second light source, a light sensor, and a processor. The processor is configured to: control the first light source to scan a horizontal detection area; control the light sensor to capture a first frame by receiving first reflective lights from the horizontal detection area; obtain a first reflection pattern, and analyze the first reflection pattern to determine whether an object is within the first portion; if so, control the second light source to scan a first vertical detection area; control the light sensor to capture a second frame from the first vertical detection area; process the second frame to obtain a second reflection pattern, and analyze the second reflection pattern to determine whether the object is detected by a misjudgment.

Abstract: A calibration device 100 for use in a calibration process of an electronic display screen 200 for touchless gesture control, the calibration device 100 comprising: a main body 102 defining a main axis 101 of the calibration device 100, wherein the main axis 101 extends from a proximal end 102a to a distal end 102b of the main body 102; a first foot 109a at the distal end 102b, the first foot 109a having a footing surface 110 being placeable on the electronic display screen 200 such that the footing surface 110 is in contact with and parallel to the electronic display screen 200, wherein the footing surface 110 is oriented at a predetermined angle, in particular 90°, with respect to the main axis 101 of the calibration device 100; a calibration pattern 103 comprising a machine-readable code being detectable by one or more optical sensors 300, in particular one or more depth cameras, wherein the one or more optical sensors 300 are arranged at or near the electronic display screen 200 and are configured to ob

Abstract: A method for controlling optional constraints to processing of multi-dimensional scene data via a user interface [UI] in an image management device is disclosed. The first step in this process is receiving a first data set of a scene having location information about a first location in an image wherein the first data set has a first performance metric. Next is activating a Constraint Manager having a plurality of constraint processes. The next step is selecting a first Constraint process from the plurality of constraint processes. Then receiving a new data set for the first constraint process to apply to the first data set, before finally activating the first Constraint process to incorporate the new data set to estimate a new location data set for the first location, wherein the new location data set has an improved performance metric as compared to the first performance metric.

Abstract: A system is provided which obtains images of a physical object captured by an AR recording device in a 3D scene. The system measures a level of diversity of the obtained images, for a respective image, based on at least: a distance and angle; a lighting condition; and a percentage of occlusion. The system generates, based on the level of diversity, a first visualization of additional images to be captured by projecting, on a display of the recording device, first instructions for capturing the additional images using the AR recording device. The system trains a model based on the collected data. The system performs an error analysis on the collected data to estimate an error rate for each image of the collected data. The system generates, based on the error analysis, a second visualization of further images to be captured. The model is further trained based on the collected data.

Abstract: A surveying instrument including a light projecting optical system which projects the distance measuring light, a light receiving optical system which receives the reflected distance measuring light from an object, a frame unit 5 which horizontally rotates around a horizontal rotation shaft, a scanning mirror which is provided in the frame unit, vertically rotates, a horizontal angle detector which detects a horizontal angle of the frame unit, a vertical angle detector which detects a vertical angle of the scanning mirror and an arithmetic control module which calculates the three-dimensional coordinates of the object, in which the light receiving optical system has a reflecting mirror having a reflecting surface which is an off-axis paraboloidal surface or an off-axis free-form surface, and the reflected distance measuring light is configured to be led to a light receiving module by the reflecting mirror while being condensed.

Abstract: A method for determining a reflectivity value indicating a reflectivity of an object is provided. The method includes performing a Time-of-Flight (ToF) measurement using a ToF sensor. A correlation function of the ToF measurement increases over distance within a measurement range of the ToF sensor such that an output value of the ToF sensor for the ToF measurement is independent of the distance between the ToF sensor and the object. The method further includes determining the reflectivity value based on the output value of the ToF sensor for the ToF measurement.

Abstract: An image processing device is provided with: a movement detection unit—for detecting, from time-series images, a first feature relating to the first movement of a head portion of a person and a second feature relating to the second movement of a body portion, which is a part of the person other than the head portion; and an index value calculation unit for calculating an index value which indicates the degree of consistency between the first feature relating to the first movement of the head portion of the person and the second feature relating to the second movement of the body portion of the person.

Abstract: Disclosed is a touch control method for a display. The method includes: after a reflection signal is received by means of a receiving component of a laser sensor, generating an image according to a laser signal and the reflection signal; acquiring gesture information of a user according to the image; and executing a control operation corresponding to the gesture information. Further disclosed are a terminal device and a computer-readable storage medium.

Abstract: Provided is a human posture detection method including: acquiring a plurality of frames of image data; acquiring a plurality of human posture reference maps output by a human posture detection model responsive to inputting a current frame of image data to the human posture detection model with reference to human posture confidence maps of a previous frame of image data, wherein different human posture reference maps correspond different human-posture key points; identifying a human-posture key point in each of the human posture reference maps; and generating human posture confidence maps of the current frame of image data based on credibility of the human-posture key points, wherein the human posture confidence maps of the current frame of image data is configured to participate in generation of human posture confidence maps of a next frame of image data.

Abstract: The invention provides a method for intelligently measuring vehicle trajectory based on a binocular stereo vision system, including the following steps: inputting a dataset into an SSD (Single Shot Multibox Detector) neural network to train a license plate recognition model; calibrating the binocular stereo vision system, and recording videos of moving target vehicles; detecting the license plates in the video frames with the license plate recognition model; performing stereo matching on the license plates in the subsequent frames of the same camera and in the corresponding left-view and right-view video frames by a feature-based matching algorithm; reserving correct matching point pairs after filtering with a homography matrix; screening the reserved matching point pairs, and reserving the one closest to the license plate center as the position of the target vehicle in the current frame; performing stereo measurement on the screened and reserved matching point pairs to get the spatial position coordinates of

Abstract: A method of and a system for synchronizing data for operating a Self-Driving Vehicle (SDV) are provided. The method comprises: causing, by an electronic device, a camera system and a LIDAR system to provide the image data and the map data to the electronic device in a common time referential, determining, by the electronic device, a first timestamp for the map data, determining, by the electronic device, a second timestamp for the image data, determining, by the electronic device, a temporal offset between the first timestamp and the second timestamp, using, by the electronic device, the temporal offset to trigger a delay between subsequent snapshots generated by the camera system.

Abstract: A method of recording images within a furnace using a thermal imaging camera comprising a bore scope connected to a digital camera unit is described, comprising the steps of: (a) inserting the borescope into the interior of the furnace, (b) collecting one of more images of the interior of the furnace using the thermal imaging camera with the borescope at a first position, and (c) moving the borescope from the first position to a second position and collecting one or more images of the interior of the furnace as the borescope is moved from the first position to the second position, wherein the borescope movement is guided by means of a guide device comprising a movable borescope mounting, mounted externally on the furnace.

Abstract: System for scanning a subject's teeth. Described herein are intraoral scanning apparatuses for generating a three-dimensional model of a subject's intraoral region (e.g., teeth). These apparatuses may be used for identifying and evaluating lesions, caries and cracks in the teeth.

Abstract: An apparatus and method are described for performing an early depth test on graphics data. For example, one embodiment of a graphics processing apparatus comprises: early depth test circuitry to perform an early depth test on blocks of pixels to determine whether all pixels in the block of pixels can be resolved by the early depth test; a plurality of execution circuits to execute pixel shading operations on the blocks of pixels; and a scheduler circuit to schedule the blocks of pixels for the pixel shading operations, the scheduler circuit to prioritize the blocks of pixels in accordance with the determination as to whether all pixels in the block of pixels can be resolved by the early depth test.

Abstract: An eyeglasses-type wearable device of an embodiment can handle various data inputs. The device includes right and left eye frames corresponding to positions of right and left eyes and nose pads corresponding to a position of a nose. Eye motion detection electrodes (sightline detection sensor electrodes) are provided with the nose pads to detect the eye motion of a user. Transmitter/receiver electrodes (capacitance sensor electrodes) of a gesture detector are provided with a part of the right and left eye frames to detect a gesture of the user. Various data inputs are achieved by a combination of input A corresponding to a gesture of the user detected by the gesture detector and input B corresponding to the eye motion of the user detected by the eye motion detector.

Abstract: An acoustic model determination approach for a real-time locating system is disclosed. The system includes one or more transmitting devices and one or more mobile devices. The acoustic model may be determined by deriving an acoustic representation of sub-structures within the building, and then forming the acoustic model based on the acoustic representation and the location and orientation of the static acoustic transmitting device. In another embodiment, an acoustic signal is transmitted from a static acoustic transmitting device, with the reflected signals received by the same static acoustic transmitting device in a receiving mode. Based on these received acoustic signals, the acoustic model is formed based on the reflected signals and the location and orientation of the static acoustic transmitting device.

Abstract: A head-up display includes a display panel, a parallax barrier, an optical system including a reflector and an optical member, and a controller. The optical system projects a virtual image of an image displayed by the display panel onto a virtual image plane. The controller controls the display panel such that first second images which have a parallax with each other are projected as a three-dimensional image in a field of view of the user, and a convergence angle at which the user views a point on the three-dimensional image is equal to or less than a maximum convergence angle which is greater by 0.43 degrees than a convergence angle for viewing a point on the virtual image plane and is equal to or greater than a minimum convergence angle which is less by 0.43 degrees than the convergence angle for viewing a point on the virtual image plane.

Abstract: Disclosed in the present invention is a camera module comprising: an optical output unit for outputting a first optical signal and a second optical signal to an object; a sensor for receiving a first reflected optical signal in which the first optical signal is reflected by the object; and a control unit for obtaining first distance information to the object by using the first optical signal and the first reflected optical signal, wherein an output of the first optical signal is smaller than an output of the second optical signal, and the control unit determines whether to output the second optical signal by using the first distance information.