Abstract: A method for processing a 360-degree image includes determining a processing order of each of a plurality of segments constituting a 360-degree image, based on positions of the segments and parameters of a camera by which the 360-degree image is captured, obtaining distortion correction information according to distortion in the 360-degree image predicted based on parameters of an optical device via which at least a partial region of the 360-degree image is projected, and processing data of the at least a partial region of the 360-degree image according to the determined processing order and the obtained distortion correction information.

Abstract: A method for processing a 360-degree image includes determining a processing order of each of a plurality of segments constituting a 360-degree image, based on positions of the segments and parameters of a camera by which the 360-degree image is captured, obtaining distortion correction information according to distortion in the 360-degree image predicted based on parameters of an optical device via which at least a partial region of the 360-degree image is projected, and processing data of the at least a partial region of the 360-degree image according to the determined processing order and the obtained distortion correction information.

Abstract: An array imaging apparatus having discrete camera modules is disclosed. In one embodiment, the apparatus comprises a substrate; and heterogeneous camera modules attached to the substrate and in a geometric relationship with each other, the heterogeneous camera modules having a substantially similar photometric response.

Abstract: An imaging system may include a plurality of networked imagers arranged in a geometric arrangement with respective fields of view covering part or all of a panoramic geometry, at least one inertial measurement unit (IMU) in communication with the networked imagers configured to generate orientation data indicating orientations of the plurality of networked imagers, and at least one processor in communication with the networked imagers and the at least one IMU. The at least one processor may be configured to receive a plurality of images from the plurality of networked imagers and combine the plurality of images into at least one combined image by positioning pixels of each of the plurality of images relative to pixels of the remaining plurality of images, associating the positioned pixels with the orientation data, and merging the oriented pixels of each of the plurality of images into the at least one combined image.

Abstract: Our present invention relates to a 180 degrees wide angle multi-camera system with the following unique features. The cameras are placed diagonally and facing inwards (100, 101, 102). The cameras are rotated 90 degrees around their optical axes to provide higher FOV for a wider view (302). In the illustrated embodiment of our invention, three cameras are placed in an inward position at particular angles to each other (105) to reduce the blind spot, parallax error and closer working distance. The multiple cameras are placed in an inward position and to avoid the adjacent camera in preview, each camera is placed diagonally. The inward position ensures the high horizontal FOV (202). The illustrated embodiment of our invention can be used in high Horizontal FOV and high Vertical FOV required applications.

Abstract: An image processing system includes a joining processing unit configured to perform a joining process to join input images captured by an image capturing device and generate an output image the image capturing device being reflected in each of the input images; and an acceptance unit configured to receive selection of one of a plurality of modes for the joining process. The plurality of modes has a first mode to generate an output image in which at least a part of the image capturing device is reflected, through the joining process; and a second mode to, through the joining process, generate an output image whose area where the image capturing device is reflected is smaller than an area where the image capturing device is reflected in the output image in the first mode or generate an output image in which the image capturing device is not reflected.

Abstract: A display method includes, when making a plurality of projectors including a first projector project projection light to display a single image, the steps of trying, by the first projector, to obtain first position information representing the projector corresponding to an installation position of the first projector, judging, by the first projector, whether or not first multi-configuration information corresponding to the first position information is stored when the first position information is obtained, and displaying, by the first projector, a first portion of the single image based on the first multi-configuration information when it is judged that the first multi-configuration information is stored.

Abstract: According to various embodiments, component information may be identified for each input image of an object. The component information may indicate a portion of the input image in which a particular component of the object is depicted. A viewpoint may be determined for each input image that indicates a camera pose for the input image relative to the object. A three-dimensional skeleton of the object may be determined based on the viewpoints and the component information. A multi-view panel corresponding to the designated component of the object that is navigable in three dimensions and that the portions of the input images in which the designated component of the object is depicted may be stored on a storage device.

Abstract: A photographing optical lens assembly includes six lens elements which are, in order from an object side to an image side: a first lens element, a second lens element, a third lens element, a fourth lens element, a fifth lens element and a sixth lens element. Each of the six lens elements has an object-side surface facing toward the object side and an image-side surface facing toward the image side. The first lens element has positive refractive power. The second lens element has negative refractive power. The third lens element has negative refractive power. The fourth lens element has negative refractive power. The fifth lens element has positive refractive power. The sixth lens element has negative refractive power. An axial distance between the fourth lens element and the fifth lens element is larger than an axial distance between the fifth lens element and the sixth lens element.

Abstract: A surround view monitoring system and a method for providing the same, including a plurality of registration cameras, each mounted on a vehicle and photographing different areas around the vehicle; a depth camera that acquires distance information with respect to an obstacle existing around the vehicle; an image synthesis unit that generates a synthesis image by synthesizing images photographed by the plurality of registration cameras, and displays the distance information with respect to the obstacle acquired by the depth camera on an obstacle existing in the synthesis image; and an image control unit that displays the synthesized synthesis image on a display device are disclosed.

Abstract: An illuminated sensor target includes a light source. Actuating the light source illuminates the sensor target. The illuminated sensor target is recognized by one or more sensors of a vehicle during a calibration process, and is used to calibrate the one or more sensors of the vehicle during the calibration process. The illuminated sensor target is illuminated during at least part of the calibration process, which may involve rotation of the vehicle about a turntable, with the illuminated sensor target positioned within a range of the turntable along with other sensors targets, which may also be illuminated.

Abstract: An apparatus comprising a housing, a mount configured to be coupled to a motor to horizontally move the apparatus, a wide-angle lens coupled to the housing, the wide-angle lens being positioned above the mount thereby being along an axis of rotation, the axis of rotation being the axis along which the apparatus rotates, an image capture device within the housing, the image capture device configured to receive two-dimensional images through the wide-angle lens of environment, and a LiDAR device within the housing, the LiDAR device configured to generate depth data based on the environment.

Abstract: An encoding method, playing method and apparatus for image stabilization of panoramic video, and a method for evaluating image stabilization algorithm are provided. The image stabilization method for the panoramic video is applicable to an electronic apparatus including a processor. In the method, a plurality of image frames of a panoramic video is captured, and each image frame is transformed into a plurality of projection frames on a plurality of faces of a cubemap. Then, variations of triaxial displacements and attitude angles between the projection frames transformed onto each of the faces and adjacent in time are calculated. The variations of triaxial displacements and attitude angles are smoothed and recorded as movement information. While playing the panoramic video, the panoramic video is corrected by the movement information and played. Thus, it is possible to reduce the amount of calculation required for the stabilization calculations on the captured video.

Abstract: The disclosure relates to a method for the situational transmission of surroundings data of a vehicle, comprising the steps: determining a driving situation of the vehicle; determining relevant surroundings data from recorded surroundings data based on the driving situation, wherein the relevant surroundings data are a subset of the recorded surroundings data that are relevant to the driving situation; and providing the relevant surroundings data to an external data processing device.

Abstract: An imaging apparatus mountable on a moveable apparatus includes a plurality of lighting-imaging units, each configured to capture an image of a different area on an object in a direction intersecting with a movement direction of the moveable apparatus. The each of the plurality of lighting-imaging units includes a light source unit configured to illuminate a partial area on the object as a lighting area; and an image capture unit configured to capture an image of an image capture area set within the lighting area. The plurality of lighting-imaging units captures an image of a non-overlapped lighting area on the object where the lighting areas of the plurality of lighting-imaging units do not overlap with each other.

Abstract: A system for generating real-time panoramic video is disclosed. The system comprises a plurality of micro panoramic cameras which are enabled on a processing unit and which are configured to simultaneously capture video frames from each of the plurality of micro panoramic cameras, wherein the video frames captured by two consecutive camera sensors from the plurality of camera sensors include an overlapping field of view, synchronize and feed the captured images to the processing unit with equal predefined delay, stitch the video frames captured by each of the plurality of micro panoramic cameras and output a real-time panoramic video on a display.

Abstract: An electronic device including first and second housings rotated on a hinge unit, a display exposed to an outside through the first and second housings, first and second cameras disposed respectively in the first and second housings, at least one sensor, and at least one processor, is provided. The at least one processor is configured to obtain first and second images using the first camera and second cameras, respectively, generate a first panoramic image based on the first and second images, detect a rotation of at least one of the first housing or the second housing through the hinge unit using the at least one sensor, obtain at least one image using at least one of the first or second cameras while the at least one housing rotates, and generate a second panoramic image based on the first panoramic image and the at least one image.

Abstract: A multicamera panoramic imaging system having no parallax. In an example, the multicamera panoramic imaging system includes multiple discrete, imaging systems disposed in a side-by-side array, wherein a field of view of each discrete, imaging systems is conjoined with a field of view of each adjacent discrete imaging system, further wherein a stencil of chief rays at the edge of the field of view of any one of the discrete imaging systems will be substantially parallel to a stencil of chief rays at the edge of the field of view of any adjacent ones of the discrete imaging systems such that all of the substantially parallel stencils of chief rays appear to converge to a common point when viewed from object space. A method for forming an image of an object having no parallax.

Abstract: A sensor pod system includes one or more sensor pods with a plurality of sensors configured to collect data from an environment. A sensor pod may have an effective field of view created by individual sensors with overlapping fields of view. The sensor pod system may include sensors of different types and modalities. Sensor pods of the sensor pod system may be modularly installed on a vehicle, for example, an autonomous vehicle and collect and provide data of the environment during operation of the vehicle. A combination of techniques may be used to calibrate a sensor pod prior to installation in the vehicle and may be used to determine if the sensor pod is compatible with other sensor pods and may also be used to calibrate other sensors when integrating the sensor pod into the vehicle.

Abstract: A video display method for a video display device is provided. The video display method comprises: acquiring a plurality of captured images from each of a plurality of cameras for each frame; generating a plurality of correction images from the plurality of captured images by performing parallax correction in each of the plurality of captured images for each frame, the parallax correction being performed between images captured by adjacent cameras; and compositing the plurality of correction images to generate a 360° panoramic composite image for each frame. An amount of the parallax correction of each captured image in each frame is limited so that an amount of change from a previous amount of the parallax correction in a previous frame is within a range defined by a predetermined limitation value.

Abstract: A scalable tracking system processes video of a space to track the positions of people within a space. The tracking system determines local coordinates for the people within frames of the video and then assigns these coordinates to time windows based on when the frames were received. The tracking system then combines or clusters certain local coordinates that have been assigned to the same time window to determine a combined coordinate for a person during that time window.

Abstract: A multi-lens camera is disclosed in the embodiment of the present application. The multi-lens camera includes a main casing assembly, lenses, a lens regulator, a supporting mechanism and a transparent cover; wherein the transparent cover is mounted on the main casing assembly, and the lens regulator is mounted within a space formed by the main casing assembly and the transparent cover; the transparent cover includes a flat portion and a curved portion surrounding the flat portion; the lens regulator includes a fixing disc and at least two lens brackets, and each of the lens brackets includes a first bracket for mounting a lens; the first bracket is movably arranged on the fixing disc and is movable along the circumferential direction of the fixing disc. The solution described above can solve the problem of the transparent cover of the multi-lens camera having poor resistance to deformation as described in the background.

Abstract: A method for estimating and adjusting crop residue parameters may include controlling an operation of a tillage implement as the implement is being towed by a work vehicle across the field to perform a tillage operation and receiving a pre-tilled image of an imaged portion of the field located to one side of a first section of the field as the implement is being towed across the first section of the field. The method may also include receiving a post-tilled image of the imaged portion of the field as the implement is being towed across the field, analyzing the pre-tilled and post-tilled images of the imaged portion of the field to estimate a crop residue parameter for the field, and, when the estimated parameter differs from a target associated with such parameter, actively adjusting the operation of the tillage implement in a manner designed to adjust the crop residue parameter.

Abstract: Disclosed herein are various embodiments for an augmented reality interaction, modeling, and annotation system. An embodiment operates by displaying a digital model of an object within an interface of an augmented reality computing system, wherein the model is associated with a first set of dimensions corresponding to a size of the object and a second set of dimensions corresponding to a size of the digital model. A command to resize the digital model to a third set of dimensions different from the second set of dimensions is received from a user. The digital model is resized within the interface in accordance with the third set of dimensions. The resized digital model of the object is displayed in accordance with the third set of dimensions, wherein the first set of dimensions corresponding to the size of the object remains unchanged within the augmented reality computing system.

Abstract: An imaging system may include a plurality of networked imagers arranged in a geometric arrangement with respective fields of view covering part or all of a panoramic geometry, at least one inertial measurement unit (IMU) in communication with the networked imagers configured to generate orientation data indicating orientations of the plurality of networked imagers, and at least one processor in communication with the networked imagers and the at least one IMU. The at least one processor may be configured to receive a plurality of images from the plurality of networked imagers and combine the plurality of images into at least one combined image by positioning pixels of each of the plurality of images relative to pixels of the remaining plurality of images, associating the positioned pixels with the orientation data, and merging the oriented pixels of each of the plurality of images into the at least one combined image.

Abstract: A transparent cover of an optical camera system comprises a curved sidewall portion having an outer contour formed by the rotation of a preset continuous curve. The preset continuous curve comprises a first curve segment and a second curve segment, each having a curvature no more than a first preset value, wherein the first back focus offset of a curved surface corresponding to the first curve segment does not exceed the second preset value, and a second back focus offset of a curved surface corresponding to the second curve segment does not exceed a third preset value. A first line segment is formed by connecting an end point of the preset continuous curve with a center of a circle circumscribing edges of a camera, and an included angle between the first line segment and a boundary line between the first and second curve segments is greater than 0.

Abstract: The present disclosure provides a control method. The method includes acquiring a first trigger instruction; executing a first function module in response to the first trigger instruction, the first function module calling one or more first image acquisition devices; acquiring a second trigger instruction during the operation of the first function module; and executing a second function module in response to the second trigger instruction, the second function module calling one or more second image acquisition devices, and the first function module being different from the second function module. The one or more first image acquisition devices and the one or more second image acquisition devices are connected to a same electronic device.

Abstract: A semiconductor device includes an image acquisition circuit which acquires a plurality of captured image data obtained by capturing a plurality of images, an estimation source image generation circuit which cancels effects of initial color adjustment processing on each captured image data to generate image data of a plurality of estimation source images, a readjustment circuit which divides each estimation source image into a plurality of processing regions to perform color balance readjustment processing for each processing region, and an image synthesis circuit which synthesizes the image data of the plurality of estimation source images so that overlapping regions included in the estimation source images overlap each other to generate image data of a synthesized image.

Abstract: Predictive pre-fetching of streams for 360 degree video is described. User view orientation metadata is obtained for a 360 degree video stream that includes data for a plurality of viewports. Data corresponding to one or more high-resolution frames for a particular one of the viewports is pre-fetched based on the user view orientation metadata and those frames are displayed. The high resolution frames are characterized by a higher resolution than for remaining viewports.

Abstract: A video processing method includes: receiving an omnidirectional content corresponding to a sphere, obtaining projection faces from the omnidirectional content, and creating a projection-based frame by generating at least one padding region and packing the projection faces and said at least one padding region in a 360 VR projection layout. The projection faces packed in the 360 VR projection layout include a first projection face and a second projection face, where there is an image content discontinuity edge between the first projection face and the second projection face if the first projection face connects with the second projection face. The at least one padding region packed in the 360 VR projection layout includes a first padding region, where the first padding region connects with the first projection face and the second projection face for isolating the first projection face from the second projection face in the 360 VR projection layout.

Abstract: An image capturing system includes a first camera having a first lens, a second camera having a second lens, a third camera having a third lens, a fourth camera having a fourth lens, a fifth camera having a fifth lens, a sixth camera having a sixth lens, and a processor coupled to the six cameras. The processor generates an optimized image according to images captured by at least two of the six cameras. The first lens, the second lens, the third lens and the fourth lens are disposed adjacently. The first lens, the third lens, the fifth lens, and the sixth lens are disposed along a straight line. Fields of view of the first lens, the second lens, the third lens, and the fourth lens are the same.

Abstract: In a left and right pair of a first display device and a second display device that perform repositionable display, mutually different display contents can be visually recognized as a first video image and a second video image. Further, a display control portion controls the display content in accordance with at least one of the first video image and the second video image.

Abstract: The present invention relates to an apparatus and a method of stitching a real-time image. More specifically, stitching-related information is generated, a parallax occurrence region in an overlap region is tracked, and correction for reducing parallax occurring in the parallax occurrence region and correction of an image distortion occurring in a non-overlap region are performed for output.

Abstract: Provided is an apparatus for providing external panoramic view contents for an aircraft during flight by installing a plurality of cameras in a plurality of windows installed in an aircraft for displaying external panoramic views inside the aircraft while the aircraft flies in order for aircraft passengers to enjoy them. The apparatus includes a shooting unit having a plurality of cameras for shooting aircraft's external panoramic views; a control unit for receiving a plurality of images from the cameras and processing them; and a display unit comprising a single display and a multi-display including a plurality of sub-displays.

Abstract: Techniques for verifying identity of a human subject to an identification document are described. In some examples, a computing device may be connected to least two cameras oriented such that a first field of view is a substantially opposite direction from a second field of view. The device may receive images from the first camera that include a human subject. Second images from the second camera may include images of an ID document with a photograph of the human subject. The device may process the first images along with the respective, corresponding second images to determine respective 3D locations for at least one of cameras at the respective times the images were captured. Based on the sequence of 3D locations, along with the first images and the second images, the device may determine whether the human subject is a valid human subject.

Abstract: An automated system for mitigating risk from a wind farm. The automated system may include an array of a plurality of image capturing devices independently mounted in a wind farm. The array may include a plurality of low resolution cameras and at least one high resolution camera. The plurality of low resolution cameras may be interconnected and may detect a spherical field surrounding the wind farm. A server is in communication with the array of image capturing devices. The server may automatically analyze images to classify an airborne object captured by the array of image capturing devices in response to receiving the images.

Abstract: An optical imaging module utilizes electric conductors to reduce the overall thickness of an image sensor element. With the configuration of an auto lens assembly and a multi-lens frame, incident light passes through the auto lens assembly and is accurately focused on the image sensor element. Hereby, the image sensor element is thus fully imaged. Besides, the invention can ensure the image quality and prevent the element from deforming during encapsulation and causing the problems such as short circuit, and can reduce the size of the optical image capturing module.

Abstract: At least one combined image may be created from a plurality of images captured by a plurality of cameras. A sensor unit may receive the plurality of images from the plurality of cameras. At least one processor in communication with the sensor unit may correlate each received image with calibration data for the camera from which the image was received. The calibration data may comprise camera position data and characteristic data, and may translate the data about a translated virtual center point translated a predetermined distance in space from the virtual center point. The processor may combine at least two of the received images from at least two of the cameras into the at least one combined image by orienting the at least two images relative to one another based on the calibration data for the at least two cameras from which the images were received and merging the at least two aligned images into the at least one combined image.

Abstract: A wireless IPTV SMART TV is provided with plurality of wireless modem modules configured to receive a plurality of wireless broadband connection signals synchronized from a plurality of cellular data networks, to process the plurality of wireless broadband connection signals, identify a set of data corresponding to a strongest wireless broadband connection signal strength, and convert said data into IPTV signals based on said IPTV provider access.

Abstract: A scale transformation adjustment unit performs a scale transformation corresponding to a change of an image range with respect to an actual image by using a scale transformation by an optical zoom of an image pickup unit that generates the actual image, and generates a coordinate transformation matrix including the scale transformation.

Abstract: A camera simulation system or method or process for simulating performance of a camera for a vehicle includes providing a camera having a lens and imager and providing a learning algorithm. Image data is captured from a raw image input of the camera and the captured image data and raw image input are output from the camera. The output image data and the raw image input are provided to the learning algorithm. The learning algorithm is trained to simulate performance of the lens and/or the imager using the output captured image data and the raw image data input. The performance of the lens and/or the imager is simulated responsive to the learning algorithm receiving raw images.

Abstract: A method, apparatus and computer program product provide a signaling mechanism that could be utilized in conjunction with a media interface and exchange mechanism in a media processing pipeline defined in Moving Picture Experts Group-I (MPEG-I) Network-based media processing (NBMP). In particular, a method, apparatus and computer program product provide a NBMP media interface mechanism that enables virtual reality (VR) stitching within an NBMP-enabled system independent of stitching algorithm used.

Abstract: Techniques related to image rectification for fisheye images are discussed. Such techniques may include iteratively determining warpings for equirectangular images corresponding to the fisheye images using alternating feature mappings between neighboring ones of the equirectangular images until mean vertical disparities between the features are reduced below a threshold, and warping the equirectangular images to rectified equirectangular images.

Abstract: According to one embodiment, an image processing apparatus includes plural imaging units and a calibration unit. The imaging units capture an overlapping region. The calibration unit calibrates plural captured images and obtains plural calibrated images in which lens distortion in each of the captured images is corrected and corresponding positions of the captured images are aligned with each other horizontally and are adjusted to a surface perpendicular to a plane. The plural imaging units are arranged such that a baseline vector connecting optical centers of the imaging units is perpendicular to a normal vector of the plane.

Abstract: An optical image capturing module is provided, including a circuit assembly and a lens assembly. The circuit assembly may include a circuit substrate, a plurality of image sensor elements, a plurality of signal transmission elements, and a multi-lens frame. The image sensor elements may be connected to the circuit substrate. The signal transmission elements may be electrically connected between the circuit substrate and the image sensor elements. The multi-lens frame may be manufactured integrally and covered on the circuit substrate and the image sensor elements. A part of the signal transmission elements may be embedded in the multi-lens frame, whereas the other part may be surrounded by the multi-lens frame. The lens assembly may include a lens base, an auto-focus lens assembly, and a driving assembly.

Abstract: The present disclosure relates to omnipolar imaging for generating a substantially 360 degree by 180 degree stereo spherical view. The omnipolar imaging device comprises at least three wide angle lenses facing in a first direction and at least three wide angle lenses facing in a second direction opposite to the first direction, each lens connected to an image sensor. The lens are positioned so as to capture the substantially 360 degree by 180 degree view. The method of rendering the view comprises, for each pixel in an output image, selecting one set of lenses, i.e. the first set of lenses or the second set of lenses, selecting one lens from the selected set of lenses, and rendering the pixel in an output image from a corresponding point in an input image of the selected lens.

Abstract: Example implementations relate to processing a query of a database and a data stream. For example, a computing device may include a processor. The processor may receive a query associated with at least one of a database and a buffer storing streamed data from a data stream. The database may store database data previously stored in the buffer. The processor may identify a range associated with the query and generate a set of sub-queries including at least one of a buffer sub-query if the range is associated with the streamed data in the buffer and a database sub-query if the range is associated with the database data in the database. The processor may process the set of sub-queries and provide a query result of the query, where the query result is a combination of sub-query results of the set of sub-queries.

Abstract: A method is provided. The method includes one or more of receiving, by an image processing device, one or more photos of building locations at a building, extracting position coordinates comprising X and Y values in a 2D floor plan from the one or more photos, converting the position coordinates into 3D model coordinates, extracting model viewpoints from a 3D model of the building at the 3D model coordinates, and comparing each of the one or more photos with a corresponding model viewpoint. Each of the model viewpoints provides a view of the 3D model at a same viewing position as one of the one or more photos.

Abstract: An image processing apparatus communicable with an image capturing device that captures image data includes circuitry. The circuitry acquires the image data captured by the image capturing device. The circuitry acquires type data indicating a type of the image capturing device. The circuitry determines the type of the image capturing device based on the acquired type data. Based on the determined type of the image capturing device, the circuitry determine a type of image processing to be performed on the acquired image data, and performs the determined image processing on the acquired image data.

Abstract: A method for processing point clouds having variable spatial distributions of scan lines includes receiving a point cloud frame generated by a sensor configured to sense an environment through which a vehicle is moving. The point cloud frame includes scan lines arranged according to a particular spatial distribution. The method also includes either generating an enhanced point cloud frame with a larger number of points than the received point cloud frame, or constructing, by one or more processors and based on points of the received point cloud frame, a three-dimensional mesh. The method also includes generating, by performing an interpolation function on the enhanced point cloud frame or a virtual surface provided by the three-dimensional mesh, a normalized point cloud frame, and generating, using the normalized point cloud frame, signals descriptive of a current state of the environment through which the vehicle is moving.