Real-time Preview Research Articles

ResumeCraft: A Machine Learning-powered Web Platform for Resume Building

Abstract: The competitive job market necessitates well-crafted resumes that resonate with both human recruiters and Applicant Tracking Systems (ATS). This paper introduces ResumeCraft, a web-based platform empowering users to build strong resumes and optimize them for ATS compatibility. ResumeCraft leverages Machine Learning (ML) for data analysis and user guidance, while the user interface is built with Hypertext Markup Language (HTML), Cascading Style Sheets (CSS), and JavaScript for a user-friendly experience. The system allows users to input their personal and professional details through a series of form fields, and provides a real-time preview of the resume design as the user inputs their data. The resume generator uses JavaScript to dynamically populate the preview with the user's input, and allows users to select from a range of pre-designed templates and color schemes to customize the look and feel of their resume. It processes the user input and generates a downloadable Portable Document Format (PDF) of the final resume. The platform analyzes user-provided information through ML models, offering suggestions on skill extraction, keyword matching, and action verb usage. This combination empowers users to create impactful resumes that are more likely to pass through ATS filters and reach human reviewers.

Integration Method of Monitoring Video and Geospatial Data Based on 3D Modeling

The fusion technology of videos has been increasingly applied in various fields such as smart cities and smart agriculture, playing a significant role in enabling real-time scene monitoring and decision-making for surveillance personnel. Currently, conventional methods for integrating geographic data with monitoring videos involve mapping two-dimensional geographic information data onto surveillance videos. However, this method exhibits significant mapping errors in scenarios with large terrain variations and 360 degrees multi-angle real-time previews. To address this issue, this paper proposes a fusion method of monitoring videos and geospatial data based on three-dimensional modeling. This method constructs a virtual scene using digital elevation models and vector geographic data and overlays the images captured under the camera viewport in the virtual scene with each frame of the video images in the monitoring video stream, thereby enhancing the video scene based on geographic data. In practical application scenarios, a system for integrating monitoring videos with geospatial data is designed and implemented. Experimental results demonstrate that this method effectively addresses issues such as unfamiliarity with the geographical environment, ambiguity of location information, inaccuracies in mapping due to terrain variations and changes in camera intrinsic parameters, thus showing superior applicability.

Image to G-Code Conversion using JavaScript for CNC Machine Control

This paper presents a JavaScript-based approach for image-to-G-code conversion in CNC (Computer Numerical Control) machine control. The developed code enables the translation of images and text into machine-readable instructions for precise reproduction using CNC machines. The code implements image loading, preprocessing, binarization, thinning, and G-code generation functionalities. It offers adjustable parameters for CNC and image settings, allowing customization and optimization of the machining process. Experimental evaluations confirm the code's efficiency, accuracy, and usability. The results demonstrate reliable image preprocessing, effective binarization techniques, successful image thinning, and precise G-code generation. The code's accessibility, user-friendly interface, and real-time preview capabilities further enhance its usability. This JavaScript-based approach contributes to the integration of digital workflows into CNC machining, offering a promising solution for accurate and efficient fabrication.

5DMETEORA FRAMEWORK: MANAGEMENT AND WEB PUBLISHING OF CULTURAL HERITAGE DATA

Abstract. Cultural Heritage (CH) management software represents virtual information in various ways aiming either at usability and long-term preservation or interactivity and immersiveness. A single web-based framework that couples the organization of geospatial, multimedia and relational data with 4D visualization, Virtual Reality (VR) and Augmented Reality (AR) is presented in this paper (https://meteora.topo.auth.gr/5dmeteora.php). It comprises the 5dMeteora platform and the Content Management System (CMS) for uploading, processing, publishing and updating its content. The 5dMeteora platform integrates a responsive 3D viewer of high-resolution models in the basis of 3DHOP (3D Heritage Online Platform) and Nexus.js multi-resolution library. It offers data retrieval and interpretation mechanisms through navigation tools, clickable geometries in the 3D scene, named hotspots, and semantic organization of metadata. Its content and interactive services are differentiated, based on the scientific specialty or the field of interest of the users. To achieve the sense of spatial presence, VR and AR viewports are designed to give a clearer understanding of spatial bounds and context of 3D CH assets. The proposed CMS allows dynamic content management, automation of 3DHOP’s operations regarding 3D data uploading and hotspots defining, real-time preview of the 3D scene as well as extensibility at all levels (e.g., new data types). It is built upon a MySQL Database Management System and developed with PHP scripting, backend JavaScript and Ajax controllers as well as front-end web languages. The database maintains and manages the entities of every type of data supported by the platform, while encryption methods guarantee data confidentiality and integrity. The presented work is the first valid attempt of open-source software that automates the dissemination of 3D and 2D content for customized eXtented Reality (XR) experiences and reaches multiple levels of interactivity for different users (experts, non-experts). It can meet the needs of domain experts that own or manage multimodal heritage data.

Biomac3D: 2D-to-3D Human Pose Analysis Model for Tele-Rehabilitation Based on Pareto Optimized Deep-Learning Architecture

The research introduces a unique deep-learning-based technique for remote rehabilitative analysis of image-captured human movements and postures. We present a ploninomial Pareto-optimized deep-learning architecture for processing inverse kinematics for sorting out and rearranging human skeleton joints generated by RGB-based two-dimensional (2D) skeleton recognition algorithms, with the goal of producing a full 3D model as a final result. The suggested method extracts the entire humanoid character motion curve, which is then connected to a three-dimensional (3D) mesh for real-time preview. Our method maintains high joint mapping accuracy with smooth motion frames while ensuring anthropometric regularity, producing a mean average precision (mAP) of 0.950 for the task of predicting the joint position of a single subject. Furthermore, the suggested system, trained on the MoVi dataset, enables a seamless evaluation of posture in a 3D environment, allowing participants to be examined from numerous perspectives using a single recorded camera feed. The results of evaluation on our own self-collected dataset of human posture videos and cross-validation on the benchmark MPII and KIMORE datasets are presented.

The informed consent form navigator: a tool for producing readable and compliant consent documents.

Informed consent forms (ICFs) and practices vary widely across institutions. This project expands on previous work at the University of Arkansas for Medical Sciences (UAMS) Center for Health Literacy to develop a plain language ICF template. Our interdisciplinary team of researchers, comprised of biomedical informaticists, health literacy experts, and stakeholders in the Institutional Review Board (IRB) process, has developed the ICF Navigator, a novel tool to facilitate the creation of plain language ICFs that comply with all relevant regulatory requirements. Our team first developed requirements for the ICF Navigator tool. The tool was then implemented by a technical team of informaticists and software developers, in consultation with an informed consent legal expert. We developed and formalized a detailed knowledge map modeling regulatory requirements for ICFs, which drives workflows within the tool. The ICF Navigator is a web-based tool that guides researchers through creating an ICF as they answer questions about their project. The navigator uses those responses to produce a clear and compliant ICF, displaying a real-time preview of the final form as content is added. Versioning and edits can be tracked to facilitate collaborative revisions by the research team and communication with the IRB. The navigator helps guide the creation of study-specific language, ensures compliance with regulatory requirements, and ensures that the resulting ICF is easy to read and understand. The ICF Navigator is an innovative, customizable, open-source software tool that helps researchers produce custom readable and compliant ICFs for research studies involving human subjects.

Illumination Browser: An intuitive representation for radiance map databases

Radiance maps (RM) are used for capturing the lighting properties of real-world environments. Databases of RMs are useful for various rendering applications such as look development, live action composition, mixed reality, and machine learning. Such databases are not useful if they cannot be organized in a meaningful way. To address this, we introduce the illumination space, a feature space that arranges RM databases based on illumination properties. Our method is motivated by how the RM illuminates the scene as opposed to describing the textural content of the RM. We avoid manual labeling by automatically extracting features from an RM that provides a concise and semantically meaningful representation of its typical lighting effects. We also introduce ‘Illumination Browser’, a user interface (UI) that visualizes the illumination space alongside a real-time preview renderer to enable intuitive browsing for artists. This is made possible with the following contributions: a method to automatically extract a small set of dominant and ambient lighting properties from RMs, a low-dimensional (5D) light feature vector summarizing these properties to form the illumination space, and a UI that effectively utilizes the illumination space.

PREVIS - A Combined Machine Learning and Visual Interpolation Approach for Interactive Reverse Engineering in Assembly Quality Control

We present PREVIS, a visual analytics tool, enhancing machine learning performance analysis in engineering applications. The presented toolchain allows for a direct comparison of regression models. In addition, we provide a methodology to visualize the impact of regression errors on the underlying field of interest in the original domain, the part geometry, via exploiting standard interpolation methods. Further, we allow a real-time preview of user-driven parameter changes in the displacement field via visual interpolation. This allows for fast and accountable online change management. We demonstrate the effectiveness with an ex-ante optimization of an automotive engine hood.

Mobile3DScanner: An Online 3D Scanner for High-quality Object Reconstruction with a Mobile Device.

We present a novel online 3D scanning system for high-quality object reconstruction with a mobile device, called Mobile3DScanner. Using a mobile device equipped with an embedded RGBD camera, our system provides online 3D object reconstruction capability for users to acquire high-quality textured 3D object models. Starting with a simultaneous pose tracking and TSDF fusion module, our system allows users to scan an object with a mobile device to get a 3D model for real-time preview. After the real-time scanning process is completed, the scanned 3D model is globally optimized and mapped with multi-view textures as an efficient postprocess to get the final textured 3D model on the mobile device. Unlike most existing state-of-the-art systems which can only scan homeware objects such as toys with small dimensions due to the limited computation and memory resources of mobile platforms, our system can reconstruct objects with large dimensions such as statues. We propose a novel visual-inertial ICP approach to achieve real-time accurate 6DoF pose tracking of each incoming frame on the front end, while maintaining a keyframe pool on the back end where the keyframe poses are optimized by local BA. Simultaneously, the keyframe depth maps are fused by the optimized poses to a TSDF model in real-time. Especially, we propose a novel adaptive voxel resizing strategy to solve the out-of-memory problem of large dimension TSDF fusion on mobile platforms. In the post-process, the keyframe poses are globally optimized and the keyframe depth maps are optimized and fused to obtain a final object model with more accurate geometry. The experiments with quantitative and qualitative evaluation demonstrate the effectiveness of the proposed 3D scanning system based on a mobile device, which can successfully achieve online high-quality 3D reconstruction of natural objects with larger dimensions for efficient AR content creation.

Mobile Wheeled Robot to Support the Task of the Alarm Sub - Unit

Abstract The article is a presentation, and detailed description of a mobile, vehicular robot whose task is to support the alarm sub-unit. The project was created in response to the increasing need for monitoring, and recognition of the areas. The robot’s interface was created with the use of integrated development environments for Python. The software implementation was possible due to a minicomputer Raspberry Pi 4 B. The robot’s frame is made out of components which are based on the main chassis. The robot is equipped with compatible sensors and cameras. Those, combined with the interface, are able to give a real-time preview of the area in which the robot is in. This particular vehicular robot is designed to eliminate the risks caused by tasks of alarm sub-unit, by giving the real-time preview, and analysis of the currently watched area. In addition, it can be used to inspect soldiers in the containment zones, and to help with the identification of unknown objects.

GRID: A Python Package for Field Plot Phenotyping Using Aerial Images

Aerial imagery has the potential to advance high-throughput phenotyping for agricultural field experiments. This potential is currently limited by the difficulties of identifying pixels of interest (POI) and performing plot segmentation due to the required intensive manual operations. We developed a Python package, GRID (GReenfield Image Decoder), to overcome this limitation. With pixel-wise K-means cluster analysis, users can specify the number of clusters and choose the clusters representing POI. The plot grid patterns are automatically recognized by the POI distribution. The local optima of POI are initialized as the plot centers, which can also be manually modified for deletion, addition, or relocation. The segmentation of POI around the plot centers is initialized by automated, intelligent agents to define plot boundaries. A plot intelligent agent negotiates with neighboring agents based on plot size and POI distributions. The negotiation can be refined by weighting more on either plot size or POI density. All adjustments are operated in a graphical user interface with real-time previews of outcomes so that users can refine segmentation results based on their knowledge of the fields. The final results are saved in text and image files. The text files include plot rows and columns, plot size, and total plot POI. The image files include displays of clusters, POI, and segmented plots. With GRID, users are completely liberated from the labor-intensive task of manually drawing plot lines or polygons. The supervised automation with GRID is expected to enhance the efficiency of agricultural field experiments.

QuickCount®: a novel automated software for rapid cell detection and quantification.

We describe a novel automated cell detection and counting software, QuickCount® (QC), designed for rapid quantification of cells. The Bland-Altman plot and intraclass correlation coefficient (ICC) analyses demonstrated strong agreement between cell counts from QC to manual counts (mean and SD: -3.3±4.5; ICC=0.95). QC has higher recall in comparison to ImageJauto, CellProfiler and CellC and the precision of QC, ImageJauto, CellProfiler and CellC are high and comparable. QC can precisely delineate and count single cells from images of different cell densities with precision and recall above 0.9. QC is unique as it is equipped with real-time preview while optimizing the parameters for accurate cell count and needs minimum hands-on time where hundreds of images can be analyzed automatically in a matter of milliseconds. In conclusion, QC offers a rapid, accurate and versatile solution for large-scale cell quantification and addresses the challenges often faced in cell biology research.

VisComposer: A Visual Programmable Composition Environment for Information Visualization

As the amount of data being collected has increased, the need for tools that can enable the visual exploration of data has also grown. This has led to the development of a variety of widely used programming frameworks for information visualization. Unfortunately, such frameworks demand comprehensive visualization and coding skills and require users to develop visualization from scratch. An alternative is to create interactive visualization design environments that require little to no programming. However, these tools only supports a small portion of visual forms.We present a programmable integrated development environment (IDE), VisComposer, that supports the development of expressive visualization using a drag-and-drop visual interface. VisComposer exposes the programmability by customizing desired components within a modularized visualization composition pipeline, effectively balancing the capability gap between expert coders and visualization artists. The implemented system empowers users to compose comprehensive visualizations with real-time preview and optimization features, and supports prototyping, sharing and reuse of the effects by means of an intuitive visual composer. Visual programming and textual programming integrated in our system allow users to compose more complex visual effects while retaining the simplicity of use. We demonstrate the performance of VisComposer with a variety of examples and an informal user evaluation.

Rethinking Literate Programming in Statistics

Literate programming is becoming increasingly trendy for data analysis because it allows the generation of dynamic-analysis reports for communicating data analysis and eliminates untraceable human errors in analysis reports. Traditionally, literate programming includes separate processes for compiling the code and preparing the documentation. While this workflow might be satisfactory for software documentation, it is not ideal for writing statistical analysis reports. Instead, these processes should run in parallel. In this article, I introduce the weaver package, which examines this idea by creating a new log system in HTML or LATEX that can be used simultaneously with the Stata log system. The new log system provides many features that the Stata log system lacks; for example, it can render mathematical notations, insert figures, create publication-ready dynamic tables, and style text, and it includes a built-in syntax highlighter. The weaver package also produces dynamic PDF documents by converting the HTML log to PDF or by typesetting the LATEX log and thus provides a real-time preview of the document without recompiling the code. I also discuss potential applications of the weaver package.

Enhanced Compressive Imaging Using Model-Based Acquisition: Smarter sampling by incorporating domain knowledge

Compressive imaging (CI) is a subset of computational photography where a scene is captured via a series of optical, transform-based modulations before being recorded at the detector. However, unlike previous transform imagers, compressive sensors take advantage of the inherent sparsity in the image and use specialized algorithms to reconstruct a high-resolution image with far lower than 100% of the total measurements. Initial CI systems exploited the properties of random matrices used in other areas of compressive sensing (CS); however, in the case of imaging, there are immense benefits to be derived by designing measurement matrices that optimize specific objectives and enable novel capabilities. In this article, we survey recent results on measurement matrix designs that provide the ability of real-time previews, signature-selective imaging, and reconstruction-free inference.

Interactive High-Relief Reconstruction for Organic and Double-Sided Objects from a Photo.

We introduce an interactive user-driven method to reconstruct high-relief 3D geometry from a single photo. Particularly, we consider two novel but challenging reconstruction issues: i) common non-rigid objects whose shapes are organic rather than polyhedral/symmetric, and ii) double-sided structures, where front and back sides of some curvy object parts are revealed simultaneously on image. To address these issues, we develop a three-stage computational pipeline. First, we construct a 2.5D model from the input image by user-driven segmentation, automatic layering, and region completion, handling three common types of occlusion. Second, users can interactively mark-up slope and curvature cues on the image to guide our constrained optimization model to inflate and lift up the image layers. We provide real-time preview of the inflated geometry to allow interactive editing. Third, we stitch and optimize the inflated layers to produce a high-relief 3D model. Compared to previous work, we can generate high-relief geometry with large viewing angles, handle complex organic objects with multiple occluded regions and varying shape profiles, and reconstruct objects with double-sided structures. Lastly, we demonstrate the applicability of our method on a wide variety of input images with human, animals, flowers, etc.

Incremental BVH construction for ray tracing

We propose a new method for incremental construction of Bounding Volume Hierarchies (BVHs). Despite the wide belief that the incremental construction of BVH is inefficient we show that our method incrementally constructs a BVH with quality comparable to the best SAH builders. We illustrate the versatility of the proposed method using a flexible parallelization scheme that opens new possibilities for combining different BVH construction heuristics. We demonstrate the usage of the method in a proof-of-concept application for real-time preview of data streamed over the network. We believe that our method will renew the interest in incremental BVH construction and it will find its applications in ray tracing based remote visualizations and fast previews or in interactive scene editing applications handling very large data sets.

Reciprocal frame structures made easy

A reciprocal frame (RF) is a self-supported three-dimensional structure made up of three or more sloping rods, which form a closed circuit, namely an RF-unit. Large RF-structures built as complex grillages of one or a few similar RF-units have an intrinsic beauty derived from their inherent self-similar and highly symmetric patterns. Designing RF-structures that span over large domains is an intricate and complex task. In this paper, we present an interactive computational tool for designing RF-structures over a 3D guiding surface, focusing on the aesthetic aspect of the design. There are three key contributions in this work. First, we draw an analogy between RF-structures and plane tiling with regular polygons, and develop a computational scheme to generate coherent RF-tessellations from simple grammar rules. Second, we employ a conformal mapping to lift the 2D tessellation over a 3D guiding surface, allowing a real-time preview and efficient exploration of wide ranges of RF design parameters. Third, we devise an optimization method to guarantee the collinearity of contact joints along each rod, while preserving the geometric properties of the RF-structure. Our tool not only supports the design of wide variety of RF pattern classes and their variations, but also allows preview and refinement through interactive controls.

Analysis and design of multiresolution scan trajectories for high-speed scanning probe microscopy

Recently, a new family of multi-resolution scan trajectories for high-speed scanning probe microscopy has been introduced based on Lissajous patterns. In this mode of imaging, the cantilever tip traverses the sample by following a pattern which is created by two single-tone harmonic waveforms interfering in a two dimensional plane. This paper provides a rigorous analysis of some of the fundamental properties of Lissajous scan trajectories, such as the imaging time and spatial resolution, and presents a step-by-step procedure which allows for the design of such trajectories. We also explore the multiresolution character of Lissajous scan trajectories which enables for a real-time preview of the sample in fractions of the overall imaging time. Experimental results are presented to substantiate the analytical results.

“Tangible Culture” – Designing virtual exhibitions on multi-touch devices1

Cultural heritage institutions such as galleries, museums and libraries increasingly use digital media to present artifacts to their audience and enable them to immerse themselves in a cultural virtual world. With the application eXhibition:editor3D museum curators and editors have a software tool at hand to interactively plan and visualize exhibitions. In this paper we present an extension to the application that enhances the workflow when designing exhibitions. By introducing multi-touch technology to the graphical user interfaces the designing phase of an exhibition is efficiently simplified, especially for non-technical users. Furthermore, multi-touch technology offers a novel way of collaborative work to be integrated into a decision making process. A flexible export system allows to store created exhibitions in various formats to display them on websites, mobile devices or custom viewers. For example, the widespread 3D scene standard Extensible 3D X3D is one of the export formats and we use it to directly incorporate a realtime preview of the exhibition in the authoring process. The combination of the tangible user interfaces with the realtime preview gives curators and exhibition planers a capable tool for efficiently presenting cultural heritage in electronic media.