Markerless Method Research Articles

Feasibility and usefulness of video-based markerless two-dimensional automated gait analysis, in providing objective quantification of gait and complementing the evaluation of gait in children with cerebral palsy

BackgroundGait analysis aids in evaluation, classification, and follow-up of gait pattern over time in children with cerebral palsy (CP). The analysis of sagittal plane joint kinematics is of special interest to assess flexed knee gait and ankle joint deviations that commonly progress with age and indicate deterioration of gait. Although most children with CP are ambulatory, no objective quantification of gait is currently included in any of the known international follow-up programs. Is video-based 2-dimensional markerless (2D ML) gait analysis with automated processing a feasible and useful tool to quantify deviations, evaluate and classify gait, in children with CP?MethodsTwenty children with bilateral CP with Gross Motor Function Classification Scale (GMFCS) levels I–III, from five regions in Sweden, were included from the national CP registry. A single RGB-Depth video camera, sensitive to depth and contrast, was positioned laterally to a green walkway and background, with four light sources. A previously validated markerless method was employed to estimate sagittal plane hip, knee, ankle kinematics, foot orientation and spatio-temporal parameters including gait speed and step length.ResultsMean age was 10.4 (range 6.8–16.1) years. Eight children were classified as GMFCS level I, eight as II and four as III. Setup of the measurement system took 15 min, acquisition 5–15 min and processing 50 min per child. Using the 2D ML method kinematic deviations from normal could be determined and used to implement the classification of gait pattern, proposed by Rodda et al. 2001.Conclusion2D ML assessment is feasible, since it is accessible, easy to perform and well tolerated by the children. The 2D ML adds consistency and quantifies objectively important gait variables. It is both relevant and reasonable to include 2D ML gait assessment in the evaluation of children with CP.

Markerless three-dimensional gait analysis in healthy older adults: test–retest reliability and measurement error

In older adults, gait analysis may detect changes that signal early disease states, yet challenges in biomechanical screening limit widespread use in clinical or community settings. Recently, a markerless method from multi-camera video data has become accessible, making screenings less challenging. This study evaluated the test–retest reliability and measurement error of markerless gait kinematics and kinetics in healthy older adults. Twenty-nine healthy older adults performed gait analysis on two occasions, at preferred walking speed, using their everyday clothes. Lower limb angles and moments were averaged from 8 gait cycles. Integrated pointwise indices [Intraclass Correlation Coefficient (ICCA,K) and Standard Error of Measurement (SEM)] were calculated for curve data, as well as ICCA,K, and SEM [95 % confidence intervals] for selected peaks. Generally, kinematic ICCs were good (>0.75) and reasonably stable throughout the gait cycle, except for the hip kinematics during the swing phase in the sagittal plane and pelvis tilt and rotation. The integrated and peaks SEM were <2.4°. The reliability of kinetics was similar (ICC>0.75), except for the transverse hip moment and abduction peak, fluctuating more during the swing than through the stance phase. SEM were < 0.07Nm/Kg. In conclusion, these results showed good overall test–retest reliability for markerless gait kinematics and kinetics for the hip, knee, and ankle joints, moderate for the pelvis angles, and error levels of ≤5°, and SEM%≤5% for the sagittal plane. This supports this method’s use in assessing gait in healthy older adults, including kinetics, for which reliability data from markerless systems is difficult to find reported.

Application of Interactive Games on Tourism Objects Based on Augmented Reality Gamification

The development of information technology is always growing rapidly, especially in the field of android smartphones. Android smartphones can now be obtained at a fairly affordable price. With rapid development, there are so many innovations that can be developed by the smartphone itself, even the tourism sector such as The Sila's Agroutourism can get the impact of several innovations that exist along with the times such as Augmented Reality. In this research, the author uses two augmented reality methods, namely Marker Based Tracker and also Markerless. Where Marker based tracker is a method that uses image illustrations in the form of QR codes or special logos to identify an object in the Augmented Reality application. While Markerless is a method that does not require a marker or image to display the object. So that this research produces an augmanted reality game using the marker-based tracker method and also markerless which takes the GPS tracker method as its markerless method. This test uses 3 tests, namely Blackbox testing, Response Time testing and also User Experience Questioner (UEQ). Where the UEQ results filled in by 35 respondents get results above average (Excelent). So that it shows that this game is good and as expected.

HyperMRI: hyperspectral and magnetic resonance fusion methodology for neurosurgery applications

PurposeMagnetic resonance imaging (MRI) is a common technique in image-guided neurosurgery (IGN). Recent research explores the integration of methods like ultrasound and tomography, among others, with hyperspectral (HS) imaging gaining attention due to its non-invasive real-time tissue classification capabilities. The main challenge is the registration process, often requiring manual intervention. This work introduces an automatic, markerless method for aligning HS images with MRI.MethodsThis work presents a multimodal system that combines RGB-Depth (RGBD) and HS cameras. The RGBD camera captures the patient’s facial geometry, which is used for registration with the preoperative MR through ICP. Once MR-depth registration is complete, the integration of HS data is achieved using a calibrated homography transformation. The incorporation of external tracking with a novel calibration method allows camera mobility from the registration position to the craniotomy area. This methodology streamlines the fusion of RGBD, HS and MR images within the craniotomy area.ResultsUsing the described system and an anthropomorphic phantom head, the system has been characterised by registering the patient’s face in 25 positions and 5 positions resulted in a fiducial registration error of 1.88 ± 0.19 mm and a target registration error of 4.07 ± 1.28 mm, respectively.ConclusionsThis work proposes a new methodology to automatically register MR and HS information with a sufficient accuracy. It can support the neurosurgeons to guide the diagnosis using multimodal data over an augmented reality representation. However, in its preliminary prototype stage, this system exhibits significant promise, driven by its cost-effectiveness and user-friendly design.

Efficient markerless genetic manipulation of Pasteurella multocida using lacZ and pheSm as selection markers.

Pasteurella multocida is a zoonotic conditional pathogen that infects multiple livestock species, causing substantial economic losses in the animal husbandry industry. An efficient markerless method for gene manipulation may facilitate the investigations of P. multocida gene function and pathogenesis of P. multocida. Herein, a temperature-sensitive shuttle vector was constructed using lacZ as a selection marker, and markerless glgB, opa, and hyaE mutants of P. multocida were subsequently constructed through blue-white colony screening. The screening efficiency of markerless deletion strains was improved by the lacZ system, and the method could be used for multiple gene deletions. However, the fur mutant was unavailable via this method. Therefore, we constructed a pheSm screening system based on mutated phenylalanine tRNA synthetase as a counterselection marker to achieve fur deletion mutant. The transformed strain was sensitive to 20 mM p-chloro-phenylalanine, demonstrating the feasibility of pheSm as a counter-selective marker. The pheSm system was used for markerless deletions of glgB, opa, and hyaE as well as fur that could not be screened by the lacZ system. A comparison of screening efficiencies of the system showed that the pheSm counterselection system was more efficient than the lacZ system and broadly applicable for mutant screening. The methods developed herein may provide valuable tools for genetic manipulation of P. multocida.IMPORTANCEPasteurella multocida is a highly contagious zoonotic pathogen. An understanding of its underlying pathogenic mechanisms is of considerable importance and requires efficient species-specific genetic tools. Herein, we propose a screening system for P. multocida mutants using lacZ or pheSm screening markers. We evaluated the efficiencies of both systems, which were used to achieve markerless deletion of multiple genes. The results of this study support the use of lacZ or pheSm as counterselection markers to improve counterselection efficiency in P. multocida. This study provides an effective genetic tool for investigations of the virulence gene functions and pathogenic mechanisms of P. multocida.

Pengembangan Aplikasi Peta Pariwisata Digital Menggunakan Metode Markerless Di Kota Palembang

Based on the results of data obtained from the Palembang city tourism office, activities providing information about tourism are not running optimally in reaching prospective domestic and foreign tourists because activities for conveying information about the attractiveness of tourist attractions through brochures, newspapers, and other print media, as well as events being held, are still ongoing. is temporary; in other words, the delivery of information has not become a routine activity by the Palembang City Culture and Tourism Office. Apart from that, the lack of information related to tourist attractions in Palembang can make it difficult for tourists to determine destinations and travel plans because descriptions of areas or tourist attractions, such as visualization of places and distances between one location and another, are unavailable. Therefore, tourists waste time looking for tourist attractions to visit. This research aims to develop a Digital Tourism Map application in Palembang City which is presented with Augmented Reality in the form of 3D Objects using the Markerless Method so that it can make it easier for local and outside tourists in the Palembang City Area to get to know the tourist attractions in Palembang City. One method currently being developed is the Markerless method; with this method, users no longer need to print a marker to display digital elements

Aplikasi Visualisasi Pembangunan Jalan Baru Menggunakan Augmented Reality

Augmented Reality Technology that combines the real world with the virtual world, is interactive in real time, and is in the form of 3D animation. The Markerless Augmented Reality method is also called the markerless method, with this method the user no longer needs to use a marker to display digital elements. Currently, the construction of a road still uses a lot of rough drawings or designs using paper prints. The problem faced by workers is that drawings for making new roads use design drawings in 2D which are printed on paper, paper is prone to damage if it is always taken to the work site, such as being exposed to water, dust and folding which could damage the image on the printed paper. The research that will be carried out uses Augmented Reality technology which can provide information in the form of 3D road pavement images as well as information about the layers that make up the road pavement.

APLIKASI PENGENALAN PERANGKAT KERAS KOMPUTER BERBASIS ANDROID MENGGUNAKAN AUGMENTED REALITY

In the Information and Communication Technology (ICT) learning system in elementary schools there are various kinds of material, namely regarding the introduction of computers in general. There is something that often becomes a problem when teaching, namely at this time in the current era of development, children have been introduced as early as possible to laptops, which are lighter and more practical than computers. Augmented Reality (AR) is a technology that is combined with a 3D object into a real form using an intermediary medium, namely the camera on Android. The markerless method is a method with the latest features that almost resemble Markerless based tracking so that users are not required to print markerless books to be able to display digital elements. Markerless development is influenced by the development of mobile-based supporting devices in the form of sensors and cameras. Android is an operating system based on mobile Linux and provides an open platform for developers to create their own applications so that they can be used by a variety of mobile devices. The results of this study are to produce computer hardware recognition applications in the form of 3D Argumented Reality.

Robust H-K Curvature Map Matching for Patient-to-CT Registration in Neurosurgical Navigation Systems

Image-to-patient registration is a coordinate system matching process between real patients and medical images to actively utilize medical images such as computed tomography (CT) during surgery. This paper mainly deals with a markerless method utilizing scan data of patients and 3D data from CT images. The 3D surface data of the patient are registered to CT data using computer-based optimization methods such as iterative closest point (ICP) algorithms. However, if a proper initial location is not set up, the conventional ICP algorithm has the disadvantages that it takes a long converging time and also suffers from the local minimum problem during the process. We propose an automatic and robust 3D data registration method that can accurately find a proper initial location for the ICP algorithm using curvature matching. The proposed method finds and extracts the matching area for 3D registration by converting 3D CT data and 3D scan data to 2D curvature images and by performing curvature matching between them. Curvature features have characteristics that are robust to translation, rotation, and even some deformation. The proposed image-to-patient registration is implemented with the precise 3D registration of the extracted partial 3D CT data and the patient’s scan data using the ICP algorithm.

Penerapan Augmented Reality Dalam Replikasi Tata Letak Studio Foto

The role of information technology is very influential in a person's life, thanks to technology it is possible to produce various conveniences so that people get what they want. Information technology is used in different fields, one of which is the field of information transmission. In the delivery of information, it is necessary to have a visual device so that the delivery is easily understood by the community. The delivery of information is an important support for all human activities.The delivery of information, one of which is in the field of architecture through information technology, which includes hardware and software to describe various infrastructures such as buildings.However, in terms of photo studios, many photo studios only think about the design of the studio to make it look attractive without thinking about whether or not the space for taking photos taken by photographers is sufficient.So that photographers sometimes have difficulty taking pictures because the studio space is too narrow due to designs that almost fill the space or studio designs that are not suitable in the size of the room.By using this application, it is hoped that a person can determine the design that suits the studio space. The system will be built based on Android, in the application will be made with a markerless method (without marker) which means that the 3d object will come out if it is triggered with a flat field. The camera will identify a flat field and will display a studio design object that the user has chosen before. In this application there is also an import feature that aims to input new object data from the internal storage of the user's device. Produce a digital product catalog application based on Augmented reality named DeStudio, and can also help photographers to design studio designs / themes that are clear and specific by utilizing Augmented reality technology. In the testing process alpha testing was successfully applied and got 84% smooth results. In beta testing, the average results are very satisfying from some responding, meaning that the application can be used and applied without any obstacles. In the new additional features, the results are very good because the user does not bother to rebuild. Each user can add 3D objects.

Penerapan Augmented Reality dengan Markerless Pada Aplikasi Pengenalan Jenis Hewan Herbivora, Karnivora, dan Omnivora

An introduction to the types of herbivores, carnivores, and omnivores needs to be given to children aged 4 to 6 years, and elementary school students. Submission of material using books is not enough to stimulate the mind, feelings and attention, hence the children feel bored. Several studies that have implemented still have limitations, such as there are no animation features, sound and screenshot share. The purpose of the application of Augmented Reality (AR) with the markerless method in the application of the introduction of herbivores, carnivores, and omnivores is to be able to display the object in three dimensions accompanied by animation features, sound and share information about the animal to social media. This goal is expected to increase children's desire to know more about various types of animals, and applications made can be fun learning media. The method used in this research is waterfall, and the application software is Unity. Application testing is using the blackbox technique to test the functions of the buttons and features displayed in the application. The results of the application trials show that all the button functions that are tried to be pressed will display the scene as expected and the results are 100% valid. From the results of the application trials, it shows that the application has been successfully created in accordance with the desired goal, which can be used as a learning medium for children.

Vespa Motorcycle Marketing by Using Augmented Reality Markerless Method Based on Android

The problem that occurred was CV. Scootres Group had not had a marketing application so it was difficult to serve the buyers who wanted to buy a Vespa when they were far from the location. Sometimes the seller has to answer the questions one by one from the buyers. This study aims at creating an Android-Based Vespa Motorcycle Marketing application to facilitate marketing on the CV. Scoots Group. The data was obtained through Field Research, Library Research, and interview. Then the system design stage, application creation, and testing stage. The SDK used is EasyAR and the C programming language and the method used in this research is the Markerless method. The results of the study indicate that the system used is BlackBox testing and User Acceptance Test (UAT) based on BlackBox testing, the system is running well, and based on UAT testing 10 respondents with a percentage of 85% and 2 Expert Examiners with a percentage of 89%, both are included in the category strongly agree to apply.

PENGENALAN KENDARAAN KLASIK DENGAN MEMANFAATKAN MOBILE AUGMENTED REALITY

Augmented Reality is a combination of a virtual world (virtual) and a real world (real) created by computers. Virtual objects can be in the form of tests, animations, 3D models or videos that combine with the actual environment so that the user feels the virtual object is in their environment. In Augmented Reality technology, classic vehicle recognition media is an application that uses the markerless method, where in this method later using a marker as a pointer or marker to bring up 3D objects. This application helps users make it easier to find out about classic vehicles in the city of Medan, without having to search the internet and even on other social media. In its use, this application runs on the Android operating system so that it can make it easier for users to access the application.

Hajj Pillars Education Application Using Markerless Augmented Reality Method

Hajj is a special worship, which is a dream and obligation for Muslims in the world to perform it, for those who are physically and materially capable. An introduction to the pilgrimage has been obtained since the 3rd grade of Elementary School (SD). The long process of the pilgrimage with various pillars and provisions contained in the procedures for its implementation often raises the disinterest of students in learning to understand and study the pilgrimage more deeply. To achieve the desired competence, many learning media have been developed, one of which is Augmented Reality (AR) technology. Augmented Reality (AR) is a technology that allows you to integrate 3D objects into a real environment. Based on this problem, the author makes an application about the introduction and pillars of the pilgrimage based on Augmented Reality using the Markerless method. Making applications using Blender software as a modeler and Unity 3D as an application maker. It is hoped that this application can introduce Augmented Reality into the world of education, and help students, especially elementary school children, get to know the pillars of Hajj better.

Pemanfaatan Augmented Reality Sebagai Media Pengenalan Atribut TNI Angkatan Darat Berbasis Android

Augmented Reality is an activity that combines the appearance of virtual and real objects (objects) in real life and at that time will also display 3D objects that we want to see in real time. The process of combining virtual and real objects using technology that continues to develop rapidly in the world of design, interactivity is aimed at the input devices needed to support the goals to be achieved. Augmented reality technology at the Indonesian Army Attributes application is an application that uses the Markerless method with the Pattern Matching technique to display augmented reality 3D objects at the Indonesian Army Attributes. This application system can help users, especially prospective students (cassis) to make it easier for prospective students (casis) to achieve their goals of becoming an Indonesian Army Soldier, starting from the recruitment level and selection of units on duty. This technology can guide users to directly view 3D Indonesian Army Attributes objects without having to browse, not to mention network constraints when accessed, which takes longer. This application system is based on Android and can be accessed and used offline.

Pilot Validation Study of Inertial Measurement Units and Markerless Methods for 3D Neck and Trunk Kinematics during a Simulated Surgery Task.

Surgeons are at high risk for developing musculoskeletal symptoms (MSS), like neck and back pain. Quantitative analysis of 3D neck and trunk movements during surgery can help to develop preventive devices such as exoskeletons. Inertial Measurement Units (IMU) and markerless motion capture methods are allowed in the operating room (OR) and are a good alternative for bulky optoelectronic systems. We aim to validate IMU and markerless methods against an optoelectronic system during a simulated surgery task. Intraclass correlation coefficient (ICC (2,1)), root mean square error (RMSE), range of motion (ROM) difference and Bland-Altman plots were used for evaluating both methods. The IMU-based motion analysis showed good-to-excellent (ICC 0.80-0.97) agreement with the gold standard within 2.3 to 3.9 degrees RMSE accuracy during simulated surgery tasks. The markerless method shows 5.5 to 8.7 degrees RMSE accuracy (ICC 0.31-0.70). Therefore, the IMU method is recommended over the markerless motion capture.

AUGMENTED REALITY FOR VISITING GUIDE TO THE LIBRARY ROOM

Libraries are one of the places that have an important role in the world of education, in this era libraries are often overlooked because technology is very helpful for daily human activities, causing a lack of interest in reading from humans themselves. The problem that exists in the public library of campus IV UINSU Medan is how visitors have difficulty finding shelves or finding the books they need so they need directives from officers. Augmented reality technology in this application uses the markerless method to bring up 3D objects from the public library building of the campus IV UINSU Medan. The results of this application program are called digital libraries which can make it easier for users to find rooms as well as books available in the library, without the need to ask the security guards or officers. Based on the blackbox testing that has been done, this application has been running as expected by the application developer. This application works runs on the android operating system and work offline, which makes its easy for users to use it.

Analysis and Implementation of Augmented Reality Using Markerless and A-Star Algorithm (Case Study: Gedung Kuliah Umum ITERA)

Institut Teknologi Sumatera is a public university in the province of Lampung. Institut Teknologi Sumatera (ITERA) has many buildings, including Gedung Kuliah Umum (GKU). GKU is the largest and widest lecture building in ITERA. GKU has four floors, where each floor has many rooms in it with different functions in each room. As the largest building in ITERA, GKU is often used for various events, including CPNS exams, new student admissions, or for visits from other campuses. Due to the size of this building, this allows visitors from outside ITERA to GKU to experience problems in terms of time to ask questions and difficulty finding various spaces in the GKU Building. This research uses Augmented Reality technology to help make it easier for visitors from outside ITERA to find space quickly and precisely. In its development using several tools, including the ARWaKit SDK. This framework is used on devices with the IoS operating system. In its implementation, it requires a camera on a smartphone to capture existing images and convert them into cyberspace. In the ARWayKit framework, Azure Spatial Anchors have been used which can be used to carry out the mapping process as a markerless method and to optimize the distance from the user's position to the destination location, the a-star algorithm is used. The results obtained from the Variation-2 test were 91.6%.

Characterization of infants’ general movements based on a single RGB-Depth camera: a feasibility study

Movements in infants have age-specific characteristics which could be quantified by extracting specific metrics based on the kinematics of General Movements (GM). For this purpose, a number of metrics have been proposed [1,2]. However the latter have been often obtained using complex and expensive experimental setups. The aim of this study was to evaluate if a simple experimental setup associated (RGB-D camera) with a suitable signal processing (a purposely modified markerless method - MLM) can be used to characterize the GM with the above-mentioned metrics. Data from three typically developing infants sitting in a baby seat were acquired at 3, 4 and 5 months from birth with a single RGB-D camera with depth obtained from a stereoscopic view of two infrared sensors (Intel RealSense D435). Each acquisition lasted three minutes. First, the video and depth data alignment was guaranteed using a purposely developed method, then an automatic tracking algorithm (DeepLabCut [3]) was used to estimate the locations of six points of interest (PoI) for both left and right upper body sides (shoulder, elbow and wrist). The 3D position of PoIs tracked in the RGB images was obtained by exploiting the depth data. Erroneous values were found when one or more of the following situations occurred: 1) a residual spatial misalignment between RGB and depth images, 2) a ‘black’ area in the depth images caused by the different points of view of the two infrared sensors and 3) PoIs were occluded by a body segment. Such erroneous values were replaced by applying a cubic spline interpolation to obtain the 3D trajectories of the PoIs. The periodicity index of the wrist trajectories, the area in which the wrist velocity profiles fall outside the standard deviation band of their moving average and the skewness of the wrist velocity were then determined [1]. Results are shown in Table 1. This work has shown that the infants’ GM could be characterized with a simple experimental setup, therefore giving parents the possibility of performing such evaluations at home with a higher frequency than currently possible in clinical facilities. This would allow an earlier detection of the appearance of GM anomalies. Additional work is needed to streamline the process and reduce the processing time while developing protocols for improving the acceptance and reliability of parents’ participation.

Sistem Edukasi Pengenalan Rumus Matematika Menggunakan Aughmented Reality Berbasis Android

The introduction of spatial media, especially in mathematics, is still often applied to learning module media such as books or whiteboard media as happened. In this case it is less effective because students are less able to absorb what is conveyed by the teacher because the media is still in the form of 2D images. This study aims to build learning augmented reality with markerless method based on android. With the application of augmented reality objects in the recognition of spatial shapes can be used as 3D images. The spatial applications that will be made are cubes, blocks, triangular prisms, triangular pyramids, rectangular pyramids, cones, spheres and regular hexagon prisms. The final result obtained is an educational application for the introduction of mathematical formulas, especially in building spaces using Android-based augmented reality, and in the form of a marker book. It is possible that this technology can be used as a tool for more innovative methods of introducing mathematical geometric formulas. By shining on the rear camera on the marker book, users can immediately see in 3D on the smartphone screen the shape of the shapes and formulas that exist in real time. This will be an interesting lesson, especially for fifth graders at SDIT At Taubah Batam.