A Project on Statistical Analysis, ETL Automation, and Intelligence Reporting

Abstract

The integration of data visualization and data analytics has been rising rapidly. Companies working on a large scale have a tremendous amount of data, this data has huge potential and can be used in order to improve the functioning of such an organization. The data can be used to optimize various areas of the organization, improvement of products, giving a better customer experience, increasing efficiency and much more. There has been an increase in the amount of tools and solutions created for working with data. The end result is produced by the combination of various technologies. A data pipeline can consist of data visualization tools, Machine learning models, Cloud database management systems etc. Our paper provides a case study on how we used a data pipeline in order to streamline the data and optimize the selection process of such a large scale organization. The Teach for India Fellowship program is an opportunity for India's brightest and most promising youth, from the nation's best institutes, to serve as full-time teachers to students from low-income communities in under-resourced schools. For the selection of these students Teach for India has a selection model in place which weeds out a certain percentage of applicants. These applicants are then reviewed by a special set of reviewers at Teach for India. Our project aims at providing a better understanding of the different competencies that are taken under consideration during the selection process and link them to the fellow's performance in the institute. The methodology and the approach can be used for many such organizations having nation wide data and requires finding the relationship between two groups of data and wants to optimize their selection process.