Design and Develop an Indexing Module

In recent years, the volume of data being generated and processed by businesses has increased dramatically, creating a need for efficient and scalable solutions for transforming and indexing data. This research study aims to design and develop a new indexing module for search and retrieval purposes. The study begins with an analysis of an existing indexing module, which extracts information from relational databases like Oracle and MariaDB and then propagates it to a NoSQL database, Elastic Search. The objective of this research is to provide a reliable, parallel, and scalable framework for indexing that efficiently handles large amounts of data. Additionally, the study considers the use of different technologies in microservices environments for change data capture and indexing. The new architecture will be evaluated based on its performance and implementation efforts and will provide valuable insights into the suitability of the technology for indexing purposes. This research is expected to provide a basis for future studies in this area and help inform decision-making processes for practitioners considering these technologies.