Automated forms cleaning by considering forms with coloured content and coloured backgrounds

The Main purpose of this project, extraction/erasing of information filled forms. As you know, forms include dynamic contents and static contents. When a form is completed by customers/ clients, static contents are the same, but the dynamic of the contents are different for each client/customer. Since this real dataset is scarce, I used the simulation method to generate fake dataset. These Empty forms are in PDF format. So, I need first convert these empty forms from PDF to PNG, then generate the dynamic content of forms and insert them on different locations of the form. For generating dynamic content of form, First I have to understand which dynamic content or which dynamic data require, and then with using fake python library generate random dynamic data. For instance, for filling the empty form, the python library needs to generate some German full-name, address, Bank account information, date of birth, job title, Email and some random text. The dataset is automatically generated. Therefore, we need also that information extraction should be done automatically because we cannot use humans to extract relevant information. This process is so slow. We can use such simulated datasets to train a Deep Learning model for extraction static forms given user filled dynamic forms. The work is then to learn for distinguishing between static and dynamic content and erase only the dynamic content, by considering these forms have coloured backgrounds and after removing the dynamic contents, the background must be recreated recovered. So that static templates can be extracted automatically from fake complete documents. Dynamic contents have two features: they have a coloured background and their location varies in form. So, deep learning model to be able to distinguish static content from dynamic content. We present a model that to be able to learns to distinguish between dynamic and static text in an image and erases dynamic content present in a filled form and recreate the background colour. Dynamic content erasure achieved an average SSIM score of 0.00003809 between original empty form image and generated form image.