Nowadays, Artificial Intelligence (AI) has expanded everywhere, and people have become accustomed to the fact that AI can make decisions for us in our daily lives, ranging from product recommendations on Amazon and films on Netflix, to suggestions of friends on Facebook or Instagram, or even advertisements tailored to who is browsing web pages provided by Google. However, in decisions that can really make a difference, such as diagnosing a disease, it is important to know the motivation behind such a risky decision. Explainable Artificial Intelligence (XAI) systems are a potential solution towards accountable AI, making it trustworthy by explaining decision processes and AI logic to end users.