I am a Data Engineer focused on developing scalable and robust data solutions. I specialize in designing, developing, and maintaining efficient data pipelines, leveraging big data technologies to transform raw data into actionable insights. My experience encompasses ETL/ELT processes, data warehousing, and API development. I am currently a student in the Computer Science and Data Science program at Faculdade Descomplica, building upon my prior degree in Systems Engineering from Universidade Federal de Minas Gerais (UFMG).
- Design and maintain robust data pipelines for large-scale data processing.
- Develop and implement ETL/ELT solutions using Python, SQL, and Java.
- Build and manage APIs for seamless data integration.
- Utilize big data technologies such as Apache Spark, Kafka, Hive, Hadoop, and HDFS.
- Ensure data quality, integrity, and reliability through rigorous testing and monitoring.
- Optimize data workflows for performance and scalability.
- Faculdade Descomplica: Computer Science and Data Science (Ongoing)
- Universidade Federal de Minas Gerais (UFMG): Systems Engineering
- LinkedIn: joaoguilhermeall
- Email: [email protected]