Skip to content
View joaoguilhermeall's full-sized avatar
🔭
Looking a way
🔭
Looking a way

Block or report joaoguilhermeall

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
joaoguilhermeall/README.md

João Guilherme | Data Engineer

I am a Data Engineer focused on developing scalable and robust data solutions. I specialize in designing, developing, and maintaining efficient data pipelines, leveraging big data technologies to transform raw data into actionable insights. My experience encompasses ETL/ELT processes, data warehousing, and API development. I am currently a student in the Computer Science and Data Science program at Faculdade Descomplica, building upon my prior degree in Systems Engineering from Universidade Federal de Minas Gerais (UFMG).

🛠️ Tech Stack & Tools

Python Spark Kafka GCP AWS SQL Hadoop Docker Airflow Java Linux Git REST API JupyterHub Podman GitLab NiFi Iceberg

Professional Experience

  • Design and maintain robust data pipelines for large-scale data processing.
  • Develop and implement ETL/ELT solutions using Python, SQL, and Java.
  • Build and manage APIs for seamless data integration.
  • Utilize big data technologies such as Apache Spark, Kafka, Hive, Hadoop, and HDFS.
  • Ensure data quality, integrity, and reliability through rigorous testing and monitoring.
  • Optimize data workflows for performance and scalability.

Education

  • Faculdade Descomplica: Computer Science and Data Science (Ongoing)
  • Universidade Federal de Minas Gerais (UFMG): Systems Engineering

Connect

Pinned Loading

  1. sqltools-jdbc-driver sqltools-jdbc-driver Public

    SQLTools Driver for JDBC Clients

    TypeScript 1

  2. datalab datalab Public

    Collection of labs that are designed to help during the learning process of different topics in Big Data, Data Engineering, Data Science, and DevOps.

    Shell

  3. tktwid tktwid Public

    Python

  4. mtxr/vscode-sqltools mtxr/vscode-sqltools Public

    Database management for VSCode

    TypeScript 1.6k 316