Arthur Reis
Data & AI Engineer
Databricks · Azure · Microsoft Fabric
Data and AI Engineer specialized in Databricks, Azure and Microsoft Fabric. I build modern data platforms, lakehouse architectures, high-performance pipelines and data quality frameworks, and explore applied AI with multi-agent systems. I share what I learn through talks, YouTube videos, blog posts, LinkedIn and open source projects.
Experience
- Sep 2025 — Present
Consultant Data Engineer · Power Tuning
Brazil · RemoteNational and international data platform strategy and modernization with Microsoft Fabric and Databricks.
- Designed and deployed a Data Platform for a major Brazilian multinational using Microsoft Fabric and Databricks, aligning technical solutions with business and governance objectives.
- Architected and deployed data workflows via Infrastructure as Code (IaC) through Azure Data Factory, ensuring scalable, maintainable and auditable pipelines.
- Designed and deployed an entire Lakehouse and AI products using Databricks and Azure.
- Implemented Databricks Genie Spaces as a conversational analytics interface over the platform data.
Microsoft Fabric Databricks Azure Azure Data Factory PySpark SQL Python - Mar 2026 — Present
Data Engineer · AB InBev (Miners)
Brazil · RemoteData Engineering and AI projects with a focus on Databricks, GitHub and Airflow.
- Maintained data pipelines in Databricks and Airflow.
- Migrated and refactored Spark and SQL code.
- Built a multi-agent system to accelerate migrations using Databricks Genie.
- Built a multi-agent system for PR reviews using OpenAI and GitHub Actions.
Databricks Apache Airflow GitHub Actions PySpark SQL Databricks Genie OpenAI - May 2025 — Sep 2025
Data Engineer · Kumulus
Brazil · RemoteData strategy, platform design and implementation for national and international clients.
- Led data platform strategy and Lakehouse architecture design for a U.S.-based multinational, defining governance standards, data models and platform structure aligned with client goals.
- Contributed to data platform modernization for a U.S. government organization, mapping data maturity and driving adoption with international stakeholders.
- Designed and implemented Lakehouse solutions for two Brazilian companies, including governance frameworks and data quality controls.
- Mentored and supervised junior Data Engineers, contributing to team topology definition.
- Deployed Microsoft Copilot to increase data team productivity across clients.
Databricks Azure Python SQL Delta Lake - Apr 2024 — May 2025
Data Engineer · Paytime
Brazil · RemoteOwned the company's end-to-end data strategy from the ground up: infrastructure, governance, quality and analytics.
- Designed and implemented the Data Lakehouse (Databricks, Spark, SQL, MongoDB, AWS) as the foundation for scalable data products and self-service analytics.
- Established data governance practices including quality testing pipelines, documentation standards and access control policies.
- Designed and delivered the company's first data products: interactive Power BI dashboards for business stakeholders.
- Implemented AWS data services (S3, Lambda, Glue, IAM) for a secure and scalable data infrastructure.
- Explored and implemented Databricks Genie Spaces for conversational analytics over company data.
Databricks Apache Spark AWS MongoDB Power BI Python SQL - Sep 2023 — Mar 2024
Data Analyst · Piwi
Brazil · RemoteManaged the company's end-to-end data strategy, from ingestion to analytics enablement.
- Led the development of the company's Lakehouse on GCP, defining the data architecture strategy and enabling scalable data management.
- Designed and launched the company's first analytics data products using Looker Studio, enabling self-service BI.
- Developed data extraction and cleaning pipelines using Python, SQL and MongoDB.
GCP Python SQL MongoDB Looker Studio - Mar 2022 — Jan 2023
Data Analyst · Secretaria Estadual de Educação do ES
Espírito Santo · BrazilSupporting data-driven decision-making for public educational policy in Espírito Santo.
- Conducted data analysis and strategic reporting on Indigenous, Quilombola and Rural schools to inform educational policy decisions.
- Produced educational resources and led training sessions on data practices for school staff.
Power BI Python SQL Excel - Mar 2018 — Nov 2022
Researcher / Data Analyst · UFES — Universidade Federal do Espírito Santo
Vitória, ES · BrazilMaster's and PhD research focused on historical data analysis and social network modeling.
- Performed ETL on historical documents and built data pipelines using Python.
- Conducted social network analysis (Twitter) through API integration using Python.
- Built visualizations and dashboards in Power BI to communicate research findings to academic stakeholders.
- Developed the website www.jornaisdaindependencia.com.br.
Python R Power BI SQL Excel
Tools & technologies
Data Engineering
SQL & Spark
Quality & Governance
AI & Agents
Certifications
✓ Databricks Certified Data Engineer Professional
Databricks Verify
✓ Databricks Certified Data Engineer Associate
Databricks Verify
✓ Apache Spark Developer
Databricks Verify
✓ Databricks Certified Data Analyst Associate
Databricks Verify
✓ DP-750: Microsoft Fabric Analytics Engineer
Microsoft Verify
✓ DP-700: Microsoft Fabric Data Engineer
Microsoft Verify
✓ DP-900: Azure Data Fundamentals
Microsoft Verify
✓ AZ-900: Azure Fundamentals
Microsoft VerifyAI-900: Microsoft Azure AI Fundamentals
Microsoft VerifyGCP Associate Cloud Engineer
Google VerifyApache Airflow
Astronomer VerifyMongoDB for SQL Professionals
MongoDBGoogle Data Analytics
Google / Coursera VerifyGoogle Project Management
Google / Coursera VerifyTalks & events
AI and Data Quality on Databricks: building tests with DQX and AI
Data Platform track. Why data quality matters more than ever in the AI era, and how to build tests on Databricks with DQX and DQX Forge — from hand-written rules to AI-generated rules, data contracts, metrics and quarantine.
AI and Data Quality on Databricks
Data quality fundamentals (DAMA-DMBOK, data contracts, data quality vs. observability) and, in practice, tests on Databricks with DQX and DQX Forge, including AI-assisted rule generation and a live demo.
Accelerating a Data Engineering career with Microsoft Learn Student Ambassadors
With Edilson Santos. How the Microsoft Student Ambassadors program works, how to join and grow in it, and how to use its benefits (Azure credits, certifications and community) to build a portfolio and accelerate a data career — with an Azure demo.
Building a data quality process on Databricks with AI
How to structure a data quality process on Databricks: 5-step planning, metrics, anti-patterns and tests with DQX and DQX Forge, using AI to generate rules from profiling and data contracts.
Data Quality on Databricks
Data quality frameworks, data contracts, metrics and anti-patterns — ISO-25012 and DAMA DMBOK applied to the medallion architecture.
Modern data architectures: Snowflake, Databricks and a bit of AI
Comparison of modern data architectures — Snowflake and Databricks — and how AI is transforming the way data platforms are built and operated.