Brazil
GFT Technologies SE
Experian
Senior Data Engineer (Databricks)
Brazil
São Paulo, São Paulo, Brazil
PythonSQLTerraform
Automatic translation. Check the original.
Company Description
Experian is a global data and technology company that drives opportunities for people and businesses around the world. We operate in various markets, such as financial services, healthcare, automotive, agribusiness, insurance, among others. Experian invests in people and advanced new technologies to unlock the power of data. We have an incredible team of 25,200 employees in 32 countries.
Our uniqueness is valuing yours. Experian's people-centric, inclusive, and purpose-driven culture is recognized by various awards—including World’s Best Workplaces™ 2025 (Fortune’s Global Top 25) and Great Place To Work™ in 26 countries, among others. Check out Experian Life on social media or explore our careers site to understand why. Experian also prides itself on being an equal opportunity and affirmative action employer.
Job Description
We are looking for a Senior Data Engineer to build and evolve our modern data platform, focusing on large-scale data ingestion, processing, and availability. The professional will be responsible for developing robust and scalable pipelines using Databricks, contributing to the reliability, governance, and efficiency of the company's data ecosystem.
We seek a hands-on profile with strong technical skills, architectural vision, and experience in highly complex corporate data environments.
Experian Careers - Creating a better tomorrow together
Main responsibilities
- Develop and maintain batch and streaming data ingestion pipelines using Databricks.
- Design and implement data integration solutions from multiple sources (APIs, relational databases, files, legacy systems, and SaaS).
- Build and optimize processes using Apache Spark.
- Apply best practices in data engineering, DataOps, and observability.
- Ensure quality, reliability, and performance of pipelines.
- Work on data modeling and organization in Lakehouse architectures.
- Collaborate with business, analytics, governance, and platform teams.
- Support the definition of technical standards, reusable frameworks, and development best practices.
- Conduct troubleshooting and performance optimizations on critical data processes.
- Participate in modernization and evolution initiatives of the data platform.
Qualifications
- Solid experience as a Data Engineer.
- Proven experience with Databricks in production environments.
- Experience with Apache Spark (PySpark or Scala).
- Experience in developing data ingestion and transformation pipelines.
- Experience with Data Lake and Lakehouse solutions.
- Experience with Git and CI/CD processes.
- Knowledge of analytical data modeling.
Technical Knowledge
- Advanced Python.
- Advanced SQL.
- Databricks Workflows.
- Delta Lake.
- Spark Structured Streaming.
- REST APIs.
- Modern data architectures.
- Performance optimization in Spark.
- Pipeline monitoring and control.
- Data governance and quality concepts.
Behavioral Competencies
- Strong sense of ownership.
- Ability to act autonomously and proactively.
- Collaborative profile focused on problem-solving.
- Good communication with technical and business areas.
- Ability to influence technical decisions.
- Continuous improvement mindset.
- Systemic vision and focus on scalability.
Nice-to-haves
- Databricks certifications.
- Experience with Unity Catalog.
- Experience with Terraform and Infrastructure as Code.
- Knowledge of Kafka or Event Hubs.
- Experience with monitoring using Datadog.
- Knowledge of Airflow.
Additional Information
Serasa Experian is much more than you imagine. With the purpose of creating a better future, expanding opportunities for people and companies, in Brazil we are more than 4 thousand people working in various teams and specialties. Here, every knowledge and diversity complements each other and you can work in what you love most; we are committed to building an inclusive culture and an environment in which people can balance their career with their personal commitments and interests, prioritizing well-being.
We dedicate ourselves greatly to being one of the best and most innovative companies to work for in the country, enabling incredible experiences and careers for our people. Our strong people-first approach is externally recognized through various market certifications: we were awarded by Great Place To Work™ in 24 countries and by the international Top Employers certification, in addition to being recognized as one of the best companies for young professionals and having a rating of 4.6 on Glassdoor. Each recognition indicates that we are on the right path, providing an ever-better work environment for our talents.
Find out what its like to work for Experian by clicking here
Employee Status: Regular
Role Type: Hybrid
Department: Product Management
Schedule: Full Time
More opportunities with one profile
Want to be considered for more roles without repeating the whole process? Create your profile and be found by companies using Nort.
Create my profile