Brazil
SONDA
Experian
Senior Data Engineering Analyst (Databricks)
Brazil
São Paulo, São Paulo, Brazil
PythonSQLTerraform
Automatic translation. Check the original.
Company Description
Experian is a global data and technology company that drives opportunities for people and businesses around the world. We operate in various markets, such as financial services, healthcare, automotive, agribusiness, insurance, among others. Experian invests in people and advanced new technologies to unlock the power of data. We have an incredible team of 25.200 employees in 32 countries.
Our uniqueness is valuing yours. The Experian culture, which is people-centric, inclusive, and purpose-driven, is recognized by various awards — including World’s Best Workplaces™ 2025 (Fortune's Top 25 global) and Great Place To Work™ in 26 countries, among others. Check out Experian Life on social media or explore our careers site to understand why. Experian also prides itself on being an equal opportunity and affirmative action employer.
Job Description
We are looking for a Senior Data Analyst to build and evolve our modern data platform, focusing on large-scale data ingestion, processing, and availability. The professional will be responsible for developing robust and scalable pipelines using Databricks, contributing to the reliability, governance, and efficiency of the company's data ecosystem.
We are looking for a hands-on profile with strong technical skills, architectural vision, and experience in highly complex corporate data environments.
Additional Information
Serasa Experian is much more than you imagine. With the purpose of creating a better future by expanding opportunities for people and businesses, in Brazil we are more than 4 thousand people working across various teams and specialties. Here, every insight and diversity complements one another, and you can work on what you love most; we are committed to building an inclusive culture and an environment where people can balance their careers with their personal commitments and interests, prioritizing well-being.
We are very dedicated to being one of the best and most innovative companies to work for in the country, enabling incredible experiences and careers for our people. Our strong people-first approach is externally recognized through various market certifications: we were awarded by Great Place To Work™ in 24 countries and by the international Top Employers certification, in addition to being recognized as one of the best companies for young professionals and having a 4.6 rating on Glassdoor. Each recognition indicates that we are on the right track, providing an ever-improving work environment for our talents.
Experian Careers - Creating a better tomorrow together
Main responsibilities
- Develop and maintain batch and streaming data ingestion pipelines using Databricks.
- Design and implement data integration solutions from multiple sources (APIs, relational databases, files, legacy systems, and SaaS).
- Build and optimize processes using Apache Spark.
- Apply best practices in data engineering, DataOps, and observability.
- Ensure the quality, reliability, and performance of pipelines.
- Work on data modeling and organization in Lakehouse architectures.
- Collaborate with business, analytics, governance, and platform teams.
- Support the definition of technical standards, reusable frameworks, and development best practices.
- Conduct troubleshooting and performance optimizations on critical data processes.
- Participate in modernization and evolution initiatives of the data platform.
Qualifications
- Proven experience with Databricks in production environments.
- Experience with Apache Spark (PySpark or Scala).
- Experience in developing data ingestion and transformation pipelines.
- Experience with Data Lake and Lakehouse solutions.
- Experience with Git and CI/CD processes.
- Knowledge in analytical data modeling.
Technical knowledge
- Advanced Python.
- Advanced SQL.
- Databricks Workflows.
- Delta Lake.
- Spark Structured Streaming.
- REST APIs.
- Modern data architectures.
- Performance optimization in Spark.
- Pipeline monitoring and control.
- Data governance and quality concepts.
Behavioral competencies
- Strong sense of ownership.
- Ability to act autonomously and proactively.
- Collaborative profile focused on problem-solving.
- Good communication with technical and business areas.
- Ability to influence technical decisions.
- Continuous improvement mindset.
- Systemic vision and focus on scalability.
Preferred
- Databricks certifications.
- Experience with Unity Catalog.
- Experience with Terraform and Infrastructure as Code.
- Knowledge in Kafka or Event Hubs.
- Experience with monitoring using Datadog.
- Knowledge in Airflow.
Find out what its like to work for Experian by clicking here
Employee Status: Regular
Role Type: Hybrid
Department: Product Management
Schedule: Full Time
More opportunities with one profile
Want to be considered for more roles without repeating the whole process? Create your profile and be found by companies using Nort.
Create my profile