Loading
E
Databricks Data Engineer
Ernst & YoungNicosia3-5 years
Apply At EY, we’re all in to shape your future with confidence.
We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.
Join EY and help to build a better working world
The opportunity
We are seeking a Databricks Data Engineer to join our Consulting practice and support clients in designing, implementing and industrializing modern lakehouse platforms. The role will focus on scalable data ingestion, transformation, data modelling and analytics enablement using Databricks, Apache Spark, Delta Lake and cloud-native data services. Our team is part of EY’s Europe Central (EC) cluster, delivering market leading services to organizations across industries in Cyprus and internationally.
Key responsibilities
- Design, develop and maintain scalable data pipelines and lakehouse architectures on Databricks.
- Build and optimize Spark-based ETL/ELT workloads using PySpark and/or Scala, with strong focus on performance, reliability and maintainability.
- Implement Delta Lake patterns including bronze/silver/gold layers, schema evolution, partitioning, time travel and ACID-compliant data management.
- Develop robust ingestion patterns from relational databases, files, APIs and streaming or near-real-time sources where applicable.
- Create curated data models that support analytics, reporting and downstream consumption by BI and data science teams.
- Apply Databricks engineering best practices across notebooks, jobs/workflows, reusable libraries, version control, testing and deployment.
- Optimize Spark jobs through practical tuning of joins, partitions, file sizes, caching, cluster configuration and query execution plans.
- Implement data quality, validation, reconciliation and monitoring checks across data pipelines.
- Collaborate with data architects, analysts, data scientists and business stakeholders to translate requirements into high-quality data products.
- Contribute to platform standards, reusable accelerators, code reviews, documentation and engineering governance across client engagements.
Skills and attributes for success
-
Bachelor’s and/or Master’s degree in Computer Science, Engineering, Mathematics or a related field.
-
3–5 years of experience in data engineering, analytics engineering or a related field.
-
Hands-on experience with Databricks is required, including practical use of notebooks, jobs/workflows, clusters and Delta Lake.
-
Practical use of Delta Lake for reliable data storage, incremental processing and curated analytical datasets.
-
Experience designing medallion-style architectures and separating raw, cleansed and business-ready data layers.
-
Strong experience with Apache Spark and distributed data processing, preferably using PySpark and/or Scala.
-
Ability to write, review and optimize PySpark code for batch data processing at scale.
-
Understanding of Databricks Jobs/Workflows or equivalent orchestration patterns for production pipelines.
-
Ability to explain Spark performance concepts clearly during technical discussions or interviews.
-
Awareness of Unity Catalog or equivalent governance concepts, including catalog/schema/table organization, access control and lineage considerations.
-
Strong SQL skills and experience working with relational databases such as SQL Server, Oracle or PostgreSQL.
-
Good understanding of lakehouse and data warehouse modelling concepts, including star schema, fact/dimension models and slowly changing dimensions.
-
Experience developing production-grade ETL/ELT pipelines with appropriate logging, error handling, monitoring and documentation.
-
Familiarity with cloud data environments, preferably Azure, including storage, identity/access concepts and data integration services.
-
Ability to work with structured and semi-structured data formats such as Parquet, Delta, CSV, JSON and XML.
-
Strong analytical thinking, problem-solving mindset and ability to troubleshoot performance and data quality issues.
-
Effective communication skills and ability to work in cross-functional consulting teams.
What we offer you
At EY, we’ll develop you with future-focused skills and equip you with world-class experiences. We’ll empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams. Learn more.
In addition to a competitive salary, our benefits include but are not limited to:
-
13th salary
-
Provident Fund
-
Private Medical and Life Insurance
-
Flexible working arrangements (hybrid work and flexible work schedule)
-
Friday afternoon off
-
EY Tech MBA and EY MSc in Business Analytics
-
EY Badges - digital learning certificates
-
Mobility programs (if interested to work abroad)
-
Paid Sick Leave
-
Paid Paternity Leave
-
Yearly wellbeing days off
-
Maternity, Wedding and New Baby Gifts
-
EY Employee Assistance Program (EAP) (counselling, legal and financial consultation services)
Are you ready to shape your future with confidence? Apply today.
To help create the best experience during the recruitment process, please describe any disability-related adjustments or accommodations you may need.
EY | Building a better working world
EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets.
Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow.
EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories.