Software Engineer II - Big Data/Hadoop

Job Description:

At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. We do this by driving Responsible Growth and delivering for our clients, teammates, communities and shareholders every day.

Being a Great Place to Work and providing a culture of caring is core to how we drive Responsible Growth. We are intentional about fostering an inclusive workplace where every teammate has the opportunity to succeed, build a career and contribute to our shared success. This includes attracting and developing exceptional talent, recognizing and rewarding performance, and supporting our teammates’ physical, emotional, and financial wellness through affordable, competitive and flexible benefits.

We value the unique perspectives individuals bring from all backgrounds and career paths - whether shaped by military service, community college education, or a wide range of work and life experiences. These journeys foster resilience, leadership and innovation, strengthening our workforce and positively impact the communities we serve.

Bank of America is committed to an in-office culture that supports collaboration, engagement, and career development. Our approach includes clear in-office expectations, while providing an appropriate level of flexibility based on role-specific responsibilities and business needs.

At Bank of America, you can build a successful career with opportunities to learn, grow, and make an impact. Join us!

Job Description:

This job is responsible for developing and delivering complex requirements to accomplish business goals. Key responsibilities of the job include ensuring that software is developed to meet functional, non-functional and compliance requirements, coding solutions, unit testing, and ensuring the solution can be integrated successfully into the overall application/system with clear, robust, and well-tested interfaces. Job expectations include an awareness of development and testing practices in the industry.

Data Solutions Center team is looking for an experienced Senior Big Data Engineer. Candidate should have strong knowledge of Hadoop technologies, SQL, Spark, and data engineering processes. Candidate should possess excellent analytical and problem-solving skills, develop a deep understanding of data and platform architecture, and support performance optimization and modernization initiatives. The role involves supporting large-scale data platforms, data ingestion, workload migrations, and onboarding applications using modern Big Data tools and frameworks.

Responsibilities:

• Codes solutions and unit test to deliver a requirement/story per the defined acceptance criteria and compliance requirements

• Utilizes multiple architectural components (across data, application, business) in design and development of client requirements

• Performs Continuous Integration and Continuous Development (CI-CD) activities

• Contributes to story refinement and definition of requirements

• Participates in estimating work necessary to realize a story/requirement through the delivery lifecycle

• Contributes to existing test suites (integration, regression, performance), analyze test reports, identify any test issues/errors, and triage the underlying cause

• Performs spike/proof of concept as necessary to mitigate risk or implement new ideas

Required Qualifications:

• 4+ years of relevant work experience

• Proficiency in programming language(s) required for the role

• Experience in Big Data and Data Engineering.

• Strong hands-on expertise with the Hadoop ecosystem, including Cloudera Hadoop, Hive, Spark, HDFS/Ozone, SQL performance tuning, Python, Scala, and Unix scripting.

• Proven experience supporting large-scale production data platforms, troubleshooting distributed systems, and delivering reliable Big Data solutions.

• Experience with Cloudera platform administration, capacity planning, performance tuning, and optimization of Hadoop workloads.

• Strong understanding of Hive, Spark, YARN, storage, and compute performance tuning, including root cause analysis of platform and application performance issues.

• Hands-on experience with Cloudera Private Cloud Data Services (Data Engineering, Data Warehouse, and Machine Learning services), including implementation, onboarding, migration, and operational support.

• The ideal candidate has a solid understanding of data warehousing, modern data platform architectures, and Agile delivery practices.

• Experience with workload migrations, platform onboarding, platform modernization, and cloud-enabled data services is preferred.

• Success in this role requires strong analytical and problem-solving skills, excellent customer focus, and the ability to collaborate effectively with application development, platform, and engineering teams.

Desired Qualifications:

• Experience in financial services and enterprise-scale data modernization programs is highly desirable.

• Knowledge of Cloudera Data Platform (CDP), Ozone, Data Services, and modern data architectures.

• Experience optimizing large-scale Hadoop environments, improving platform performance, and supporting migration of workloads from traditional Hadoop services to modern data platforms and cloud-native services.

Skills:

• Application Development

• Automation

• Collaboration

• DevOps Practices

• Solution Design

• Agile Practices

• Architecture

• Result Orientation

• Solution Delivery Process

• User Experience Design

• Analytical Thinking

• Data Management

• Risk Management

• Technical Strategy Development

• Test Engineering

Minimum Education Requirement: Bachelor’s degree or equivalent work experience.

Shift:

1st shift (United States of America)

Hours Per Week: 

40