Data Engineer III - Core Technology Infrastructure
Charlotte, North Carolina
**Job Description:**
Responsible for leading efforts to develop and deliver complex data solutions to accomplish technology and business goals. Codes design and delivery tasks associated with the integration, cleaning, transformation and control of data in operational and analytics data systems. Works with stakeholders, Product Owners, and Software Engineers to aid in the implementation of data requirements, analyze performance, conduct research and troubleshoot any issues. Proficient in data engineering practices, and have extensive experience of using design and architectural patterns. Contributes to story refinement/defining requirements. Participates in estimating work necessary to realize a story/requirement through the delivery lifecycle. Utilizes multiple architectural components in design and development of client requirements. Codes complex solutions to integrate, clean, transform and control data in operational and/or analytics data systems per the defined acceptance criteria. Assists team with resolving technical complexities involved in realizing story work. Collaborates with development teams to understand data requirements, ensure the data architecture is feasible to implement and subsequently implemented accurately. Assembles large, complex data sets that meet functional / non-functional requirements. Builds processes supporting data transformation, data structures, metadata, data quality controls, dependency and workload management. Defines and builds data pipelines that enable faster, better, data-informed decision-making within the business. Contributes to existing test suites (integration, regression, performance), analyzes test reports, identifies any test issues/errors, and triages the underlying cause. Documents and communicates required information for deployment, maintenance, support, and business functionality. Adheres to team delivery/release process and cadence pertaining to code deployment and release. Identifies gaps in data management standards adherence and works with appropriate partners to develop plans to close gaps. Leads concept and experimentation testing and synthesizes the results to validate and improve analytical solution. Monitors key performance indicators and internal controls. Mentors more junior Data Engineers and coaches team on CI-CD practices and automating tool stack. Individual contributor.
Position Description:
The Cloud Data Engineer supports multiple instances of Azure cloud databases including Synapse Analytics, CosmosDB, Azure SQL database, development/uat databases, Storage management, Archive, Restore, disaster recovery, security and the enterprise warehouse systems and business applications. This resource is responsible for building and Installing new cloud database solutions including setting access control security layer, DR setup, Manage/Monitor cloud database system performance, including workload management, query performance and tuning. Will also provide consulting on physical database implementations, Partitioning, Indexing, join methods, and data access paths. Works closely with Microsoft vendor support, Engineering, Operation, Production support to design and implement secure, available and performant data services on Azure cloud platform supporting a variety of applications on Data Warehouse platform.
Implement and administer access policies in conjunction with corporate standards.
Manage, design, develop, support and consult cloud shell/power shell process/scripts/tools/ARM templates for system management.
Required Skills:
+ 3+ years experience as a Cloud Data Engineer with Microsoft Azure cloud Data engineering experience
+ Experience on Azure Synapse / CosmosDB / Azure SQL Database and/or prior experience on supporting very large database migration to Azure cloud is highly preferred
+ Advanced working knowledge of MPP Database Architecture and Azure cloud architecture
+ Database physical implementation expertise
+ Advanced experience on Azure security/RBAC/Database Roles
+ Experience on Azure ADF/Synapse/CosmosDB/Storage accounts PaaS services
+ Experience on creating resources on Azure using Power Shell / Cloud Shell with proper security and access control attributes
+ Advanced working knowledge of database administration on any RDBMS (SQL Server / Teradata preferred) including Security administration, High Availability, DR, Performance tuning and Workload management
+ Expert in advanced SQL (preferably T-SQL)
+ Advanced design and development of Stored procedures (T-SQL preferred)
+ Advanced knowledge of Data Warehouse design including 3NF/ Star Schema / Snow Flake design etc
+ Database performance tuning using Indexing, Partitioning etc
+ Experience on Agile development, SDM tools including JIRA, Bitbucket Repository, CI/CD Pipelines, Ansible, Change Management process using tools like Remedy etc
+ Strong Python / Scala scripting experience with working knowledge on Notebooks
Desired Education:
+ BS Degree
Desired Skills:
+ Familiar with Cloud Storage like Native Object Storage, Machine Learning etc
+ Familiar on Teradata database / Hadoop platform
+ Familiar with Cloud/Blob/object storage and file formats including Parquet SSO onboarding using AD integration for authentication and authorization
+ Familiar with Apache Spark Experience in implementing data solutions in Azure including Azure SQL, Synapse Analytics, CosmosDB, Apache Spark etc
+ Familiar on Data Lake Architecture Familiar on Azure RBAC roles
+ Familiar on Elastic computing especially on cloud platform
**Job Band:**
H5
**Shift:**
1st shift (United States of America)
**Hours Per Week:**
40
**Weekly Schedule:**
**Referral Bonus Amount:**
0
**Job Description:**
Responsible for leading efforts to develop and deliver complex data solutions to accomplish technology and business goals. Codes design and delivery tasks associated with the integration, cleaning, transformation and control of data in operational and analytics data systems. Works with stakeholders, Product Owners, and Software Engineers to aid in the implementation of data requirements, analyze performance, conduct research and troubleshoot any issues. Proficient in data engineering practices, and have extensive experience of using design and architectural patterns. Contributes to story refinement/defining requirements. Participates in estimating work necessary to realize a story/requirement through the delivery lifecycle. Utilizes multiple architectural components in design and development of client requirements. Codes complex solutions to integrate, clean, transform and control data in operational and/or analytics data systems per the defined acceptance criteria. Assists team with resolving technical complexities involved in realizing story work. Collaborates with development teams to understand data requirements, ensure the data architecture is feasible to implement and subsequently implemented accurately. Assembles large, complex data sets that meet functional / non-functional requirements. Builds processes supporting data transformation, data structures, metadata, data quality controls, dependency and workload management. Defines and builds data pipelines that enable faster, better, data-informed decision-making within the business. Contributes to existing test suites (integration, regression, performance), analyzes test reports, identifies any test issues/errors, and triages the underlying cause. Documents and communicates required information for deployment, maintenance, support, and business functionality. Adheres to team delivery/release process and cadence pertaining to code deployment and release. Identifies gaps in data management standards adherence and works with appropriate partners to develop plans to close gaps. Leads concept and experimentation testing and synthesizes the results to validate and improve analytical solution. Monitors key performance indicators and internal controls. Mentors more junior Data Engineers and coaches team on CI-CD practices and automating tool stack. Individual contributor.
Position Description:
The Cloud Data Engineer supports multiple instances of Azure cloud databases including Synapse Analytics, CosmosDB, Azure SQL database, development/uat databases, Storage management, Archive, Restore, disaster recovery, security and the enterprise warehouse systems and business applications. This resource is responsible for building and Installing new cloud database solutions including setting access control security layer, DR setup, Manage/Monitor cloud database system performance, including workload management, query performance and tuning. Will also provide consulting on physical database implementations, Partitioning, Indexing, join methods, and data access paths. Works closely with Microsoft vendor support, Engineering, Operation, Production support to design and implement secure, available and performant data services on Azure cloud platform supporting a variety of applications on Data Warehouse platform.
Implement and administer access policies in conjunction with corporate standards.
Manage, design, develop, support and consult cloud shell/power shell process/scripts/tools/ARM templates for system management.
Required Skills:
+ 3+ years experience as a Cloud Data Engineer with Microsoft Azure cloud Data engineering experience
+ Experience on Azure Synapse / CosmosDB / Azure SQL Database and/or prior experience on supporting very large database migration to Azure cloud is highly preferred
+ Advanced working knowledge of MPP Database Architecture and Azure cloud architecture
+ Database physical implementation expertise
+ Advanced experience on Azure security/RBAC/Database Roles
+ Experience on Azure ADF/Synapse/CosmosDB/Storage accounts PaaS services
+ Experience on creating resources on Azure using Power Shell / Cloud Shell with proper security and access control attributes
+ Advanced working knowledge of database administration on any RDBMS (SQL Server / Teradata preferred) including Security administration, High Availability, DR, Performance tuning and Workload management
+ Expert in advanced SQL (preferably T-SQL)
+ Advanced design and development of Stored procedures (T-SQL preferred)
+ Advanced knowledge of Data Warehouse design including 3NF/ Star Schema / Snow Flake design etc
+ Database performance tuning using Indexing, Partitioning etc
+ Experience on Agile development, SDM tools including JIRA, Bitbucket Repository, CI/CD Pipelines, Ansible, Change Management process using tools like Remedy etc
+ Strong Python / Scala scripting experience with working knowledge on Notebooks
Desired Education:
+ BS Degree
Desired Skills:
+ Familiar with Cloud Storage like Native Object Storage, Machine Learning etc
+ Familiar on Teradata database / Hadoop platform
+ Familiar with Cloud/Blob/object storage and file formats including Parquet SSO onboarding using AD integration for authentication and authorization
+ Familiar with Apache Spark Experience in implementing data solutions in Azure including Azure SQL, Synapse Analytics, CosmosDB, Apache Spark etc
+ Familiar on Data Lake Architecture Familiar on Azure RBAC roles
+ Familiar on Elastic computing especially on cloud platform
**Shift:**
1st shift (United States of America)
**Hours Per Week:**
40
Learn more about this role
Full time
JR-22089064
Band: H5
Manages People: No
Travel: Yes, 5% of the time
Manager:
Talent Acquisition Contact:
Tanya Edmond [C]
Referral Bonus:
0
Bank of America and its affiliates consider for employment and hire qualified candidates without regard to race, religious creed, religion, color, sex, sexual orientation, genetic information, gender, gender identity, gender expression, age, national origin, ancestry, citizenship, protected veteran or disability status or any factor prohibited by law, and as such affirms in policy and practice to support and promote the concept of equal employment opportunity and affirmative action, in accordance with all applicable federal, state, provincial and municipal laws. The company also prohibits discrimination on other bases such as medical condition, marital status or any other factor that is irrelevant to the performance of our teammates.
To view the "EEO is the Law" poster, CLICK HERE (https://www.dol.gov/ofccp/regs/compliance/posters/pdf/eeopost.pdf) .
To view the "EEO is the Law" Supplement, CLICK HERE (https://www.dol.gov/ofccp/regs/compliance/posters/pdf/OFCCP\_EEO\_Supplement\_Final\_JRF\_QA\_508c.pdf) .
Bank of America aims to create a workplace free from the dangers and resulting consequences of illegal and illicit drug use and alcohol abuse. Our Drug-Free Workplace and Alcohol Policy (Policy) establishes requirements to prevent the presence or use of illegal or illicit drugs or unauthorized alcohol on Bank of America premises and to provide a safe work environment.
To view Bank of Americas Drug-free workplace and alcohol policy, CLICK HERE .
