Data Engineer III- Python / Data Lake
J.P. Morgan
This job is no longer accepting applications
See open jobs at J.P. Morgan.See open jobs similar to "Data Engineer III- Python / Data Lake" Tech:NYC.Be part of a dynamic team where your distinctive skills will contribute to a winning culture and team.
Job responsibilities
- Supports review of controls to ensure sufficient protection of enterprise data
- Advises and makes custom configuration changes in one to two tools to generate a product at the business or customer request
- Updates logical or physical data models based on new use cases
- Frequently uses SQL and understands NoSQL databases and their niche in the marketplace
- Adds to team culture of diversity, opportunity, inclusion, and respect
Required qualifications, capabilities, and skills
- Formal training or certification on data engineering concepts and 3+ years applied experience
- Experience across the data lifecycle
- Expertise in Python programming language for data engineering tasks (secondary alternative: Java)
- Expertise in cluster computing frameworks such as Spark or Flink
- Experience in building data lakehouse platforms (AWS data lake or Databricks or Hadoop)
- Experience in building DAGs/workflows using scheduling/orchestration tools (Airflow or AWS Step Functions or similar)
- Advanced at SQL (e.g., joins and aggregations)
- Working understanding of NoSQL databases
- Significant experience with statistical data analysis and ability to determine appropriate tools and data patterns to perform analysis
- Experience customizing changes in a tool to generate product
- Proficiency in developing data pipelines using AWS services such Glue, EMR, MSK, Kinesis, etc.
- Experience in using relational data stores (Postgres or similar) and NOSQL data stores (Cassandra or Dynamo or similar)
- Proficiency in IAC (Terraform)
- Knowledge of data serialization formats (e.g., JSON, Avro, Protobuf), big-data storage formats (e.g., Parquet, Iceberg, Hudi), data processing methodologies (batch, micro-batching, stream), and data modeling techniques (Dimensional, Data Vault, Kimball, Inmon)
We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.
We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.
JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans
Our Consumer & Community Banking Group depends on innovators like you to serve consumers, small businesses, municipalities and non-profits. You’ll support the delivery of award winning tools and services that cover everything from personal and small business banking as well as lending, mortgages, credit cards, payments, auto finance and investment advice. This group is also focused on developing and delivering cutting edged mobile applications, digital experiences and next generation banking technology solutions to better serve our clients and customers.
Develop, test, and maintain critical data pipelines and architectures across multiple technical areas
This job is no longer accepting applications
See open jobs at J.P. Morgan.See open jobs similar to "Data Engineer III- Python / Data Lake" Tech:NYC.