19 个优质java developer职位（正在招聘！）

Data Engineer
Dalian Styxtech Systems Co. Ltd. —上海市
- 月薪50,000-60,000元
- 全职
快速申请
15 小时
Senior Professional, IT Systems
Yanfeng Automotive —上海市
- 全职
6天
IoT Technical Support Engineer, Senior
PTC Inc. —上海市
Senior Sofware Engineer-Backend
Atlas Copco Group —上海市
Senior Graphics Dev Tools Engineer
Qualcomm —成都市
Software Engineering & Development, VP
State Street —杭州市
- 全职
Principal Software Engineer - Map Rendering
HERE Technologies —北京市
12天
Senior Quality Assurance Engineer (Crypto.com APP)
Crypto.com —深圳市
快速申请
Software Engineering & Development, AVP
State Street —杭州市
- 全职
Backend QA Engineer
LotusFlare —西安市
Lead Software Engineer - IoT
BISSELL Homecare —深圳市
Senior AI Engineer
Standard Chartered —广州市
Technical Lead Full Stack
Fidelity International —大连市
- 全职
12天
数字化架构及方案研发主任工程师
ABB LV Installation Materials Co. Ltd. Beijing —北京市
快速申请
1天
AI Agent Security Research Engineer
OKX —深圳市
DLT Senior Full Stack Engineer
Standard Chartered —广州市
12天
Principal Software Engineer - Customer Integration
HERE Technologies —北京市
12天
QA Engineer
LotusFlare —西安市
Senior R&D Engineer (Embedded Android System)
ABB Xiamen Smart Technology Co., Ltd. —厦门市
快速申请
10天

More jobs to discover

Find similar jobs that you might be interested in.

System Engineer Simulation (Performance, Thermal Behaviour)/性能/热仿真系统工程师(逆变器)_EM
Bosch Group —上海市
Experience in performance simulation or thermal simulation of electric drive systems is preferred. Minimum 3 years of working experience in simulation of…
快速申请
Senior Brand Strategist
MetaDesign —北京市
你会与在战略性品牌咨询与品牌管理上十分有才干的设计师，客户经理，与品牌顾问组成的国际团队一起工作。你会进行研究和分析并帮助开发品牌战略／品牌模型，准备展示文稿，与客户或者目标团体一起开会。你的思维有条理且井然有序，在与品牌咨询团队以及设计团队合作相关的项目筹划上掌握系统化的方法途径。根据项目需要…

Show more similar jobs

我想收到 java developer 的最新职位提醒

一旦登录您的账户，即表明您同意 SimplyHired 的服务条款和我们的Cookie 协议及隐私政策。

Data Engineer

Dalian Styxtech Systems Co. Ltd.
上海市

快速申请

职位详情

全职
月薪50,000-60,000元
15 小时前

完整职位描述

Job Title: Data Engineer (Production Support)Location: Shanghai, ChinaExperience: 8+ yearsShift Timings: GeneralHybrid/Remote: HybridStart Date: Immediate Job Description: Data Engineer (Production Support) for AWS EMR with Spark, Scala and Talend or any ETL tool Experience Position OverviewWe are seeking a highly skilled and motivated Data Engineer specializing in Production Support for AWS EMR (Elastic MapReduce) with spark, scala, Talend or any ETL tool knowledge to join our dynamic team. The ideal candidate will ensure the smooth operation, performance, and stability of large-scale distributed data processing pipelines and applications deployed on AWS EMR. This role requires a mix of strong technical expertise, problem-solving skills, and operational excellence. Key Responsibilities 1. Production Support:

Monitor, troubleshoot, and resolve issues in real-time for AWS EMR clusters and associated data pipelines.
Investigate and debug data processing failures, latency issues, and performance bottlenecks.
Provide support for mission-critical production systems as part of an on-call rotation.
Analytical and problem-solving skills applied to Big Data domain. Strong exposure in Object Oriented concepts and implementation.

2. Cluster Management:

Manage AWS EMR cluster lifecycle, including creation, scaling, termination, and optimization.
Ensure effective resource utilization and cost optimization of clusters.
Apply patches and upgrades to EMR clusters and software components as needed.

3. Data Pipeline Maintenance:

Maintain and support ETL/ELT pipelines built on tools such as Apache Spark, Hive, or Presto running on EMR.
Ensure data quality, consistency, and availability across pipelines and storage systems like S3, Redshift,Mysql or Snowflake.
Implement and monitor automated workflows using AWS tools like Step Functions, Lambda, and CloudWatch.

4. Performance Optimization:

Analyze and optimize EMR job performance by tuning Spark/Hive configurations and improving query efficiency.
Identify and address inefficiencies in data storage and access patterns.
Providing optimal solutions for performance enhancement and fine tuning of current applications.

5. Monitoring and Reporting:

Set up and manage monitoring tools (e.g., AWS CloudWatch, Datadog, or Prometheus) to track system health and performance.
Develop alerting mechanisms and dashboards for proactive issue identification.
Provide daily/weekly monitoring reports on job status and alert on any long running/resource consuming issues

6. Collaboration and Documentation:

Collaborate with software developers, data scientists, and DevOps teams to resolve issues and optimize workflows.
Maintain comprehensive documentation for troubleshooting guides, operational workflows, and best practices.

Required Skills and Qualifications Technical Expertise:

Proficiency in managing AWS services, particularly EMR, S3, Lambda, Step Functions, and CloudWatch.
Hands-on experience with distributed data processing frameworks like Apache Spark, Hive, or Presto.
Experience on Kafka, NiFi, Amazon Web Service (AWS), Maven, Ambari-TEZ, Stash and Bamboo.
Familiarity with data loading tools like Talend, Sqoop. Familiarity with cloud database like AWS Redshift, Aurora MySQL and PostgreSQL
Knowledge of workflow/schedulers like Oozie or Apache AirFlow.
Strong knowledge of Shell Scripting, python or Java for scripting and automation.
Familiarity with SQL and query optimization techniques.

Operational Skills:

Experience in production support for large-scale distributed systems or data platforms.
Ability to analyze logs, diagnose issues, and implement fixes in high-pressure scenarios.
Implement data modelling concepts, methodologies to optimize data warehouse solutions.
Manage detailed Standard Operating Procedure (SOP) using flow diagrams, source to target mapping, system architecture diagram and use cases

Problem-Solving:

Strong analytical skills to debug complex systems and resolve performance bottlenecks.
Soft Skills:
Effective communication skills to coordinate with cross-functional teams.
A proactive and customer-focused attitude to provide excellent production support.

Preferred Skills

Experience with CI/CD tools like Jenkins or GitLab for pipeline deployments.
Familiarity with container orchestration tools (e.g., Kubernetes, Docker).
Knowledge of data governance, security, and compliance in cloud environments.
Certifications in AWS (e.g., AWS Certified Big Data Specialty or AWS Certified Solutions Architect).

Education and Experience

Bachelor’s degree in computer science, Engineering, or a related field.
10+ years of experience with atleast 3-5 years on AWS Cloud platform experience in data engineering, production support, or a similar role.

Job Type: Full-time

Work Location: Hybrid remote in 上海市

快速申请

完善您的搜索

java developer 个职位

Data Engineer

Senior Professional, IT Systems

IoT Technical Support Engineer, Senior

Senior Sofware Engineer-Backend

Senior Graphics Dev Tools Engineer

Software Engineering & Development, VP

Principal Software Engineer - Map Rendering

Senior Quality Assurance Engineer (Crypto.com APP)

Software Engineering & Development, AVP

Backend QA Engineer

Lead Software Engineer - IoT

Senior AI Engineer

Technical Lead Full Stack

数字化架构及方案研发主任工程师

AI Agent Security Research Engineer

DLT Senior Full Stack Engineer

Principal Software Engineer - Customer Integration

QA Engineer

Senior R&D Engineer (Embedded Android System)

More jobs to discover

我想收到 java developer 的最新职位提醒

求职者工具

雇主工具

浏览

保持联系