Digital Engineering Staff Engineer

Details of the offer

Req ID:301995
NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.
We are currently seeking a Digital Engineering Staff Engineer to join our team in Bangalore, Karnataka (IN-KA), India (IN).
Job Duties: Key Responsibilities:
Data Pipeline Development: Design, build, and maintain scalable data pipelines using Databricks on AWS.
Data Integration: Ingest data from multiple sources (structured and unstructured) using AWS services such as S3, Lambda, Glue, and Kinesis.
Big Data Processing: Develop and optimize Spark-based ETL jobs to process large datasets on Databricks.
Data Architecture: Collaborate with the architecture team to implement best practices for cloud-based data lakes and data warehouses.
Optimization: Tune Spark jobs for performance improvements and efficient resource usage.
Strong experience with Databricks, including Apache Spark development.
Proficiency in Python or Scala for Spark job development.
Experience with SQL for querying and managing data.
Familiarity with CI/CD tools (e.g., Jenkins, GitLab) for automating deployment and testing of data pipelines.
Knowledge of big data technologies (Hadoop, Hive) and ETL frameworks.
Familiarity with AWS security best practices (IAM, VPC, security groups).

Minimum Skills Required: Data Engineer, Databricks, Cloud migration 1+ year (at least one project)
About NTT DATA
NTT DATA is a $30 billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure and connectivity. We are one of the leading providers of digital and AI infrastructure in the world. NTT DATA is a part of NTT Group, which invests over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. Visit us at us.nttdata.com
NTT DATA is an equal opportunity employer and considers all applicants without regarding to race, color, religion, citizenship, national origin, ancestry, age, sex, sexual orientation, gender identity, genetic information, physical or mental disability, veteran or marital status, or any other characteristic protected by law. We are committed to creating a diverse and inclusive environment for all employees. If you need assistance or an accommodation due to a disability, please inform your recruiter so that we may connect you with the appropriate team.


Nominal Salary: To be agreed

Source: Eightfold_Ai

Job Function:

Requirements

Senior Engineer, Test Engineering

Company Description At Western Digital, our vision is to power global innovation and push the boundaries of technology to make what you thought was once impo...


Western Digital - Karnataka

Published a month ago

Qa/ Automation Engineer

As a QA/Automation Engineer, you will be a part of the Software testing team for an IBM IaaS product. You will work in an agile, collaborative environment ac...


Ibm Careers - Karnataka

Published a month ago

Ibm Logic Design Engineer – Cache

Lead the Architecture, Design and development of processor L2 and LLC (Last Level Cache) for high-performance IBM Systems. Design and architect L2 cache and ...


Ibm Careers - Karnataka

Published a month ago

Ai Engineer

7+ years of experience in Data Science with a background in machine learning, deep learning, and natural language processing. Robust background in traditiona...


Ibm Careers - Karnataka

Published a month ago

Built at: 2024-11-15T15:24:02.806Z